2023-05-24T03:44:41.491 INFO:root:teuthology version: 0.0.1.dev101+gc6e0984 2023-05-24T03:44:41.492 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} --verbose --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314 --name pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/orig.config.yaml 2023-05-24T03:44:41.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-24T03:44:41.629 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314 branch: wip-pdonnell-testing-20230523.134409 description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} email: pdonnell@redhat.com first_in_suite: false job_id: '7284314' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20230523.134409 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230523.134409 sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 seed: 7650 sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 sleep_before_teardown: 0 subset: 449/512 suite: fs suite_branch: wip-pdonnell-testing-20230523.134409 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIcYehHKRCOZMJs0TX73ZxuODablbS0ht8/p5d3kfoXgkNWbQEwMR5zD9ZZXuD/3M6tQX9gSnmALqZj70Rg4Gu0= smithi067.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOUYy+0CXpAm6lgDQ8Z2zGCA0MeYOPttlj/daf5w+/xd smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2e/MzT90YFY933kSp8sC5l8DS0nZU55rxKQ/Vz2CmuGjeqiAsIbyBDnhPr6HcQpITpY05I8T7wQHaJhjhcN+4= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbdKZ0H3Wz2rH6WQwWfoMX0H1HuHJyuMHFKqhEX5Pu4YFuJ/mpBpRsdsebnGZ007+wQJexXSrhoDpUELvq4QgU= smithi162.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEsJoPbYwYzoVvmxpiWNCKjuwyMacSwAK4thGPAQ4eC5 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - pexec: clients: - cd $TESTDIR - wget http://download.ceph.com/qa/ior.tbz2 - tar xvfj ior.tbz2 - cd ior - ./configure - make - make install DESTDIR=$TESTDIR/binary/ - cd $TESTDIR/ - rm ior.tbz2 - rm -r ior - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile - pexec: clients: - rm -f $TESTDIR/gmnt/ior.testfile - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/binary teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: stdin-killer teuthology_sha1: c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2 timestamp: 2023-05-23_18:20:18 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-24T03:44:41.629 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa; will attempt to use it 2023-05-24T03:44:41.630 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks 2023-05-24T03:44:41.631 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-24T03:44:41.632 INFO:teuthology.task.internal:Checking packages... 2023-05-24T03:44:41.663 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28' 2023-05-24T03:44:41.663 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-24T03:44:41.664 INFO:teuthology.packaging:ref: None 2023-05-24T03:44:41.664 INFO:teuthology.packaging:tag: None 2023-05-24T03:44:41.665 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230523.134409 2023-05-24T03:44:41.665 INFO:teuthology.packaging:sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:44:41.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20230523.134409 2023-05-24T03:44:41.858 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:44:41.859 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-24T03:44:41.868 INFO:teuthology.task.internal:no buildpackages task found 2023-05-24T03:44:41.870 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-24T03:44:41.887 INFO:teuthology.task.internal:Saving configuration 2023-05-24T03:44:41.907 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-24T03:44:41.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T03:44:41.954 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.488544', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIArjcYRtDs1DAR7Ujc/lSDFeY1m/p1ARRDobegoluBko'} 2023-05-24T03:44:41.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.487276', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOUYy+0CXpAm6lgDQ8Z2zGCA0MeYOPttlj/daf5w+/xd'} 2023-05-24T03:44:42.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.484297', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG0atbTm2w59qw3MzxsSPJ0fiz0EnVt2h8q6cyG1G9sC'} 2023-05-24T03:44:42.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.486041', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG9dbLBmwcJ+GuXn3bVA0UD8NeVgeIaBLGOlPy2DGfpa'} 2023-05-24T03:44:42.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.489784', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEsJoPbYwYzoVvmxpiWNCKjuwyMacSwAK4thGPAQ4eC5'} 2023-05-24T03:44:42.056 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-24T03:44:42.068 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-05-24T03:44:42.069 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-05-24T03:44:42.069 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['client.0'] 2023-05-24T03:44:42.069 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['client.1'] 2023-05-24T03:44:42.069 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['client.2'] 2023-05-24T03:44:42.069 INFO:teuthology.run_tasks:Running task console_log... 2023-05-24T03:44:42.294 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d7aa11040>, signals=[15]) 2023-05-24T03:44:42.296 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-24T03:44:42.308 INFO:teuthology.task.internal:Opening connections... 2023-05-24T03:44:42.308 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T03:44:42.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:44:42.389 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T03:44:42.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:44:42.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2023-05-24T03:44:42.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:44:42.541 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-05-24T03:44:42.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:44:42.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2023-05-24T03:44:42.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:44:42.692 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-24T03:44:42.707 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-05-24T03:44:42.715 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-05-24T03:44:42.715 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-05-24T03:44:42.760 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-24T03:44:42.761 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2023-05-24T03:44:42.761 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04" 2023-05-24T03:44:42.761 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-24T03:44:42.761 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-24T03:44:42.762 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy 2023-05-24T03:44:42.764 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-05-24T03:44:42.790 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-05-24T03:44:42.797 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-05-24T03:44:42.797 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-05-24T03:44:42.843 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-24T03:44:42.843 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2023-05-24T03:44:42.843 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="22.04" 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=jammy 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-24T03:44:42.844 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-24T03:44:42.845 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-24T03:44:42.845 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=jammy 2023-05-24T03:44:42.845 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-05-24T03:44:42.873 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-05-24T03:44:42.879 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-05-24T03:44:42.880 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-05-24T03:44:42.926 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-24T03:44:42.927 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2023-05-24T03:44:42.927 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2023-05-24T03:44:42.927 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-24T03:44:42.927 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2023-05-24T03:44:42.927 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2023-05-24T03:44:42.927 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2023-05-24T03:44:42.928 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-24T03:44:42.928 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-24T03:44:42.928 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-24T03:44:42.928 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-24T03:44:42.928 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2023-05-24T03:44:42.928 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-05-24T03:44:42.957 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-05-24T03:44:42.965 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-05-24T03:44:42.966 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-05-24T03:44:43.015 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-24T03:44:43.016 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2023-05-24T03:44:43.016 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2023-05-24T03:44:43.016 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-24T03:44:43.017 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-24T03:44:43.018 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2023-05-24T03:44:43.018 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-05-24T03:44:43.049 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-05-24T03:44:43.055 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-05-24T03:44:43.055 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-05-24T03:44:43.104 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-24T03:44:43.105 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-05-24T03:44:43.105 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-05-24T03:44:43.105 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-24T03:44:43.106 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-05-24T03:44:43.106 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-05-24T03:44:43.106 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-05-24T03:44:43.107 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-24T03:44:43.107 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-24T03:44:43.107 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-24T03:44:43.107 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-24T03:44:43.108 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-05-24T03:44:43.109 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-05-24T03:44:43.132 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-24T03:44:43.149 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-24T03:44:43.192 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-24T03:44:43.193 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:44:43.195 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:44:43.198 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:44:43.201 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:44:43.205 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:44:43.210 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-24T03:44:43.220 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-24T03:44:43.220 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:44:43.243 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:44:43.246 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:44:43.248 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:44:43.252 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:44:43.270 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-24T03:44:43.432 INFO:teuthology.run_tasks:Running task kernel... 2023-05-24T03:44:43.451 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-05-24T03:44:43.452 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-05-24T03:44:43.452 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:44:43.453 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:44:43.453 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:44:43.454 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:44:43.455 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:44:43.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:44:43.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:44:43.461 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-05-24T03:44:43.461 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2023-05-24T03:44:43.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:44:43.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:44:43.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:44:43.464 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2023-05-24T03:44:43.464 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-05-24T03:44:43.465 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-05-24T03:44:43.506 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-56-generic 2023-05-24T03:44:43.506 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.15.0-56-generic 2023-05-24T03:44:43.506 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2023-05-24T03:44:43.508 INFO:teuthology.orchestra.run.smithi121.stdout:5.15.0-56-generic 2023-05-24T03:44:43.509 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.15.0-56-generic 2023-05-24T03:44:43.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2023-05-24T03:44:43.511 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-56-generic 2023-05-24T03:44:43.512 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.15.0-56-generic 2023-05-24T03:44:43.512 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2023-05-24T03:44:43.513 INFO:teuthology.orchestra.run.smithi067.stdout:5.15.0-56-generic 2023-05-24T03:44:43.513 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.15.0-56-generic 2023-05-24T03:44:43.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get clean 2023-05-24T03:44:43.514 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-56-generic 2023-05-24T03:44:43.515 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.15.0-56-generic 2023-05-24T03:44:43.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2023-05-24T03:44:43.628 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2023-05-24T03:44:43.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2023-05-24T03:44:43.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2023-05-24T03:44:43.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-05-24T03:44:43.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2023-05-24T03:44:43.784 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:44:43.785 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:44:43.792 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-05-24T03:44:43.801 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-05-24T03:44:43.802 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:44:43.819 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-05-24T03:44:43.857 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-05-24T03:44:43.861 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-05-24T03:44:43.882 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-05-24T03:44:43.896 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-05-24T03:44:43.902 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-05-24T03:44:43.921 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-05-24T03:44:43.922 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:44:43.922 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-05-24T03:44:43.977 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-05-24T03:44:44.029 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [609 kB] 2023-05-24T03:44:44.037 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [397 kB] 2023-05-24T03:44:44.059 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [609 kB] 2023-05-24T03:44:44.071 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:44:44.072 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-05-24T03:44:44.096 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [609 kB] 2023-05-24T03:44:44.097 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [397 kB] 2023-05-24T03:44:44.105 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [172 kB] 2023-05-24T03:44:44.110 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:44.110 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [172 kB] 2023-05-24T03:44:44.116 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-05-24T03:44:44.117 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [38.7 kB] 2023-05-24T03:44:44.117 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.118 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:44.119 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [397 kB] 2023-05-24T03:44:44.126 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-05-24T03:44:44.127 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-05-24T03:44:44.127 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [38.7 kB] 2023-05-24T03:44:44.127 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.133 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [172 kB] 2023-05-24T03:44:44.137 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:44.137 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.143 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-05-24T03:44:44.144 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [38.7 kB] 2023-05-24T03:44:44.144 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.152 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [612 kB] 2023-05-24T03:44:44.162 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [906 kB] 2023-05-24T03:44:44.179 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [906 kB] 2023-05-24T03:44:44.267 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [906 kB] 2023-05-24T03:44:44.289 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [612 kB] 2023-05-24T03:44:44.290 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [186 kB] 2023-05-24T03:44:44.293 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [18.9 kB] 2023-05-24T03:44:44.293 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-05-24T03:44:44.295 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-05-24T03:44:44.295 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-05-24T03:44:44.295 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-05-24T03:44:44.296 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-05-24T03:44:44.296 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-05-24T03:44:44.296 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-05-24T03:44:44.297 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [186 kB] 2023-05-24T03:44:44.300 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [18.9 kB] 2023-05-24T03:44:44.300 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-05-24T03:44:44.301 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-05-24T03:44:44.301 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-05-24T03:44:44.301 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-05-24T03:44:44.302 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-05-24T03:44:44.305 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [612 kB] 2023-05-24T03:44:44.306 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-05-24T03:44:44.306 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-05-24T03:44:44.313 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [186 kB] 2023-05-24T03:44:44.315 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [18.9 kB] 2023-05-24T03:44:44.316 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-05-24T03:44:44.316 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-05-24T03:44:44.317 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-05-24T03:44:44.317 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-05-24T03:44:44.317 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-05-24T03:44:44.321 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-05-24T03:44:44.321 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-05-24T03:44:44.328 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [394 kB] 2023-05-24T03:44:44.329 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-05-24T03:44:44.330 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-05-24T03:44:44.331 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [216 kB] 2023-05-24T03:44:44.341 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-05-24T03:44:44.344 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [216 kB] 2023-05-24T03:44:44.348 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-05-24T03:44:44.356 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-05-24T03:44:44.359 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-05-24T03:44:44.368 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-05-24T03:44:44.370 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [394 kB] 2023-05-24T03:44:44.374 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-05-24T03:44:44.375 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-05-24T03:44:44.376 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-05-24T03:44:44.385 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-05-24T03:44:44.386 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-05-24T03:44:44.393 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-05-24T03:44:44.397 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-05-24T03:44:44.400 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-05-24T03:44:44.411 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-05-24T03:44:44.467 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [609 kB] 2023-05-24T03:44:44.480 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-05-24T03:44:44.487 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [216 kB] 2023-05-24T03:44:44.547 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [394 kB] 2023-05-24T03:44:44.557 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [394 kB] 2023-05-24T03:44:44.607 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [216 kB] 2023-05-24T03:44:44.635 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [113 kB] 2023-05-24T03:44:44.640 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [216 kB] 2023-05-24T03:44:44.647 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [113 kB] 2023-05-24T03:44:44.649 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [9,884 B] 2023-05-24T03:44:44.650 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.652 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [609 kB] 2023-05-24T03:44:44.659 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [113 kB] 2023-05-24T03:44:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [397 kB] 2023-05-24T03:44:44.668 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [113 kB] 2023-05-24T03:44:44.673 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [9,884 B] 2023-05-24T03:44:44.675 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.682 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [9,884 B] 2023-05-24T03:44:44.684 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.684 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [9,884 B] 2023-05-24T03:44:44.687 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-05-24T03:44:44.692 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.717 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-05-24T03:44:44.720 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [38.3 kB] 2023-05-24T03:44:44.724 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.724 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [529 kB] 2023-05-24T03:44:44.726 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-05-24T03:44:44.727 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [172 kB] 2023-05-24T03:44:44.728 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [38.3 kB] 2023-05-24T03:44:44.728 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.729 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [529 kB] 2023-05-24T03:44:44.731 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [38.3 kB] 2023-05-24T03:44:44.735 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [394 kB] 2023-05-24T03:44:44.735 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.735 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [529 kB] 2023-05-24T03:44:44.737 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-05-24T03:44:44.741 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [38.3 kB] 2023-05-24T03:44:44.743 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:44.745 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.746 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.746 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [529 kB] 2023-05-24T03:44:44.765 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-05-24T03:44:44.767 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [38.7 kB] 2023-05-24T03:44:44.769 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.773 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [727 kB] 2023-05-24T03:44:44.774 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [727 kB] 2023-05-24T03:44:44.785 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [727 kB] 2023-05-24T03:44:44.806 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [727 kB] 2023-05-24T03:44:44.817 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [397 kB] 2023-05-24T03:44:44.838 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [113 kB] 2023-05-24T03:44:44.863 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [9,884 B] 2023-05-24T03:44:44.866 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-05-24T03:44:44.872 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.881 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [172 kB] 2023-05-24T03:44:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [260 kB] 2023-05-24T03:44:44.922 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-05-24T03:44:44.922 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [38.3 kB] 2023-05-24T03:44:44.923 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [38.7 kB] 2023-05-24T03:44:44.923 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.924 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [529 kB] 2023-05-24T03:44:44.925 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-05-24T03:44:44.936 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [612 kB] 2023-05-24T03:44:44.964 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [727 kB] 2023-05-24T03:44:44.980 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [127 kB] 2023-05-24T03:44:44.988 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [127 kB] 2023-05-24T03:44:44.998 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [127 kB] 2023-05-24T03:44:45.013 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [127 kB] 2023-05-24T03:44:45.089 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [612 kB] 2023-05-24T03:44:45.177 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [127 kB] 2023-05-24T03:44:45.349 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:45.354 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-05-24T03:44:45.356 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:45.363 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-05-24T03:44:45.365 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:45.369 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-05-24T03:44:45.371 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-05-24T03:44:45.371 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-05-24T03:44:45.377 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-05-24T03:44:45.380 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:45.380 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-05-24T03:44:45.385 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-05-24T03:44:45.387 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-05-24T03:44:45.388 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-05-24T03:44:45.402 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-05-24T03:44:45.404 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-05-24T03:44:45.496 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [906 kB] 2023-05-24T03:44:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [14.6 kB] 2023-05-24T03:44:45.550 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-05-24T03:44:45.565 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-05-24T03:44:45.567 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-05-24T03:44:45.604 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [186 kB] 2023-05-24T03:44:45.622 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [18.9 kB] 2023-05-24T03:44:45.623 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-05-24T03:44:45.627 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-05-24T03:44:45.628 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-05-24T03:44:45.629 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-05-24T03:44:45.629 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-05-24T03:44:45.631 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-05-24T03:44:45.634 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-05-24T03:44:45.654 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [906 kB] 2023-05-24T03:44:45.760 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [186 kB] 2023-05-24T03:44:45.778 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [18.9 kB] 2023-05-24T03:44:45.779 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-05-24T03:44:45.780 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-05-24T03:44:45.783 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-05-24T03:44:45.784 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-05-24T03:44:45.784 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-05-24T03:44:45.788 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-05-24T03:44:45.790 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-05-24T03:44:45.799 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-05-24T03:44:45.882 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-05-24T03:44:45.955 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-05-24T03:44:45.978 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-05-24T03:44:46.006 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-05-24T03:44:46.038 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-05-24T03:44:46.057 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-05-24T03:44:46.120 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-05-24T03:44:46.163 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-05-24T03:44:46.214 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-05-24T03:44:49.408 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 6,257 kB in 2s (3,752 kB/s) 2023-05-24T03:44:49.416 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 6,257 kB in 2s (3,698 kB/s) 2023-05-24T03:44:49.675 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 6,257 kB in 2s (3,754 kB/s) 2023-05-24T03:44:50.051 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 6,257 kB in 2s (2,669 kB/s) 2023-05-24T03:44:50.551 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:44:50.568 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:44:50.596 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 6,257 kB in 2s (2,645 kB/s) 2023-05-24T03:44:50.627 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:44:50.659 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:44:50.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:44:50.737 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:44:50.798 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2023-05-24T03:44:50.799 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2023-05-24T03:44:50.909 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2023-05-24T03:44:50.910 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2023-05-24T03:44:50.915 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:44:50.932 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:44:50.941 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:44:50.941 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:44:50.941 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:44:50.942 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:44:50.942 INFO:teuthology.orchestra.run.smithi162.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-24T03:44:50.942 INFO:teuthology.orchestra.run.smithi162.stdout: python2.7-minimal 2023-05-24T03:44:50.942 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:44:50.943 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2023-05-24T03:44:50.944 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:50.944 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-generic linux-image-5.15.0-72-generic 2023-05-24T03:44:50.945 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-5.15.0-72-generic linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:50.945 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2023-05-24T03:44:50.945 INFO:teuthology.orchestra.run.smithi162.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-05-24T03:44:50.945 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2023-05-24T03:44:50.945 INFO:teuthology.orchestra.run.smithi162.stdout: thermald 2023-05-24T03:44:50.986 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:44:50.989 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2023-05-24T03:44:50.990 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:50.990 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.15.0-72-generic linux-modules-5.15.0-72-generic 2023-05-24T03:44:50.991 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:50.992 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2023-05-24T03:44:50.992 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-24T03:44:51.050 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:44:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:44:51.050 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:44:51.051 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:44:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-24T03:44:51.052 INFO:teuthology.orchestra.run.smithi155.stdout: python2.7-minimal 2023-05-24T03:44:51.053 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:44:51.053 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2023-05-24T03:44:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:51.053 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-generic linux-image-5.15.0-72-generic 2023-05-24T03:44:51.054 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-5.15.0-72-generic linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:51.054 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2023-05-24T03:44:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-05-24T03:44:51.055 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2023-05-24T03:44:51.055 INFO:teuthology.orchestra.run.smithi155.stdout: thermald 2023-05-24T03:44:51.105 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2023-05-24T03:44:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:51.105 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.15.0-72-generic linux-modules-5.15.0-72-generic 2023-05-24T03:44:51.106 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:51.107 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2023-05-24T03:44:51.107 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-24T03:44:51.149 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2023-05-24T03:44:51.149 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2023-05-24T03:44:51.159 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:44:51.168 INFO:teuthology.orchestra.run.smithi162.stdout:3 upgraded, 5 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:44:51.168 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 114 MB of archives. 2023-05-24T03:44:51.168 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 596 MB of additional disk space will be used. 2023-05-24T03:44:51.168 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-72-generic amd64 5.15.0-72.79 [23.2 MB] 2023-05-24T03:44:51.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:44:51.224 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:44:51.282 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:44:51.283 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:44:51.283 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:44:51.283 INFO:teuthology.orchestra.run.smithi155.stdout:3 upgraded, 5 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:44:51.284 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 114 MB of archives. 2023-05-24T03:44:51.284 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 596 MB of additional disk space will be used. 2023-05-24T03:44:51.284 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-72-generic amd64 5.15.0-72.79 [23.2 MB] 2023-05-24T03:44:51.284 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:44:51.285 INFO:teuthology.orchestra.run.smithi067.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-24T03:44:51.285 INFO:teuthology.orchestra.run.smithi067.stdout: python2.7-minimal 2023-05-24T03:44:51.285 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:44:51.285 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2023-05-24T03:44:51.285 INFO:teuthology.orchestra.run.smithi067.stdout: linux-generic linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:51.285 INFO:teuthology.orchestra.run.smithi067.stdout: linux-headers-generic linux-image-5.15.0-72-generic 2023-05-24T03:44:51.286 INFO:teuthology.orchestra.run.smithi067.stdout: linux-modules-5.15.0-72-generic linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:51.286 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2023-05-24T03:44:51.286 INFO:teuthology.orchestra.run.smithi067.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-05-24T03:44:51.286 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2023-05-24T03:44:51.286 INFO:teuthology.orchestra.run.smithi067.stdout: thermald 2023-05-24T03:44:51.340 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2023-05-24T03:44:51.340 INFO:teuthology.orchestra.run.smithi067.stdout: linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:51.341 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.15.0-72-generic linux-modules-5.15.0-72-generic 2023-05-24T03:44:51.341 INFO:teuthology.orchestra.run.smithi067.stdout: linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:51.341 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2023-05-24T03:44:51.342 INFO:teuthology.orchestra.run.smithi067.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-24T03:44:51.376 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2023-05-24T03:44:51.377 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2023-05-24T03:44:51.391 INFO:teuthology.orchestra.run.smithi067.stdout:3 upgraded, 5 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:44:51.392 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 114 MB of archives. 2023-05-24T03:44:51.392 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 596 MB of additional disk space will be used. 2023-05-24T03:44:51.392 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-72-generic amd64 5.15.0-72.79 [23.2 MB] 2023-05-24T03:44:51.508 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:44:51.509 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:44:51.509 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:44:51.509 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:44:51.510 INFO:teuthology.orchestra.run.smithi121.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-24T03:44:51.510 INFO:teuthology.orchestra.run.smithi121.stdout: python2.7-minimal 2023-05-24T03:44:51.510 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:44:51.511 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2023-05-24T03:44:51.512 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:51.512 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-generic linux-image-5.15.0-72-generic 2023-05-24T03:44:51.512 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-5.15.0-72-generic linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:51.513 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2023-05-24T03:44:51.513 INFO:teuthology.orchestra.run.smithi121.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-05-24T03:44:51.513 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2023-05-24T03:44:51.513 INFO:teuthology.orchestra.run.smithi121.stdout: thermald 2023-05-24T03:44:51.552 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2023-05-24T03:44:51.552 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:51.553 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.15.0-72-generic linux-modules-5.15.0-72-generic 2023-05-24T03:44:51.553 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:51.553 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2023-05-24T03:44:51.553 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-24T03:44:51.601 INFO:teuthology.orchestra.run.smithi121.stdout:3 upgraded, 5 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:44:51.601 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 114 MB of archives. 2023-05-24T03:44:51.602 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 596 MB of additional disk space will be used. 2023-05-24T03:44:51.602 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-72-generic amd64 5.15.0-72.79 [23.2 MB] 2023-05-24T03:44:51.845 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-72-generic amd64 5.15.0-72.79 [11.4 MB] 2023-05-24T03:44:51.867 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:44:51.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:44:51.949 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:44:51.949 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-72-generic amd64 5.15.0-72.79 [64.2 MB] 2023-05-24T03:44:52.040 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-72-generic amd64 5.15.0-72.79 [11.4 MB] 2023-05-24T03:44:52.122 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-05-24T03:44:52.123 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-05-24T03:44:52.150 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-72-generic amd64 5.15.0-72.79 [64.2 MB] 2023-05-24T03:44:52.273 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:44:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:44:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:44:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:44:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-24T03:44:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: python2.7-minimal 2023-05-24T03:44:52.275 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:44:52.276 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-05-24T03:44:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-generic linux-image-5.15.0-72-generic 2023-05-24T03:44:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-5.15.0-72-generic linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:52.277 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-05-24T03:44:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-05-24T03:44:52.278 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2023-05-24T03:44:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: thermald 2023-05-24T03:44:52.325 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-05-24T03:44:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-5.15.0-72 linux-headers-5.15.0-72-generic 2023-05-24T03:44:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.15.0-72-generic linux-modules-5.15.0-72-generic 2023-05-24T03:44:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-extra-5.15.0-72-generic 2023-05-24T03:44:52.326 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-05-24T03:44:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-24T03:44:52.508 INFO:teuthology.orchestra.run.smithi040.stdout:3 upgraded, 5 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:44:52.508 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 114 MB of archives. 2023-05-24T03:44:52.509 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 596 MB of additional disk space will be used. 2023-05-24T03:44:52.509 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-72-generic amd64 5.15.0-72.79 [23.2 MB] 2023-05-24T03:44:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-72-generic amd64 5.15.0-72.79 [11.4 MB] 2023-05-24T03:44:52.765 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.72.70 [1,700 B] 2023-05-24T03:44:52.766 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.72.70 [2,496 B] 2023-05-24T03:44:52.766 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72 all 5.15.0-72.79 [12.3 MB] 2023-05-24T03:44:52.790 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-72-generic amd64 5.15.0-72.79 [11.4 MB] 2023-05-24T03:44:52.893 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72-generic amd64 5.15.0-72.79 [2,895 kB] 2023-05-24T03:44:52.915 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.72.70 [2,346 B] 2023-05-24T03:44:52.963 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.72.70 [1,700 B] 2023-05-24T03:44:52.963 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.72.70 [2,496 B] 2023-05-24T03:44:52.963 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72 all 5.15.0-72.79 [12.3 MB] 2023-05-24T03:44:53.039 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-72-generic amd64 5.15.0-72.79 [64.2 MB] 2023-05-24T03:44:53.082 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72-generic amd64 5.15.0-72.79 [2,895 kB] 2023-05-24T03:44:53.104 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.72.70 [2,346 B] 2023-05-24T03:44:53.137 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-72-generic amd64 5.15.0-72.79 [64.2 MB] 2023-05-24T03:44:53.383 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 114 MB in 2s (69.9 MB/s) 2023-05-24T03:44:53.564 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 114 MB in 2s (70.8 MB/s) 2023-05-24T03:44:53.564 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-modules-5.15.0-72-generic. 2023-05-24T03:44:53.730 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-5.15.0-72-generic. 2023-05-24T03:44:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-72-generic amd64 5.15.0-72.79 [11.4 MB] 2023-05-24T03:44:54.332 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-72-generic amd64 5.15.0-72.79 [64.2 MB] 2023-05-24T03:44:55.250 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.72.70 [1,700 B] 2023-05-24T03:44:55.250 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.72.70 [2,496 B] 2023-05-24T03:44:55.250 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72 all 5.15.0-72.79 [12.3 MB] 2023-05-24T03:44:55.295 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.72.70 [1,700 B] 2023-05-24T03:44:55.296 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.72.70 [2,496 B] 2023-05-24T03:44:55.296 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72 all 5.15.0-72.79 [12.3 MB] 2023-05-24T03:44:55.570 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-05-24T03:44:55.574 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../0-linux-modules-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:55.661 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:55.685 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-05-24T03:44:55.689 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../0-linux-modules-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:55.777 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:55.791 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72-generic amd64 5.15.0-72.79 [2,895 kB] 2023-05-24T03:44:55.847 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.72.70 [2,346 B] 2023-05-24T03:44:56.215 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 114 MB in 5s (24.1 MB/s) 2023-05-24T03:44:56.418 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-5.15.0-72-generic. 2023-05-24T03:44:56.460 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72-generic amd64 5.15.0-72.79 [2,895 kB] 2023-05-24T03:44:56.572 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.72.70 [2,346 B] 2023-05-24T03:44:56.742 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.72.70 [1,700 B] 2023-05-24T03:44:56.743 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.72.70 [2,496 B] 2023-05-24T03:44:56.743 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72 all 5.15.0-72.79 [12.3 MB] 2023-05-24T03:44:56.980 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 114 MB in 6s (20.5 MB/s) 2023-05-24T03:44:57.161 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-5.15.0-72-generic. 2023-05-24T03:44:57.638 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-72-generic amd64 5.15.0-72.79 [2,895 kB] 2023-05-24T03:44:57.773 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.72.70 [2,346 B] 2023-05-24T03:44:57.929 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-image-5.15.0-72-generic. 2023-05-24T03:44:57.951 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../1-linux-image-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:58.050 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:58.294 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-image-5.15.0-72-generic. 2023-05-24T03:44:58.316 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../1-linux-image-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:58.335 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 114 MB in 5s (21.0 MB/s) 2023-05-24T03:44:58.426 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-05-24T03:44:58.435 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../0-linux-modules-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:58.480 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:58.516 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-72-generic. 2023-05-24T03:44:58.534 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-5.15.0-72-generic. 2023-05-24T03:44:58.536 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:58.541 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:58.565 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:58.889 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-72-generic. 2023-05-24T03:44:58.909 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:58.964 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:44:59.107 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-05-24T03:44:59.111 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../0-linux-modules-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:44:59.275 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:00.572 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-05-24T03:45:00.575 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../0-linux-modules-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:00.820 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:00.918 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-5.15.0-72-generic. 2023-05-24T03:45:00.940 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../1-linux-image-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:01.034 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-72-generic. 2023-05-24T03:45:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:01.967 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-image-5.15.0-72-generic. 2023-05-24T03:45:01.988 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../1-linux-image-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:02.080 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:02.545 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-72-generic. 2023-05-24T03:45:02.566 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:02.603 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:03.241 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-image-5.15.0-72-generic. 2023-05-24T03:45:03.263 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../1-linux-image-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:03.870 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-72-generic. 2023-05-24T03:45:03.891 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:03.945 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:05.273 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../3-linux-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:05.400 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:05.567 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../3-linux-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:05.710 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:05.732 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:05.845 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:06.028 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:06.156 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:06.156 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.15.0-72. 2023-05-24T03:45:06.178 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../5-linux-headers-5.15.0-72_5.15.0-72.79_all.deb ... 2023-05-24T03:45:06.223 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:06.483 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-headers-5.15.0-72. 2023-05-24T03:45:06.494 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../5-linux-headers-5.15.0-72_5.15.0-72.79_all.deb ... 2023-05-24T03:45:06.534 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:08.843 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../3-linux-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:08.879 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../3-linux-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:08.962 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:09.028 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:09.261 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:09.361 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:09.391 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:09.499 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:09.669 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-72. 2023-05-24T03:45:09.691 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../5-linux-headers-5.15.0-72_5.15.0-72.79_all.deb ... 2023-05-24T03:45:09.735 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:09.794 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.15.0-72. 2023-05-24T03:45:09.817 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../5-linux-headers-5.15.0-72_5.15.0-72.79_all.deb ... 2023-05-24T03:45:09.868 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:11.030 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../3-linux-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:11.182 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:11.516 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:11.644 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-72. 2023-05-24T03:45:11.995 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.15.0-72-generic. 2023-05-24T03:45:11.996 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../5-linux-headers-5.15.0-72_5.15.0-72.79_all.deb ... 2023-05-24T03:45:12.031 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../6-linux-headers-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:12.039 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:12.078 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:12.698 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-headers-5.15.0-72-generic. 2023-05-24T03:45:12.735 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../6-linux-headers-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:12.772 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:14.657 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:14.763 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:15.096 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:15.103 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-72-generic. 2023-05-24T03:45:15.138 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../6-linux-headers-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:15.177 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:15.218 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:15.344 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-generic (5.15.0.72.70) ... 2023-05-24T03:45:15.456 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:15.482 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:15.610 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.15.0-72-generic. 2023-05-24T03:45:15.960 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../6-linux-headers-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:16.065 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-generic (5.15.0.72.70) ... 2023-05-24T03:45:16.320 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:16.773 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:16.773 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:16.773 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:16.773 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:16.943 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:17.687 INFO:teuthology.orchestra.run.smithi067.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:17.687 INFO:teuthology.orchestra.run.smithi067.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:17.688 INFO:teuthology.orchestra.run.smithi067.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:17.688 INFO:teuthology.orchestra.run.smithi067.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:17.971 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:18.094 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-72-generic. 2023-05-24T03:45:18.132 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../6-linux-headers-5.15.0-72-generic_5.15.0-72.79_amd64.deb ... 2023-05-24T03:45:18.169 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:18.182 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:18.305 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:18.346 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:18.639 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:18.675 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:18.760 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:18.823 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:18.886 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-generic (5.15.0.72.70) ... 2023-05-24T03:45:19.015 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:19.565 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:19.623 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:19.696 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:19.813 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-generic (5.15.0.72.70) ... 2023-05-24T03:45:19.942 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:19.971 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-generic (5.15.0.72.70) ... 2023-05-24T03:45:20.072 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-generic (5.15.0.72.70) ... 2023-05-24T03:45:20.173 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:20.238 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-24T03:45:20.238 INFO:teuthology.orchestra.run.smithi121.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:20.337 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:20.338 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:20.338 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:20.338 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:20.500 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:21.065 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-generic (5.15.0.72.70) ... 2023-05-24T03:45:21.216 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-generic (5.15.0.72.70) ... 2023-05-24T03:45:21.298 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:21.298 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:21.298 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:21.298 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:21.343 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:21.400 INFO:teuthology.orchestra.run.smithi067.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-24T03:45:21.401 INFO:teuthology.orchestra.run.smithi067.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:21.478 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:21.504 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.72.70_amd64.deb ... 2023-05-24T03:45:21.630 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-generic (5.15.0.72.70) over (5.15.0.56.54) ... 2023-05-24T03:45:21.894 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:22.005 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-72 (5.15.0-72.79) ... 2023-05-24T03:45:22.126 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:22.294 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-generic (5.15.0.72.70) ... 2023-05-24T03:45:22.423 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:22.905 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:23.253 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-generic (5.15.0.72.70) ... 2023-05-24T03:45:23.380 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-generic (5.15.0.72.70) ... 2023-05-24T03:45:23.505 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:23.580 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-24T03:45:23.581 INFO:teuthology.orchestra.run.smithi162.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:23.771 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:23.771 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:23.771 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:23.771 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:23.916 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:24.315 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-generic (5.15.0.72.70) ... 2023-05-24T03:45:24.415 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-generic (5.15.0.72.70) ... 2023-05-24T03:45:25.225 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:25.293 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-24T03:45:25.294 INFO:teuthology.orchestra.run.smithi155.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:25.660 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-extra-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:27.077 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-generic (5.15.0.72.70) ... 2023-05-24T03:45:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-generic (5.15.0.72.70) ... 2023-05-24T03:45:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for linux-image-5.15.0-72-generic (5.15.0-72.79) ... 2023-05-24T03:45:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-24T03:45:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:34.825 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-24T03:45:34.826 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub' 2023-05-24T03:45:34.837 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:34.859 INFO:teuthology.orchestra.run.smithi121.stdout:Generating grub configuration file ... 2023-05-24T03:45:35.128 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:35.158 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:35.418 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:35.424 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:35.500 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:35.506 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:35.680 INFO:teuthology.orchestra.run.smithi121.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:35.681 INFO:teuthology.orchestra.run.smithi121.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:35.681 INFO:teuthology.orchestra.run.smithi121.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:35.721 INFO:teuthology.orchestra.run.smithi121.stdout:done 2023-05-24T03:45:35.823 INFO:teuthology.orchestra.run.smithi067.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-24T03:45:35.868 INFO:teuthology.orchestra.run.smithi067.stdout:Sourcing file `/etc/default/grub' 2023-05-24T03:45:35.868 INFO:teuthology.orchestra.run.smithi067.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:35.869 INFO:teuthology.orchestra.run.smithi067.stdout:Generating grub configuration file ... 2023-05-24T03:45:36.159 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2023-05-24T03:45:36.162 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:36.177 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 20 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2023-05-24T03:45:36.178 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:36.179 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2023-05-24T03:45:36.180 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-72-generic 2023-05-24T03:45:36.180 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-24T03:45:36.180 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-24T03:45:36.180 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-05-24T03:45:36.180 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2023-05-24T03:45:36.181 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2023-05-24T03:45:36.181 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:36.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2023-05-24T03:45:36.462 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:36.502 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:36.502 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:45:36.503 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:45:36.503 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:45:36.503 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:45:36.544 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:36.550 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:36.719 INFO:teuthology.orchestra.run.smithi067.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:36.719 INFO:teuthology.orchestra.run.smithi067.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:36.719 INFO:teuthology.orchestra.run.smithi067.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:36.776 INFO:teuthology.orchestra.run.smithi067.stdout:done 2023-05-24T03:45:37.263 DEBUG:teuthology.orchestra.run.smithi067:> dpkg -s linux-image-generic 2023-05-24T03:45:37.303 INFO:teuthology.orchestra.run.smithi067.stdout:Package: linux-image-generic 2023-05-24T03:45:37.304 INFO:teuthology.orchestra.run.smithi067.stdout:Status: install ok installed 2023-05-24T03:45:37.304 INFO:teuthology.orchestra.run.smithi067.stdout:Priority: optional 2023-05-24T03:45:37.304 INFO:teuthology.orchestra.run.smithi067.stdout:Section: kernel 2023-05-24T03:45:37.304 INFO:teuthology.orchestra.run.smithi067.stdout:Installed-Size: 20 2023-05-24T03:45:37.304 INFO:teuthology.orchestra.run.smithi067.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:37.304 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: amd64 2023-05-24T03:45:37.305 INFO:teuthology.orchestra.run.smithi067.stdout:Source: linux-meta 2023-05-24T03:45:37.305 INFO:teuthology.orchestra.run.smithi067.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:37.305 INFO:teuthology.orchestra.run.smithi067.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:37.305 INFO:teuthology.orchestra.run.smithi067.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:37.305 INFO:teuthology.orchestra.run.smithi067.stdout:Recommends: thermald 2023-05-24T03:45:37.306 INFO:teuthology.orchestra.run.smithi067.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:37.306 INFO:teuthology.orchestra.run.smithi067.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:37.306 INFO:teuthology.orchestra.run.smithi067.stdout: available. 2023-05-24T03:45:37.306 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-72-generic 2023-05-24T03:45:37.306 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-24T03:45:37.307 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-24T03:45:37.307 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-05-24T03:45:37.307 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2023-05-24T03:45:37.308 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get clean 2023-05-24T03:45:37.481 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2023-05-24T03:45:37.692 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:45:37.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:45:37.760 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:45:37.760 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:45:37.761 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:45:37.819 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:45:37.837 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-24T03:45:37.838 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub' 2023-05-24T03:45:37.849 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:37.865 INFO:teuthology.orchestra.run.smithi162.stdout:Generating grub configuration file ... 2023-05-24T03:45:37.901 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:45:37.918 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2023-05-24T03:45:37.920 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2023-05-24T03:45:38.051 INFO:teuthology.orchestra.run.smithi121.stdout:linux-image-generic is already the newest version (5.15.0.72.70). 2023-05-24T03:45:38.051 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:45:38.051 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:45:38.051 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:45:38.051 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:45:38.052 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:45:38.052 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:45:38.052 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:45:38.086 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 0 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:45:38.088 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2023-05-24T03:45:38.134 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:38.149 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:38.150 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2023-05-24T03:45:38.150 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2023-05-24T03:45:38.150 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2023-05-24T03:45:38.150 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2023-05-24T03:45:38.150 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 20 2023-05-24T03:45:38.151 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:38.151 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2023-05-24T03:45:38.151 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2023-05-24T03:45:38.151 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:38.151 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:38.151 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:38.152 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2023-05-24T03:45:38.152 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:38.152 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:38.152 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2023-05-24T03:45:38.153 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2023-05-24T03:45:38.203 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.A40gojEww0 2023-05-24T03:45:38.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub/grub.cfg /tmp/tmp.A40gojEww0 2023-05-24T03:45:38.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.A40gojEww0 2023-05-24T03:45:38.380 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.A40gojEww0 is 10KB 2023-05-24T03:45:38.396 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.A40gojEww0 2023-05-24T03:45:38.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:38.444 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:38.450 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:38.461 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:45:38.461 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-24T03:45:38.461 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:38.523 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:38.525 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-72-generic 2023-05-24T03:45:38.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo update-grub 2023-05-24T03:45:38.528 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:38.688 INFO:teuthology.orchestra.run.smithi162.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:38.689 INFO:teuthology.orchestra.run.smithi162.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:38.689 INFO:teuthology.orchestra.run.smithi162.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:38.733 INFO:teuthology.orchestra.run.smithi162.stdout:done 2023-05-24T03:45:38.969 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:45:38.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:45:39.043 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:45:39.184 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2023-05-24T03:45:39.199 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2023-05-24T03:45:39.205 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2023-05-24T03:45:39.205 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2023-05-24T03:45:39.205 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2023-05-24T03:45:39.205 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2023-05-24T03:45:39.205 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 20 2023-05-24T03:45:39.205 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2023-05-24T03:45:39.206 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:39.207 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:39.207 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2023-05-24T03:45:39.208 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-72-generic 2023-05-24T03:45:39.208 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-24T03:45:39.208 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-24T03:45:39.208 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2023-05-24T03:45:39.209 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2023-05-24T03:45:39.209 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2023-05-24T03:45:39.210 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2023-05-24T03:45:39.349 INFO:teuthology.orchestra.run.smithi067.stdout:linux-image-generic is already the newest version (5.15.0.72.70). 2023-05-24T03:45:39.349 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:45:39.350 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:45:39.350 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:45:39.350 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:45:39.350 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:45:39.350 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:45:39.351 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:45:39.385 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 0 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:45:39.387 DEBUG:teuthology.orchestra.run.smithi067:> dpkg -s linux-image-generic 2023-05-24T03:45:39.400 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2023-05-24T03:45:39.444 INFO:teuthology.orchestra.run.smithi067.stdout:Package: linux-image-generic 2023-05-24T03:45:39.445 INFO:teuthology.orchestra.run.smithi067.stdout:Status: install ok installed 2023-05-24T03:45:39.445 INFO:teuthology.orchestra.run.smithi067.stdout:Priority: optional 2023-05-24T03:45:39.445 INFO:teuthology.orchestra.run.smithi067.stdout:Section: kernel 2023-05-24T03:45:39.445 INFO:teuthology.orchestra.run.smithi067.stdout:Installed-Size: 20 2023-05-24T03:45:39.445 INFO:teuthology.orchestra.run.smithi067.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:39.445 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: amd64 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout:Source: linux-meta 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout:Recommends: thermald 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:39.446 INFO:teuthology.orchestra.run.smithi067.stdout: available. 2023-05-24T03:45:39.447 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-05-24T03:45:39.493 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.BpVC1lqvom 2023-05-24T03:45:39.494 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BpVC1lqvom 2023-05-24T03:45:39.530 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:45:39.530 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:45:39.542 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:45:39.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.BpVC1lqvom 2023-05-24T03:45:39.557 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub' 2023-05-24T03:45:39.558 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:39.560 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2023-05-24T03:45:39.639 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:45:39.662 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.BpVC1lqvom is 10KB 2023-05-24T03:45:39.674 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.BpVC1lqvom 2023-05-24T03:45:39.679 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:39.734 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:45:39.734 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-24T03:45:39.734 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:39.742 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:39.748 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:39.802 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-72-generic 2023-05-24T03:45:39.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo update-grub 2023-05-24T03:45:39.982 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:39.987 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:40.029 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:40.034 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:40.126 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-24T03:45:40.126 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub' 2023-05-24T03:45:40.156 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:40.164 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:40.164 INFO:teuthology.orchestra.run.smithi121.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:40.164 INFO:teuthology.orchestra.run.smithi121.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:40.174 INFO:teuthology.orchestra.run.smithi155.stdout:Generating grub configuration file ... 2023-05-24T03:45:40.190 INFO:teuthology.orchestra.run.smithi121.stderr:done 2023-05-24T03:45:40.199 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2023-05-24T03:45:40.463 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:40.489 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:40.703 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:45:40.720 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:45:40.780 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:45:40.806 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:40.812 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:40.878 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:40.883 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:40.921 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2023-05-24T03:45:40.923 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:40.925 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2023-05-24T03:45:40.948 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2023-05-24T03:45:40.949 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2023-05-24T03:45:41.061 INFO:teuthology.orchestra.run.smithi155.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:41.061 INFO:teuthology.orchestra.run.smithi155.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:41.061 INFO:teuthology.orchestra.run.smithi155.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:41.095 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:41.097 INFO:teuthology.orchestra.run.smithi162.stdout:linux-image-generic is already the newest version (5.15.0.72.70). 2023-05-24T03:45:41.097 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:45:41.098 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:45:41.098 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:45:41.098 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:45:41.098 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:45:41.099 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:45:41.099 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:45:41.100 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:41.110 INFO:teuthology.orchestra.run.smithi155.stdout:done 2023-05-24T03:45:41.135 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 0 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:45:41.137 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2023-05-24T03:45:41.151 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2023-05-24T03:45:41.152 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2023-05-24T03:45:41.152 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2023-05-24T03:45:41.152 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2023-05-24T03:45:41.152 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 20 2023-05-24T03:45:41.152 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2023-05-24T03:45:41.153 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:41.154 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:41.154 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2023-05-24T03:45:41.154 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2023-05-24T03:45:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.HTRLHBaMDs 2023-05-24T03:45:41.198 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HTRLHBaMDs 2023-05-24T03:45:41.254 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.HTRLHBaMDs 2023-05-24T03:45:41.329 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:41.336 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:41.377 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:41.378 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.HTRLHBaMDs is 10KB 2023-05-24T03:45:41.382 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:41.390 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.HTRLHBaMDs 2023-05-24T03:45:41.395 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:41.450 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:45:41.450 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-24T03:45:41.450 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:41.496 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:41.497 INFO:teuthology.orchestra.run.smithi067.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:41.497 INFO:teuthology.orchestra.run.smithi067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:41.521 INFO:teuthology.orchestra.run.smithi067.stderr:done 2023-05-24T03:45:41.524 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2023-05-24T03:45:41.526 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-72-generic 2023-05-24T03:45:41.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo update-grub 2023-05-24T03:45:41.603 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2023-05-24T03:45:41.626 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2023-05-24T03:45:41.627 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2023-05-24T03:45:41.627 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2023-05-24T03:45:41.627 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2023-05-24T03:45:41.627 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 20 2023-05-24T03:45:41.627 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:41.627 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2023-05-24T03:45:41.629 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-72-generic 2023-05-24T03:45:41.629 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-24T03:45:41.629 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-24T03:45:41.629 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-05-24T03:45:41.631 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2023-05-24T03:45:41.631 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2023-05-24T03:45:41.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2023-05-24T03:45:41.932 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:45:41.933 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:45:41.943 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:45:41.960 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:45:42.340 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-24T03:45:42.340 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub' 2023-05-24T03:45:42.355 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:42.382 INFO:teuthology.orchestra.run.smithi040.stdout:Generating grub configuration file ... 2023-05-24T03:45:42.624 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2023-05-24T03:45:42.625 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:42.627 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2023-05-24T03:45:42.794 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:42.808 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:42.815 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:42.818 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:43.035 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:43.041 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:43.082 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:43.086 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:43.181 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:45:43.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:45:43.202 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:43.203 INFO:teuthology.orchestra.run.smithi162.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:43.203 INFO:teuthology.orchestra.run.smithi162.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:43.234 INFO:teuthology.orchestra.run.smithi162.stderr:done 2023-05-24T03:45:43.250 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:43.252 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2023-05-24T03:45:43.256 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:43.258 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:45:43.325 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:43.331 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:43.424 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2023-05-24T03:45:43.424 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2023-05-24T03:45:43.504 INFO:teuthology.orchestra.run.smithi040.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:43.504 INFO:teuthology.orchestra.run.smithi040.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:43.505 INFO:teuthology.orchestra.run.smithi040.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:43.548 INFO:teuthology.orchestra.run.smithi040.stdout:done 2023-05-24T03:45:43.555 INFO:teuthology.orchestra.run.smithi155.stdout:linux-image-generic is already the newest version (5.15.0.72.70). 2023-05-24T03:45:43.556 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:45:43.556 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:45:43.556 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:45:43.556 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:45:43.556 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:45:43.557 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:45:43.557 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:45:43.590 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:45:43.592 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2023-05-24T03:45:43.605 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2023-05-24T03:45:43.605 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2023-05-24T03:45:43.605 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2023-05-24T03:45:43.605 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2023-05-24T03:45:43.606 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 20 2023-05-24T03:45:43.606 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:43.606 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2023-05-24T03:45:43.606 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2023-05-24T03:45:43.607 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:43.607 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:43.607 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:43.607 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2023-05-24T03:45:43.607 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:43.608 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:43.608 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2023-05-24T03:45:43.608 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-05-24T03:45:43.652 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.m5BfjSOwHL 2023-05-24T03:45:43.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub/grub.cfg /tmp/tmp.m5BfjSOwHL 2023-05-24T03:45:43.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.m5BfjSOwHL 2023-05-24T03:45:43.845 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.m5BfjSOwHL is 10KB 2023-05-24T03:45:43.856 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.m5BfjSOwHL 2023-05-24T03:45:43.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:43.916 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:45:43.917 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-24T03:45:43.917 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:43.957 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2023-05-24T03:45:43.977 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2023-05-24T03:45:43.977 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2023-05-24T03:45:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:43.979 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:43.979 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:43.979 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2023-05-24T03:45:43.979 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:43.979 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:43.979 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2023-05-24T03:45:43.980 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-72-generic 2023-05-24T03:45:43.980 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-24T03:45:43.980 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-24T03:45:43.980 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-05-24T03:45:43.980 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2023-05-24T03:45:43.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2023-05-24T03:45:43.988 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-72-generic 2023-05-24T03:45:43.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo update-grub 2023-05-24T03:45:44.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-05-24T03:45:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:45:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:45:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:45:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:45:45.136 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2023-05-24T03:45:45.137 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:45.139 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-05-24T03:45:45.375 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:45.382 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:45.533 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:45:45.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-24T03:45:45.591 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:45.595 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:45.604 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:45:45.632 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:45.637 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:45.741 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:45.742 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:45.742 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:45.760 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-05-24T03:45:45.762 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-05-24T03:45:45.767 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-05-24T03:45:45.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2023-05-24T03:45:45.896 INFO:teuthology.orchestra.run.smithi040.stdout:linux-image-generic is already the newest version (5.15.0.72.70). 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:45:45.897 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:45:45.934 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 0 newly installed, 0 to remove and 178 not upgraded. 2023-05-24T03:45:45.936 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2023-05-24T03:45:45.995 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2023-05-24T03:45:45.995 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2023-05-24T03:45:45.995 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2023-05-24T03:45:45.996 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2023-05-24T03:45:45.996 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2023-05-24T03:45:45.996 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2023-05-24T03:45:45.997 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2023-05-24T03:45:45.997 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2023-05-24T03:45:45.997 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.72.70 2023-05-24T03:45:45.997 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-72), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-05-24T03:45:45.998 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-72-generic, linux-modules-extra-5.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-24T03:45:45.998 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2023-05-24T03:45:45.998 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2023-05-24T03:45:45.998 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2023-05-24T03:45:45.998 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2023-05-24T03:45:45.999 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-05-24T03:45:46.039 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.ffKH4aQhfn 2023-05-24T03:45:46.040 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ffKH4aQhfn 2023-05-24T03:45:46.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.ffKH4aQhfn 2023-05-24T03:45:46.210 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.ffKH4aQhfn is 10KB 2023-05-24T03:45:46.222 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.ffKH4aQhfn 2023-05-24T03:45:46.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:46.284 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:45:46.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-24T03:45:46.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-24T03:45:46.352 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-72-generic 2023-05-24T03:45:46.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo update-grub 2023-05-24T03:45:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub' 2023-05-24T03:45:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-24T03:45:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2023-05-24T03:45:47.832 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-72-generic 2023-05-24T03:45:47.838 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-72-generic 2023-05-24T03:45:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-24T03:45:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-24T03:45:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-24T03:45:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-24T03:45:48.372 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-24T03:45:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-24T03:45:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-24T03:45:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:done 2023-05-24T03:45:48.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2023-05-24T03:46:10.220 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-05-24T03:46:10.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-05-24T03:46:10.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:46:11.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-24T03:46:11.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-05-24T03:46:11.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:46:13.256 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2023-05-24T03:46:13.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-05-24T03:46:13.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:46:15.773 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-05-24T03:46:15.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-05-24T03:46:15.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:46:18.397 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-24T03:46:18.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-24T03:46:18.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:46:28.600 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-05-24T03:46:29.876 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-05-24T03:46:31.668 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-05-24T03:46:34.224 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-05-24T03:46:36.784 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-05-24T03:46:58.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-05-24T03:46:58.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:46:59.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-05-24T03:46:59.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:01.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-05-24T03:47:01.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:01.680 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-05-24T03:47:02.932 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-05-24T03:47:04.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-05-24T03:47:04.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:06.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-24T03:47:06.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:07.280 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-05-24T03:47:09.844 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-05-24T03:47:31.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-05-24T03:47:31.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:31.964 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-05-24T03:47:32.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-05-24T03:47:32.592 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-72-generic"... 2023-05-24T03:47:32.593 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2023-05-24T03:47:32.637 INFO:teuthology.orchestra.run.smithi121.stdout:5.15.0-72-generic 2023-05-24T03:47:32.638 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-72-generic vs 5.15.0-72-generic 2023-05-24T03:47:32.638 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-24T03:47:32.638 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-24T03:47:32.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-05-24T03:47:32.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:33.104 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-05-24T03:47:33.177 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-05-24T03:47:33.639 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-05-24T03:47:33.639 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-24T03:47:33.696 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2023-05-24T03:47:33.727 DEBUG:teuthology.parallel:result is None 2023-05-24T03:47:33.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-05-24T03:47:33.760 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-72-generic"... 2023-05-24T03:47:33.760 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-05-24T03:47:33.808 INFO:teuthology.orchestra.run.smithi067.stdout:5.15.0-72-generic 2023-05-24T03:47:33.809 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-72-generic vs 5.15.0-72-generic 2023-05-24T03:47:33.809 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-24T03:47:33.809 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-24T03:47:34.810 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-24T03:47:34.811 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-24T03:47:34.887 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2023-05-24T03:47:34.910 DEBUG:teuthology.parallel:result is None 2023-05-24T03:47:37.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-05-24T03:47:37.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:37.741 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-05-24T03:47:39.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-05-24T03:47:39.323 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-72-generic"... 2023-05-24T03:47:39.323 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-05-24T03:47:39.328 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-72-generic 2023-05-24T03:47:39.328 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-72-generic vs 5.15.0-72-generic 2023-05-24T03:47:39.329 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-24T03:47:39.329 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-24T03:47:39.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-24T03:47:39.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:47:40.239 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-05-24T03:47:40.329 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-05-24T03:47:40.330 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-24T03:47:40.506 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2023-05-24T03:47:40.547 DEBUG:teuthology.parallel:result is None 2023-05-24T03:47:40.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-24T03:47:40.951 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-72-generic"... 2023-05-24T03:47:40.951 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-05-24T03:47:40.997 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-72-generic 2023-05-24T03:47:40.998 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-72-generic vs 5.15.0-72-generic 2023-05-24T03:47:40.998 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-24T03:47:40.998 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-24T03:47:41.999 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-24T03:47:41.999 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-24T03:47:42.105 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2023-05-24T03:47:42.140 DEBUG:teuthology.parallel:result is None 2023-05-24T03:48:03.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-05-24T03:48:03.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:48:03.314 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-05-24T03:48:03.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-05-24T03:48:03.895 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.15.0-72-generic"... 2023-05-24T03:48:03.896 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2023-05-24T03:48:03.942 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-72-generic 2023-05-24T03:48:03.942 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-72-generic vs 5.15.0-72-generic 2023-05-24T03:48:03.943 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-24T03:48:03.943 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-24T03:48:04.944 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2023-05-24T03:48:04.944 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-24T03:48:05.009 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2023-05-24T03:48:05.032 DEBUG:teuthology.parallel:result is None 2023-05-24T03:48:05.032 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-24T03:48:05.043 INFO:teuthology.task.internal:Creating test directory... 2023-05-24T03:48:05.044 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:48:05.047 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:48:05.050 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:48:05.054 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:48:05.058 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:48:05.064 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-24T03:48:05.071 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-24T03:48:05.083 INFO:teuthology.task.internal:Creating archive directory... 2023-05-24T03:48:05.083 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:48:05.095 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:48:05.099 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:48:05.103 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:48:05.107 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:48:05.192 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-24T03:48:05.201 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-24T03:48:05.202 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:48:05.205 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:48:05.208 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:48:05.211 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:48:05.214 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:48:05.226 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.227 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.234 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.234 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.235 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.240 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.243 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.248 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:48:05.250 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-24T03:48:05.260 INFO:teuthology.task.internal:Configuring sudo... 2023-05-24T03:48:05.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:48:05.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:48:05.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:48:05.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:48:05.302 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:48:05.321 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-24T03:48:05.331 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-24T03:48:05.331 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:48:05.339 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:48:05.341 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:48:05.344 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:48:05.367 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:48:05.372 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:48:05.391 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:48:05.440 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:48:05.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:48:05.502 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:48:05.508 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:48:05.556 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:48:05.556 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:48:05.629 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:48:05.636 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:48:05.682 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:48:05.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:48:05.749 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:48:05.754 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:48:05.802 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:48:05.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:48:05.865 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:48:05.873 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:48:05.919 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:48:05.919 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:48:05.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-05-24T03:48:05.983 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2023-05-24T03:48:05.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2023-05-24T03:48:05.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-05-24T03:48:05.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2023-05-24T03:48:06.069 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-24T03:48:06.076 INFO:teuthology.task.internal:Starting timer... 2023-05-24T03:48:06.077 INFO:teuthology.run_tasks:Running task pcp... 2023-05-24T03:48:06.085 INFO:teuthology.run_tasks:Running task selinux... 2023-05-24T03:48:06.104 DEBUG:teuthology.task.selinux:Excluding smithi040: OS 'ubuntu' does not support SELinux 2023-05-24T03:48:06.104 DEBUG:teuthology.task.selinux:Excluding smithi067: OS 'ubuntu' does not support SELinux 2023-05-24T03:48:06.104 DEBUG:teuthology.task.selinux:Excluding smithi121: OS 'ubuntu' does not support SELinux 2023-05-24T03:48:06.105 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2023-05-24T03:48:06.105 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2023-05-24T03:48:06.105 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-24T03:48:06.105 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-05-24T03:48:06.106 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-24T03:48:06.106 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-24T03:48:06.121 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-24T03:48:06.127 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-24T03:48:06.274 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-24T03:48:06.300 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-24T03:48:06.302 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi067.front.sepia.ceph.com,smithi121.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-24T03:55:53.720 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2023-05-24T03:55:53.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-24T03:55:53.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:55:53.800 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-05-24T03:55:53.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-05-24T03:55:53.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:55:53.972 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-05-24T03:55:54.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-05-24T03:55:54.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:55:54.186 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-05-24T03:55:54.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-05-24T03:55:54.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:55:54.378 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-05-24T03:55:54.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-05-24T03:55:54.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:55:54.564 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-05-24T03:55:54.673 INFO:teuthology.run_tasks:Running task clock... 2023-05-24T03:55:54.685 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-24T03:55:54.685 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:55:54.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:55:54.688 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:55:54.689 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:55:54.691 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:55:54.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:55:54.693 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:55:54.694 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:55:54.696 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:55:54.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:55:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-24T03:55:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Command line: ntpd -gq 2023-05-24T03:55:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: ---------------------------------------------------- 2023-05-24T03:55:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: ntp-4 is maintained by Network Time Foundation, 2023-05-24T03:55:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-24T03:55:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: corporation. Support and training for ntp-4 are 2023-05-24T03:55:54.719 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: available at https://www.nwtime.org/support 2023-05-24T03:55:54.719 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: ---------------------------------------------------- 2023-05-24T03:55:54.719 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: proto: precision = 0.047 usec (-24) 2023-05-24T03:55:54.719 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: basedate set to 2022-02-04 2023-05-24T03:55:54.720 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: gps base set to 2022-02-06 (week 2196) 2023-05-24T03:55:54.720 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.720 INFO:teuthology.orchestra.run.smithi040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.720 INFO:teuthology.orchestra.run.smithi040.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.721 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.721 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listen and drop on 0 v6wildcard [::]:123 2023-05-24T03:55:54.721 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-24T03:55:54.722 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listen normally on 2 lo 127.0.0.1:123 2023-05-24T03:55:54.722 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listen normally on 3 ens1f0 172.21.15.40:123 2023-05-24T03:55:54.722 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listen normally on 4 lo [::1]:123 2023-05-24T03:55:54.722 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12cc%4]:123 2023-05-24T03:55:54.722 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:55:54 ntpd[26928]: Listening on routing socket on fd #22 for interface updates 2023-05-24T03:55:54.723 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-24T03:55:54.723 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Command line: ntpd -gq 2023-05-24T03:55:54.723 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: ---------------------------------------------------- 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: ntp-4 is maintained by Network Time Foundation, 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: corporation. Support and training for ntp-4 are 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: available at https://www.nwtime.org/support 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: ---------------------------------------------------- 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: proto: precision = 0.046 usec (-24) 2023-05-24T03:55:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: basedate set to 2022-02-04 2023-05-24T03:55:54.725 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: gps base set to 2022-02-06 (week 2196) 2023-05-24T03:55:54.725 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-24T03:55:54.725 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Command line: ntpd -gq 2023-05-24T03:55:54.725 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: ---------------------------------------------------- 2023-05-24T03:55:54.725 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: ntp-4 is maintained by Network Time Foundation, 2023-05-24T03:55:54.725 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-24T03:55:54.726 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: corporation. Support and training for ntp-4 are 2023-05-24T03:55:54.726 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: available at https://www.nwtime.org/support 2023-05-24T03:55:54.726 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: ---------------------------------------------------- 2023-05-24T03:55:54.726 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: proto: precision = 0.060 usec (-24) 2023-05-24T03:55:54.726 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: basedate set to 2022-02-04 2023-05-24T03:55:54.726 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: gps base set to 2022-02-06 (week 2196) 2023-05-24T03:55:54.727 INFO:teuthology.orchestra.run.smithi067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.727 INFO:teuthology.orchestra.run.smithi121.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.727 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.727 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.728 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.728 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.728 INFO:teuthology.orchestra.run.smithi067.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.728 INFO:teuthology.orchestra.run.smithi121.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listen and drop on 0 v6wildcard [::]:123 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listen normally on 2 lo 127.0.0.1:123 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listen normally on 3 enp3s0f1 172.21.15.121:123 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listen normally on 4 lo [::1]:123 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba3%5]:123 2023-05-24T03:55:54.730 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:55:54 ntpd[27074]: Listening on routing socket on fd #22 for interface updates 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listen and drop on 0 v6wildcard [::]:123 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listen normally on 2 lo 127.0.0.1:123 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listen normally on 3 enp3s0f1 172.21.15.67:123 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listen normally on 4 lo [::1]:123 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:fc0b%5]:123 2023-05-24T03:55:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:55:54 ntpd[27065]: Listening on routing socket on fd #22 for interface updates 2023-05-24T03:55:54.739 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-24T03:55:54.739 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Command line: ntpd -gq 2023-05-24T03:55:54.739 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: ---------------------------------------------------- 2023-05-24T03:55:54.739 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: ntp-4 is maintained by Network Time Foundation, 2023-05-24T03:55:54.739 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-24T03:55:54.740 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: corporation. Support and training for ntp-4 are 2023-05-24T03:55:54.740 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: available at https://www.nwtime.org/support 2023-05-24T03:55:54.740 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: ---------------------------------------------------- 2023-05-24T03:55:54.740 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: proto: precision = 0.045 usec (-24) 2023-05-24T03:55:54.741 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: basedate set to 2022-02-04 2023-05-24T03:55:54.741 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: gps base set to 2022-02-06 (week 2196) 2023-05-24T03:55:54.741 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.741 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.742 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.742 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.742 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listen and drop on 0 v6wildcard [::]:123 2023-05-24T03:55:54.743 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-24T03:55:54.743 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listen normally on 2 lo 127.0.0.1:123 2023-05-24T03:55:54.743 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2023-05-24T03:55:54.743 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listen normally on 4 lo [::1]:123 2023-05-24T03:55:54.743 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2023-05-24T03:55:54.743 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:55:54 ntpd[27012]: Listening on routing socket on fd #22 for interface updates 2023-05-24T03:55:54.764 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Command line: ntpd -gq 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: ---------------------------------------------------- 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: ntp-4 is maintained by Network Time Foundation, 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: corporation. Support and training for ntp-4 are 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: available at https://www.nwtime.org/support 2023-05-24T03:55:54.765 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: ---------------------------------------------------- 2023-05-24T03:55:54.766 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: proto: precision = 0.059 usec (-24) 2023-05-24T03:55:54.766 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: basedate set to 2022-02-04 2023-05-24T03:55:54.766 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: gps base set to 2022-02-06 (week 2196) 2023-05-24T03:55:54.767 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.767 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-24T03:55:54.767 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.768 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-24T03:55:54.768 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listen and drop on 0 v6wildcard [::]:123 2023-05-24T03:55:54.768 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-24T03:55:54.769 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listen normally on 2 lo 127.0.0.1:123 2023-05-24T03:55:54.769 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2023-05-24T03:55:54.769 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listen normally on 4 lo [::1]:123 2023-05-24T03:55:54.769 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2023-05-24T03:55:54.769 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:55:54 ntpd[27007]: Listening on routing socket on fd #22 for interface updates 2023-05-24T03:55:55.718 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:55.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:55 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:55 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:55 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.722 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:55 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:55 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:55 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:55 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:55.723 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.723 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.723 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:55 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:55.739 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:55 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:55.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:55 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:55 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:55 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:55.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:55 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:55.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:55 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:55.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:55 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:56 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:56 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.721 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:56 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.721 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:56 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.739 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:56 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:56 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:56 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:56 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:56 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:56 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:56.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:56.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:56.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:56.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:56 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:57 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:57 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:57 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:57 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:57.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:57 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:57 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:57 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:57.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:57 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:57.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:57 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:57.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:57 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:58.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.742 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.742 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.742 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.742 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:58.743 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:58 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:58.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:58.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:58.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:58.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:58.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:58.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:58 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:55:59 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:55:59 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.727 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.727 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.727 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.727 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.727 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.728 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:55:59 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:55:59 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:55:59.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:59 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:59 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:59 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:55:59.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:59 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:55:59.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:59 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:55:59.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:55:59 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:00.739 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:00 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:00.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:00 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:00.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:00 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:00.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:00 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:00.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:00 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:00.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:00 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:00.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:00.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:00.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:00.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:00.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:00.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:00 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.721 INFO:teuthology.orchestra.run.smithi040.stdout:24 May 03:56:01 ntpd[26928]: ntpd: time slew -0.002957 s 2023-05-24T03:56:01.721 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd: time slew -0.002957s 2023-05-24T03:56:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-24T03:56:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:24 May 03:56:01 ntpd[26928]: can't open /var/log/ntpstats/loopstats.20230524: Permission denied 2023-05-24T03:56:01.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.723 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.724 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.725 INFO:teuthology.orchestra.run.smithi067.stdout:24 May 03:56:01 ntpd[27065]: ntpd: time slew -0.003160 s 2023-05-24T03:56:01.725 INFO:teuthology.orchestra.run.smithi067.stdout:ntpd: time slew -0.003160s 2023-05-24T03:56:01.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.725 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.726 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.727 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.728 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.728 INFO:teuthology.orchestra.run.smithi121.stdout:24 May 03:56:01 ntpd[27074]: ntpd: time slew +0.002492 s 2023-05-24T03:56:01.728 INFO:teuthology.orchestra.run.smithi121.stdout:ntpd: time slew +0.002492s 2023-05-24T03:56:01.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-24T03:56:01.729 INFO:teuthology.orchestra.run.smithi067.stderr:24 May 03:56:01 ntpd[27065]: can't open /var/log/ntpstats/loopstats.20230524: Permission denied 2023-05-24T03:56:01.729 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-24T03:56:01.729 INFO:teuthology.orchestra.run.smithi121.stderr:24 May 03:56:01 ntpd[27074]: can't open /var/log/ntpstats/loopstats.20230524: Permission denied 2023-05-24T03:56:01.739 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.740 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.741 INFO:teuthology.orchestra.run.smithi162.stdout:24 May 03:56:01 ntpd[27012]: ntpd: time slew -0.005278 s 2023-05-24T03:56:01.741 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time slew -0.005278s 2023-05-24T03:56:01.741 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-24T03:56:01.742 INFO:teuthology.orchestra.run.smithi162.stderr:24 May 03:56:01 ntpd[27012]: can't open /var/log/ntpstats/loopstats.20230524: Permission denied 2023-05-24T03:56:01.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-24T03:56:01.765 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: can't open /var/log/ntpstats/rawstats.20230524: Permission denied 2023-05-24T03:56:01.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-24T03:56:01.766 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: can't open /var/log/ntpstats/peerstats.20230524: Permission denied 2023-05-24T03:56:01.766 INFO:teuthology.orchestra.run.smithi155.stdout:24 May 03:56:01 ntpd[27007]: ntpd: time slew +0.001106 s 2023-05-24T03:56:01.766 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time slew +0.001106s 2023-05-24T03:56:01.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-24T03:56:01.767 INFO:teuthology.orchestra.run.smithi155.stderr:24 May 03:56:01 ntpd[27007]: can't open /var/log/ntpstats/loopstats.20230524: Permission denied 2023-05-24T03:56:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T03:56:01.791 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2023-05-24T03:56:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.812 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T03:56:01.813 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2023-05-24T03:56:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.815 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T03:56:01.816 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2023-05-24T03:56:01.816 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.816 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.816 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.816 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.819 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T03:56:01.819 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2023-05-24T03:56:01.820 INFO:teuthology.orchestra.run.smithi121.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.820 INFO:teuthology.orchestra.run.smithi121.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.820 INFO:teuthology.orchestra.run.smithi121.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.820 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.862 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T03:56:01.862 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2023-05-24T03:56:01.863 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.863 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.863 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.863 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T03:56:01.864 INFO:teuthology.run_tasks:Running task install... 2023-05-24T03:56:01.872 DEBUG:teuthology.task.install:project ceph 2023-05-24T03:56:01.873 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}} 2023-05-24T03:56:01.873 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'} 2023-05-24T03:56:01.873 INFO:teuthology.task.install:Using flavor: default 2023-05-24T03:56:01.879 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-24T03:56:01.879 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-24T03:56:01.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-key list | grep Ceph 2023-05-24T03:56:01.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-key list | grep Ceph 2023-05-24T03:56:01.881 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-key list | grep Ceph 2023-05-24T03:56:01.881 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2023-05-24T03:56:01.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2023-05-24T03:56:01.936 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-24T03:56:01.937 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-24T03:56:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-24T03:56:01.942 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-24T03:56:01.947 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-24T03:56:01.962 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-24T03:56:01.963 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2023-05-24T03:56:01.963 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-24T03:56:01.963 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-24T03:56:01.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:56:01.967 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-24T03:56:01.967 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2023-05-24T03:56:01.968 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-24T03:56:01.968 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-24T03:56:01.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:56:01.971 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-24T03:56:01.972 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph.com (release key) 2023-05-24T03:56:01.972 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-24T03:56:01.972 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph.com (release key) 2023-05-24T03:56:01.972 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-24T03:56:01.972 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-24T03:56:01.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:56:01.974 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-24T03:56:01.974 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-24T03:56:01.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:56:01.977 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-24T03:56:01.978 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph.com (release key) 2023-05-24T03:56:01.978 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-24T03:56:01.978 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-24T03:56:01.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:56:02.187 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default/ 2023-05-24T03:56:02.187 INFO:teuthology.task.install.deb:Package version is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:02.206 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default/ 2023-05-24T03:56:02.207 INFO:teuthology.task.install.deb:Package version is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:02.208 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default/ 2023-05-24T03:56:02.208 INFO:teuthology.task.install.deb:Package version is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:02.209 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default/ 2023-05-24T03:56:02.209 INFO:teuthology.task.install.deb:Package version is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:02.214 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default/ 2023-05-24T03:56:02.214 INFO:teuthology.task.install.deb:Package version is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:02.367 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:56:02.368 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-24T03:56:02.376 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:56:02.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-24T03:56:02.381 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2023-05-24T03:56:02.392 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:56:02.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-24T03:56:02.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-05-24T03:56:02.400 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:56:02.400 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-24T03:56:02.400 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:56:02.401 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-24T03:56:02.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2023-05-24T03:56:02.416 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2023-05-24T03:56:02.416 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2023-05-24T03:56:02.566 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:56:02.575 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:56:02.581 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:56:02.584 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:56:02.584 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:56:02.591 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:56:02.592 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:56:02.608 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:56:02.663 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy InRelease 2023-05-24T03:56:02.677 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:56:02.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy InRelease 2023-05-24T03:56:02.687 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:56:02.689 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:56:02.698 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy InRelease 2023-05-24T03:56:02.699 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy InRelease 2023-05-24T03:56:02.699 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy InRelease 2023-05-24T03:56:02.700 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-24T03:56:02.703 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:56:02.704 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-24T03:56:02.705 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-24T03:56:02.717 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-24T03:56:02.735 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-24T03:56:02.735 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-24T03:56:02.736 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-24T03:56:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-24T03:56:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:56:02.754 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-24T03:56:02.772 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-24T03:56:02.772 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-24T03:56:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2023-05-24T03:56:02.773 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-24T03:56:02.785 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:56:02.787 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-24T03:56:02.791 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-24T03:56:02.808 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2023-05-24T03:56:02.809 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-24T03:56:02.809 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-24T03:56:02.815 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-24T03:56:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:56:02.833 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2023-05-24T03:56:02.850 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-24T03:56:02.851 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2023-05-24T03:56:02.852 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2023-05-24T03:56:02.867 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:56:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-24T03:56:02.927 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 28.5 kB in 0s (84.9 kB/s) 2023-05-24T03:56:02.927 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 28.5 kB in 0s (81.7 kB/s) 2023-05-24T03:56:03.003 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 28.5 kB in 0s (69.6 kB/s) 2023-05-24T03:56:03.005 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 28.5 kB in 0s (69.9 kB/s) 2023-05-24T03:56:03.039 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 28.5 kB in 0s (59.6 kB/s) 2023-05-24T03:56:03.663 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:56:03.681 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4167-gfa0e62c4-1jammy cephadm=18.0.0-4167-gfa0e62c4-1jammy ceph-mds=18.0.0-4167-gfa0e62c4-1jammy ceph-mgr=18.0.0-4167-gfa0e62c4-1jammy ceph-common=18.0.0-4167-gfa0e62c4-1jammy ceph-fuse=18.0.0-4167-gfa0e62c4-1jammy ceph-test=18.0.0-4167-gfa0e62c4-1jammy ceph-volume=18.0.0-4167-gfa0e62c4-1jammy radosgw=18.0.0-4167-gfa0e62c4-1jammy python3-rados=18.0.0-4167-gfa0e62c4-1jammy python3-rgw=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy python3-rbd=18.0.0-4167-gfa0e62c4-1jammy libcephfs2=18.0.0-4167-gfa0e62c4-1jammy libcephfs-dev=18.0.0-4167-gfa0e62c4-1jammy librados2=18.0.0-4167-gfa0e62c4-1jammy librbd1=18.0.0-4167-gfa0e62c4-1jammy rbd-fuse=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy cephfs-shell=18.0.0-4167-gfa0e62c4-1jammy cephfs-top=18.0.0-4167-gfa0e62c4-1jammy cephfs-mirror=18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:03.713 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:56:03.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4167-gfa0e62c4-1jammy cephadm=18.0.0-4167-gfa0e62c4-1jammy ceph-mds=18.0.0-4167-gfa0e62c4-1jammy ceph-mgr=18.0.0-4167-gfa0e62c4-1jammy ceph-common=18.0.0-4167-gfa0e62c4-1jammy ceph-fuse=18.0.0-4167-gfa0e62c4-1jammy ceph-test=18.0.0-4167-gfa0e62c4-1jammy ceph-volume=18.0.0-4167-gfa0e62c4-1jammy radosgw=18.0.0-4167-gfa0e62c4-1jammy python3-rados=18.0.0-4167-gfa0e62c4-1jammy python3-rgw=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy python3-rbd=18.0.0-4167-gfa0e62c4-1jammy libcephfs2=18.0.0-4167-gfa0e62c4-1jammy libcephfs-dev=18.0.0-4167-gfa0e62c4-1jammy librados2=18.0.0-4167-gfa0e62c4-1jammy librbd1=18.0.0-4167-gfa0e62c4-1jammy rbd-fuse=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy cephfs-shell=18.0.0-4167-gfa0e62c4-1jammy cephfs-top=18.0.0-4167-gfa0e62c4-1jammy cephfs-mirror=18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:03.740 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:56:03.778 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:56:03.793 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:56:03.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4167-gfa0e62c4-1jammy cephadm=18.0.0-4167-gfa0e62c4-1jammy ceph-mds=18.0.0-4167-gfa0e62c4-1jammy ceph-mgr=18.0.0-4167-gfa0e62c4-1jammy ceph-common=18.0.0-4167-gfa0e62c4-1jammy ceph-fuse=18.0.0-4167-gfa0e62c4-1jammy ceph-test=18.0.0-4167-gfa0e62c4-1jammy ceph-volume=18.0.0-4167-gfa0e62c4-1jammy radosgw=18.0.0-4167-gfa0e62c4-1jammy python3-rados=18.0.0-4167-gfa0e62c4-1jammy python3-rgw=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy python3-rbd=18.0.0-4167-gfa0e62c4-1jammy libcephfs2=18.0.0-4167-gfa0e62c4-1jammy libcephfs-dev=18.0.0-4167-gfa0e62c4-1jammy librados2=18.0.0-4167-gfa0e62c4-1jammy librbd1=18.0.0-4167-gfa0e62c4-1jammy rbd-fuse=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy cephfs-shell=18.0.0-4167-gfa0e62c4-1jammy cephfs-top=18.0.0-4167-gfa0e62c4-1jammy cephfs-mirror=18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:03.795 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:56:03.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4167-gfa0e62c4-1jammy cephadm=18.0.0-4167-gfa0e62c4-1jammy ceph-mds=18.0.0-4167-gfa0e62c4-1jammy ceph-mgr=18.0.0-4167-gfa0e62c4-1jammy ceph-common=18.0.0-4167-gfa0e62c4-1jammy ceph-fuse=18.0.0-4167-gfa0e62c4-1jammy ceph-test=18.0.0-4167-gfa0e62c4-1jammy ceph-volume=18.0.0-4167-gfa0e62c4-1jammy radosgw=18.0.0-4167-gfa0e62c4-1jammy python3-rados=18.0.0-4167-gfa0e62c4-1jammy python3-rgw=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy python3-rbd=18.0.0-4167-gfa0e62c4-1jammy libcephfs2=18.0.0-4167-gfa0e62c4-1jammy libcephfs-dev=18.0.0-4167-gfa0e62c4-1jammy librados2=18.0.0-4167-gfa0e62c4-1jammy librbd1=18.0.0-4167-gfa0e62c4-1jammy rbd-fuse=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy cephfs-shell=18.0.0-4167-gfa0e62c4-1jammy cephfs-top=18.0.0-4167-gfa0e62c4-1jammy cephfs-mirror=18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:03.814 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:56:03.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4167-gfa0e62c4-1jammy cephadm=18.0.0-4167-gfa0e62c4-1jammy ceph-mds=18.0.0-4167-gfa0e62c4-1jammy ceph-mgr=18.0.0-4167-gfa0e62c4-1jammy ceph-common=18.0.0-4167-gfa0e62c4-1jammy ceph-fuse=18.0.0-4167-gfa0e62c4-1jammy ceph-test=18.0.0-4167-gfa0e62c4-1jammy ceph-volume=18.0.0-4167-gfa0e62c4-1jammy radosgw=18.0.0-4167-gfa0e62c4-1jammy python3-rados=18.0.0-4167-gfa0e62c4-1jammy python3-rgw=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy python3-rbd=18.0.0-4167-gfa0e62c4-1jammy libcephfs2=18.0.0-4167-gfa0e62c4-1jammy libcephfs-dev=18.0.0-4167-gfa0e62c4-1jammy librados2=18.0.0-4167-gfa0e62c4-1jammy librbd1=18.0.0-4167-gfa0e62c4-1jammy rbd-fuse=18.0.0-4167-gfa0e62c4-1jammy python3-cephfs=18.0.0-4167-gfa0e62c4-1jammy cephfs-shell=18.0.0-4167-gfa0e62c4-1jammy cephfs-top=18.0.0-4167-gfa0e62c4-1jammy cephfs-mirror=18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:56:03.857 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:56:03.873 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:56:03.892 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:56:03.911 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2023-05-24T03:56:03.912 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2023-05-24T03:56:03.967 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-05-24T03:56:03.968 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-05-24T03:56:04.028 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2023-05-24T03:56:04.028 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2023-05-24T03:56:04.034 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2023-05-24T03:56:04.035 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2023-05-24T03:56:04.067 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:56:04.068 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:56:04.068 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:56:04.068 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:56:04.069 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:56:04.069 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:56:04.069 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:56:04.069 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2023-05-24T03:56:04.069 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-24T03:56:04.070 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-24T03:56:04.070 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.070 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-24T03:56:04.071 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-24T03:56:04.071 INFO:teuthology.orchestra.run.smithi162.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-24T03:56:04.071 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-24T03:56:04.071 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-24T03:56:04.071 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-24T03:56:04.071 INFO:teuthology.orchestra.run.smithi162.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-24T03:56:04.072 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2023-05-24T03:56:04.073 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: python3-watchdog 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2023-05-24T03:56:04.074 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2023-05-24T03:56:04.075 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2023-05-24T03:56:04.075 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2023-05-24T03:56:04.130 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:56:04.131 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:56:04.131 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:56:04.131 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:56:04.132 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:56:04.132 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:56:04.132 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:56:04.133 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-05-24T03:56:04.133 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-24T03:56:04.133 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-24T03:56:04.133 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.133 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-24T03:56:04.133 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-24T03:56:04.134 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-24T03:56:04.135 INFO:teuthology.orchestra.run.smithi040.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-24T03:56:04.136 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-24T03:56:04.136 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-24T03:56:04.136 INFO:teuthology.orchestra.run.smithi040.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-24T03:56:04.136 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-05-24T03:56:04.136 INFO:teuthology.orchestra.run.smithi040.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout: python3-watchdog 2023-05-24T03:56:04.137 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2023-05-24T03:56:04.138 INFO:teuthology.orchestra.run.smithi040.stdout: btrfs-tools 2023-05-24T03:56:04.169 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2023-05-24T03:56:04.169 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-24T03:56:04.169 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-24T03:56:04.170 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-24T03:56:04.170 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-24T03:56:04.171 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.171 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-24T03:56:04.171 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-24T03:56:04.171 INFO:teuthology.orchestra.run.smithi162.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-24T03:56:04.171 INFO:teuthology.orchestra.run.smithi162.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-24T03:56:04.172 INFO:teuthology.orchestra.run.smithi162.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-24T03:56:04.173 INFO:teuthology.orchestra.run.smithi162.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-24T03:56:04.174 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-24T03:56:04.174 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-24T03:56:04.174 INFO:teuthology.orchestra.run.smithi162.stdout: socat xmlstarlet 2023-05-24T03:56:04.179 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:56:04.179 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:56:04.179 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:56:04.180 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:56:04.180 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:56:04.180 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:56:04.181 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:56:04.181 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2023-05-24T03:56:04.181 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-24T03:56:04.182 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-24T03:56:04.182 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.182 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-24T03:56:04.182 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-24T03:56:04.182 INFO:teuthology.orchestra.run.smithi067.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-24T03:56:04.182 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-24T03:56:04.183 INFO:teuthology.orchestra.run.smithi067.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-24T03:56:04.184 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-24T03:56:04.185 INFO:teuthology.orchestra.run.smithi067.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-24T03:56:04.185 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2023-05-24T03:56:04.185 INFO:teuthology.orchestra.run.smithi067.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: python3-watchdog 2023-05-24T03:56:04.186 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2023-05-24T03:56:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: btrfs-tools 2023-05-24T03:56:04.188 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:56:04.188 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:56:04.188 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:56:04.188 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:56:04.188 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.189 INFO:teuthology.orchestra.run.smithi121.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-24T03:56:04.190 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-24T03:56:04.191 INFO:teuthology.orchestra.run.smithi121.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-24T03:56:04.192 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-24T03:56:04.192 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-24T03:56:04.192 INFO:teuthology.orchestra.run.smithi121.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-24T03:56:04.192 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2023-05-24T03:56:04.192 INFO:teuthology.orchestra.run.smithi121.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: python3-watchdog 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2023-05-24T03:56:04.193 INFO:teuthology.orchestra.run.smithi121.stdout: btrfs-tools 2023-05-24T03:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2023-05-24T03:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-24T03:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-24T03:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-24T03:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-24T03:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-24T03:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-24T03:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-24T03:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-24T03:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-24T03:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-24T03:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-24T03:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2023-05-24T03:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-24T03:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-24T03:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-24T03:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-24T03:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-24T03:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-24T03:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-watchdog 2023-05-24T03:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2023-05-24T03:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2023-05-24T03:56:04.239 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-05-24T03:56:04.240 INFO:teuthology.orchestra.run.smithi040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-24T03:56:04.240 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-24T03:56:04.240 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-24T03:56:04.241 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-24T03:56:04.241 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.241 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-24T03:56:04.241 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-24T03:56:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-24T03:56:04.243 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-24T03:56:04.244 INFO:teuthology.orchestra.run.smithi040.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-24T03:56:04.244 INFO:teuthology.orchestra.run.smithi040.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-24T03:56:04.244 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-24T03:56:04.244 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-24T03:56:04.244 INFO:teuthology.orchestra.run.smithi040.stdout: socat xmlstarlet 2023-05-24T03:56:04.284 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2023-05-24T03:56:04.284 INFO:teuthology.orchestra.run.smithi067.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-24T03:56:04.284 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-24T03:56:04.284 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-24T03:56:04.285 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-24T03:56:04.286 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-24T03:56:04.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-24T03:56:04.288 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-24T03:56:04.289 INFO:teuthology.orchestra.run.smithi067.stdout: socat xmlstarlet 2023-05-24T03:56:04.294 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2023-05-24T03:56:04.294 INFO:teuthology.orchestra.run.smithi121.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-24T03:56:04.295 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-24T03:56:04.295 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-24T03:56:04.296 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-24T03:56:04.296 INFO:teuthology.orchestra.run.smithi121.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.296 INFO:teuthology.orchestra.run.smithi121.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-24T03:56:04.296 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-24T03:56:04.296 INFO:teuthology.orchestra.run.smithi121.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-24T03:56:04.296 INFO:teuthology.orchestra.run.smithi121.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-24T03:56:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-24T03:56:04.298 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-24T03:56:04.299 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-24T03:56:04.299 INFO:teuthology.orchestra.run.smithi121.stdout: socat xmlstarlet 2023-05-24T03:56:04.302 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 115 newly installed, 0 to remove and 166 not upgraded. 2023-05-24T03:56:04.302 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 175 MB of archives. 2023-05-24T03:56:04.302 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-24T03:56:04.302 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-24T03:56:04.319 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-24T03:56:04.329 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-24T03:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2023-05-24T03:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-24T03:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-24T03:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-24T03:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-24T03:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-24T03:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-24T03:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-24T03:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-24T03:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-24T03:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-24T03:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-24T03:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-24T03:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-24T03:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-24T03:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: socat xmlstarlet 2023-05-24T03:56:04.354 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 115 newly installed, 0 to remove and 166 not upgraded. 2023-05-24T03:56:04.355 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 175 MB of archives. 2023-05-24T03:56:04.355 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-24T03:56:04.355 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-24T03:56:04.369 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-24T03:56:04.378 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-24T03:56:04.394 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-24T03:56:04.397 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-24T03:56:04.406 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-24T03:56:04.419 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,404 kB] 2023-05-24T03:56:04.437 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-24T03:56:04.454 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-24T03:56:04.458 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-24T03:56:04.470 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,404 kB] 2023-05-24T03:56:04.470 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-24T03:56:04.473 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 115 newly installed, 0 to remove and 166 not upgraded. 2023-05-24T03:56:04.473 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 175 MB of archives. 2023-05-24T03:56:04.473 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-24T03:56:04.473 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-24T03:56:04.482 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-24T03:56:04.483 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 115 newly installed, 0 to remove and 166 not upgraded. 2023-05-24T03:56:04.483 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 175 MB of archives. 2023-05-24T03:56:04.483 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-24T03:56:04.483 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-24T03:56:04.508 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-24T03:56:04.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,404 kB] 2023-05-24T03:56:04.531 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 115 newly installed, 0 to remove and 166 not upgraded. 2023-05-24T03:56:04.531 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 175 MB of archives. 2023-05-24T03:56:04.531 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-24T03:56:04.531 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-24T03:56:04.532 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,404 kB] 2023-05-24T03:56:04.548 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-24T03:56:04.555 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-24T03:56:04.566 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-24T03:56:04.594 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,404 kB] 2023-05-24T03:56:04.601 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-24T03:56:04.611 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-24T03:56:04.613 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-24T03:56:04.623 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-24T03:56:04.625 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-24T03:56:04.625 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-24T03:56:04.628 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-24T03:56:04.629 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-24T03:56:04.658 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-24T03:56:04.664 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-24T03:56:04.665 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-24T03:56:04.677 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-24T03:56:04.687 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-24T03:56:04.690 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-24T03:56:04.698 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-24T03:56:04.720 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-24T03:56:04.743 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-24T03:56:04.747 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-24T03:56:04.748 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-24T03:56:04.749 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-24T03:56:04.754 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-24T03:56:04.755 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-24T03:56:04.789 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-24T03:56:04.794 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-24T03:56:04.796 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-24T03:56:04.806 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-24T03:56:04.807 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-24T03:56:04.839 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-24T03:56:04.850 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-24T03:56:04.851 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-24T03:56:04.854 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-24T03:56:04.855 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-24T03:56:04.862 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-24T03:56:04.865 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-24T03:56:04.897 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-24T03:56:04.906 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-24T03:56:04.907 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-24T03:56:04.908 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-24T03:56:04.910 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-24T03:56:04.912 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-24T03:56:04.914 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-24T03:56:04.917 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-24T03:56:04.918 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-24T03:56:04.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-24T03:56:04.925 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-24T03:56:04.936 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-24T03:56:04.956 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-24T03:56:04.971 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-24T03:56:04.972 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-24T03:56:04.982 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-24T03:56:04.983 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-24T03:56:05.008 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-24T03:56:05.016 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-24T03:56:05.025 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-24T03:56:05.029 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-24T03:56:05.045 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-24T03:56:05.049 INFO:teuthology.orchestra.run.smithi040.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-24T03:56:05.052 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-24T03:56:05.064 INFO:teuthology.orchestra.run.smithi040.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-24T03:56:05.087 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,095 kB] 2023-05-24T03:56:05.137 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-24T03:56:05.145 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-24T03:56:05.148 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-24T03:56:05.157 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-24T03:56:05.163 INFO:teuthology.orchestra.run.smithi040.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-24T03:56:05.164 INFO:teuthology.orchestra.run.smithi040.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-24T03:56:05.166 INFO:teuthology.orchestra.run.smithi040.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-24T03:56:05.166 INFO:teuthology.orchestra.run.smithi040.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-24T03:56:05.167 INFO:teuthology.orchestra.run.smithi040.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-24T03:56:05.168 INFO:teuthology.orchestra.run.smithi040.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-24T03:56:05.172 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-24T03:56:05.183 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-24T03:56:05.195 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-24T03:56:05.204 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-24T03:56:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-24T03:56:05.223 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-24T03:56:05.230 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-24T03:56:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-24T03:56:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-24T03:56:05.344 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-24T03:56:05.353 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4167-gfa0e62c4-1jammy [657 kB] 2023-05-24T03:56:05.355 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-24T03:56:05.379 INFO:teuthology.orchestra.run.smithi040.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-24T03:56:05.380 INFO:teuthology.orchestra.run.smithi040.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-24T03:56:05.381 INFO:teuthology.orchestra.run.smithi040.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-24T03:56:05.382 INFO:teuthology.orchestra.run.smithi040.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-24T03:56:05.384 INFO:teuthology.orchestra.run.smithi040.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-24T03:56:05.385 INFO:teuthology.orchestra.run.smithi040.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-24T03:56:05.386 INFO:teuthology.orchestra.run.smithi040.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-24T03:56:05.387 INFO:teuthology.orchestra.run.smithi040.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-24T03:56:05.397 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4167-gfa0e62c4-1jammy [345 kB] 2023-05-24T03:56:05.402 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-24T03:56:05.419 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-24T03:56:05.429 INFO:teuthology.orchestra.run.smithi040.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-24T03:56:05.432 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4167-gfa0e62c4-1jammy [23.0 kB] 2023-05-24T03:56:05.433 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4167-gfa0e62c4-1jammy [170 kB] 2023-05-24T03:56:05.437 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4167-gfa0e62c4-1jammy [48.9 kB] 2023-05-24T03:56:05.439 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4167-gfa0e62c4-1jammy [318 kB] 2023-05-24T03:56:05.455 INFO:teuthology.orchestra.run.smithi040.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,095 kB] 2023-05-24T03:56:05.473 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4167-gfa0e62c4-1jammy [5,867 kB] 2023-05-24T03:56:05.513 INFO:teuthology.orchestra.run.smithi040.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-24T03:56:05.522 INFO:teuthology.orchestra.run.smithi040.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-24T03:56:05.530 INFO:teuthology.orchestra.run.smithi040.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-24T03:56:05.540 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-24T03:56:05.550 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-24T03:56:05.551 INFO:teuthology.orchestra.run.smithi040.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-24T03:56:05.562 INFO:teuthology.orchestra.run.smithi040.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-24T03:56:05.563 INFO:teuthology.orchestra.run.smithi040.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-24T03:56:05.575 INFO:teuthology.orchestra.run.smithi040.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-24T03:56:05.582 INFO:teuthology.orchestra.run.smithi040.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-24T03:56:05.583 INFO:teuthology.orchestra.run.smithi040.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-24T03:56:05.584 INFO:teuthology.orchestra.run.smithi040.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-24T03:56:05.597 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-24T03:56:05.620 INFO:teuthology.orchestra.run.smithi040.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-24T03:56:05.685 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,095 kB] 2023-05-24T03:56:05.703 INFO:teuthology.orchestra.run.smithi040.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-24T03:56:05.709 INFO:teuthology.orchestra.run.smithi040.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-24T03:56:05.752 INFO:teuthology.orchestra.run.smithi040.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-24T03:56:05.753 INFO:teuthology.orchestra.run.smithi040.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-24T03:56:05.753 INFO:teuthology.orchestra.run.smithi040.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-24T03:56:05.759 INFO:teuthology.orchestra.run.smithi040.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-24T03:56:05.761 INFO:teuthology.orchestra.run.smithi040.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-24T03:56:05.786 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-24T03:56:05.790 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,095 kB] 2023-05-24T03:56:05.793 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-24T03:56:05.795 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-24T03:56:05.806 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-24T03:56:05.807 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-24T03:56:05.809 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-24T03:56:05.811 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-24T03:56:05.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-24T03:56:05.814 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-24T03:56:05.892 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4167-gfa0e62c4-1jammy [102 kB] 2023-05-24T03:56:05.895 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4167-gfa0e62c4-1jammy [429 kB] 2023-05-24T03:56:05.899 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4167-gfa0e62c4-1jammy [3,095 kB] 2023-05-24T03:56:05.908 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-24T03:56:05.915 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-24T03:56:05.917 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-24T03:56:05.918 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-24T03:56:05.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-24T03:56:05.927 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-24T03:56:05.929 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-24T03:56:05.930 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-24T03:56:05.932 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-24T03:56:05.933 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-24T03:56:05.935 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-24T03:56:05.937 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-24T03:56:05.939 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-24T03:56:05.940 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-24T03:56:05.941 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-24T03:56:05.943 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-24T03:56:05.945 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-24T03:56:05.947 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-24T03:56:05.948 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4167-gfa0e62c4-1jammy [21.9 MB] 2023-05-24T03:56:05.964 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-24T03:56:05.969 INFO:teuthology.orchestra.run.smithi040.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4167-gfa0e62c4-1jammy [657 kB] 2023-05-24T03:56:05.972 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-24T03:56:05.974 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-24T03:56:05.979 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-24T03:56:05.985 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-24T03:56:05.986 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-24T03:56:05.988 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-24T03:56:05.990 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-24T03:56:05.991 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-24T03:56:05.993 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-24T03:56:06.059 INFO:teuthology.orchestra.run.smithi040.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4167-gfa0e62c4-1jammy [345 kB] 2023-05-24T03:56:06.101 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-24T03:56:06.112 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-24T03:56:06.135 INFO:teuthology.orchestra.run.smithi040.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4167-gfa0e62c4-1jammy [23.0 kB] 2023-05-24T03:56:06.136 INFO:teuthology.orchestra.run.smithi040.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4167-gfa0e62c4-1jammy [170 kB] 2023-05-24T03:56:06.141 INFO:teuthology.orchestra.run.smithi040.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4167-gfa0e62c4-1jammy [48.9 kB] 2023-05-24T03:56:06.143 INFO:teuthology.orchestra.run.smithi040.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4167-gfa0e62c4-1jammy [318 kB] 2023-05-24T03:56:06.159 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-24T03:56:06.221 INFO:teuthology.orchestra.run.smithi040.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4167-gfa0e62c4-1jammy [5,867 kB] 2023-05-24T03:56:06.349 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4167-gfa0e62c4-1jammy [657 kB] 2023-05-24T03:56:06.411 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-24T03:56:06.421 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-24T03:56:06.427 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-24T03:56:06.431 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-24T03:56:06.448 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-24T03:56:06.452 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-24T03:56:06.454 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-24T03:56:06.496 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-24T03:56:06.510 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-24T03:56:06.514 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-24T03:56:06.530 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4167-gfa0e62c4-1jammy [345 kB] 2023-05-24T03:56:06.532 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-24T03:56:06.542 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-24T03:56:06.543 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-24T03:56:06.547 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-24T03:56:06.551 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-24T03:56:06.553 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-24T03:56:06.559 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-24T03:56:06.563 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-24T03:56:06.569 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-24T03:56:06.572 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-24T03:56:06.575 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-24T03:56:06.580 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-24T03:56:06.584 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-24T03:56:06.586 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-24T03:56:06.590 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-24T03:56:06.600 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-24T03:56:06.603 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4167-gfa0e62c4-1jammy [657 kB] 2023-05-24T03:56:06.606 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-24T03:56:06.610 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-24T03:56:06.616 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-24T03:56:06.628 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-24T03:56:06.628 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-24T03:56:06.630 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-24T03:56:06.631 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-24T03:56:06.633 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-24T03:56:06.635 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-24T03:56:06.638 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4167-gfa0e62c4-1jammy [23.0 kB] 2023-05-24T03:56:06.638 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4167-gfa0e62c4-1jammy [170 kB] 2023-05-24T03:56:06.641 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-24T03:56:06.642 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4167-gfa0e62c4-1jammy [48.9 kB] 2023-05-24T03:56:06.644 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4167-gfa0e62c4-1jammy [318 kB] 2023-05-24T03:56:06.646 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-24T03:56:06.675 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-24T03:56:06.689 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-24T03:56:06.691 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4167-gfa0e62c4-1jammy [345 kB] 2023-05-24T03:56:06.694 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-24T03:56:06.707 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4167-gfa0e62c4-1jammy [5,867 kB] 2023-05-24T03:56:06.741 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4167-gfa0e62c4-1jammy [657 kB] 2023-05-24T03:56:06.764 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4167-gfa0e62c4-1jammy [23.0 kB] 2023-05-24T03:56:06.765 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4167-gfa0e62c4-1jammy [170 kB] 2023-05-24T03:56:06.769 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-24T03:56:06.833 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4167-gfa0e62c4-1jammy [48.9 kB] 2023-05-24T03:56:06.835 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4167-gfa0e62c4-1jammy [318 kB] 2023-05-24T03:56:06.846 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4167-gfa0e62c4-1jammy [5,867 kB] 2023-05-24T03:56:06.851 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-24T03:56:06.888 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-24T03:56:06.902 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-24T03:56:06.942 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-24T03:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-24T03:56:06.971 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-24T03:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4167-gfa0e62c4-1jammy [345 kB] 2023-05-24T03:56:06.985 INFO:teuthology.orchestra.run.smithi121.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-24T03:56:06.999 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-24T03:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-24T03:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4167-gfa0e62c4-1jammy [23.0 kB] 2023-05-24T03:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4167-gfa0e62c4-1jammy [170 kB] 2023-05-24T03:56:07.060 INFO:teuthology.orchestra.run.smithi067.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-24T03:56:07.075 INFO:teuthology.orchestra.run.smithi121.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-24T03:56:07.117 INFO:teuthology.orchestra.run.smithi067.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-24T03:56:07.120 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-24T03:56:07.121 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-24T03:56:07.133 INFO:teuthology.orchestra.run.smithi121.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-24T03:56:07.139 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4167-gfa0e62c4-1jammy [48.9 kB] 2023-05-24T03:56:07.141 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4167-gfa0e62c4-1jammy [318 kB] 2023-05-24T03:56:07.179 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-24T03:56:07.207 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-24T03:56:07.226 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-24T03:56:07.228 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4167-gfa0e62c4-1jammy [5,867 kB] 2023-05-24T03:56:07.239 INFO:teuthology.orchestra.run.smithi067.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-24T03:56:07.245 INFO:teuthology.orchestra.run.smithi040.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4167-gfa0e62c4-1jammy [102 kB] 2023-05-24T03:56:07.255 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-24T03:56:07.255 INFO:teuthology.orchestra.run.smithi121.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-24T03:56:07.266 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-24T03:56:07.300 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-24T03:56:07.304 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-24T03:56:07.312 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-24T03:56:07.319 INFO:teuthology.orchestra.run.smithi040.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4167-gfa0e62c4-1jammy [429 kB] 2023-05-24T03:56:07.326 INFO:teuthology.orchestra.run.smithi067.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-24T03:56:07.342 INFO:teuthology.orchestra.run.smithi121.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-24T03:56:07.344 INFO:teuthology.orchestra.run.smithi067.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-24T03:56:07.361 INFO:teuthology.orchestra.run.smithi121.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-24T03:56:07.373 INFO:teuthology.orchestra.run.smithi067.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-24T03:56:07.385 INFO:teuthology.orchestra.run.smithi067.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-24T03:56:07.387 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-24T03:56:07.389 INFO:teuthology.orchestra.run.smithi121.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-24T03:56:07.401 INFO:teuthology.orchestra.run.smithi121.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-24T03:56:07.406 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-24T03:56:07.407 INFO:teuthology.orchestra.run.smithi040.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4167-gfa0e62c4-1jammy [21.9 MB] 2023-05-24T03:56:07.423 INFO:teuthology.orchestra.run.smithi067.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-24T03:56:07.431 INFO:teuthology.orchestra.run.smithi067.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-24T03:56:07.435 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-24T03:56:07.440 INFO:teuthology.orchestra.run.smithi121.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-24T03:56:07.447 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-24T03:56:07.447 INFO:teuthology.orchestra.run.smithi121.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-24T03:56:07.485 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-24T03:56:07.493 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-24T03:56:07.504 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-24T03:56:07.622 INFO:teuthology.orchestra.run.smithi067.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-24T03:56:07.639 INFO:teuthology.orchestra.run.smithi121.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-24T03:56:07.686 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-24T03:56:07.847 INFO:teuthology.orchestra.run.smithi067.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4167-gfa0e62c4-1jammy [102 kB] 2023-05-24T03:56:07.850 INFO:teuthology.orchestra.run.smithi067.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4167-gfa0e62c4-1jammy [429 kB] 2023-05-24T03:56:07.896 INFO:teuthology.orchestra.run.smithi067.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4167-gfa0e62c4-1jammy [21.9 MB] 2023-05-24T03:56:07.944 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4167-gfa0e62c4-1jammy [6,824 kB] 2023-05-24T03:56:08.137 INFO:teuthology.orchestra.run.smithi121.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4167-gfa0e62c4-1jammy [102 kB] 2023-05-24T03:56:08.139 INFO:teuthology.orchestra.run.smithi121.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4167-gfa0e62c4-1jammy [429 kB] 2023-05-24T03:56:08.218 INFO:teuthology.orchestra.run.smithi121.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4167-gfa0e62c4-1jammy [21.9 MB] 2023-05-24T03:56:08.314 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-24T03:56:08.316 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-24T03:56:08.319 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-24T03:56:08.320 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-24T03:56:08.321 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-24T03:56:08.323 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-24T03:56:08.366 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-24T03:56:08.369 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-24T03:56:08.370 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-24T03:56:08.426 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-24T03:56:08.431 INFO:teuthology.orchestra.run.smithi067.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-24T03:56:08.433 INFO:teuthology.orchestra.run.smithi067.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-24T03:56:08.436 INFO:teuthology.orchestra.run.smithi067.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-24T03:56:08.437 INFO:teuthology.orchestra.run.smithi067.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-24T03:56:08.438 INFO:teuthology.orchestra.run.smithi067.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-24T03:56:08.441 INFO:teuthology.orchestra.run.smithi067.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-24T03:56:08.451 INFO:teuthology.orchestra.run.smithi121.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-24T03:56:08.454 INFO:teuthology.orchestra.run.smithi121.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-24T03:56:08.456 INFO:teuthology.orchestra.run.smithi121.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-24T03:56:08.458 INFO:teuthology.orchestra.run.smithi121.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-24T03:56:08.458 INFO:teuthology.orchestra.run.smithi121.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-24T03:56:08.461 INFO:teuthology.orchestra.run.smithi121.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-24T03:56:08.465 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4167-gfa0e62c4-1jammy [226 kB] 2023-05-24T03:56:08.470 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [114 kB] 2023-05-24T03:56:08.486 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4167-gfa0e62c4-1jammy [1,469 kB] 2023-05-24T03:56:08.486 INFO:teuthology.orchestra.run.smithi067.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-24T03:56:08.490 INFO:teuthology.orchestra.run.smithi067.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-24T03:56:08.491 INFO:teuthology.orchestra.run.smithi067.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-24T03:56:08.498 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-24T03:56:08.505 INFO:teuthology.orchestra.run.smithi121.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-24T03:56:08.505 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-24T03:56:08.505 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-24T03:56:08.505 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-24T03:56:08.506 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-24T03:56:08.506 INFO:teuthology.orchestra.run.smithi121.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-24T03:56:08.506 INFO:teuthology.orchestra.run.smithi121.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-24T03:56:08.508 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-24T03:56:08.543 INFO:teuthology.orchestra.run.smithi067.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-24T03:56:08.551 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-24T03:56:08.555 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-24T03:56:08.555 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-24T03:56:08.562 INFO:teuthology.orchestra.run.smithi121.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-24T03:56:08.590 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-24T03:56:08.606 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-24T03:56:08.632 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4167-gfa0e62c4-1jammy [9,851 kB] 2023-05-24T03:56:08.707 INFO:teuthology.orchestra.run.smithi067.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-24T03:56:08.726 INFO:teuthology.orchestra.run.smithi121.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-24T03:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-24T03:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4167-gfa0e62c4-1jammy [102 kB] 2023-05-24T03:56:08.848 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-24T03:56:08.880 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-24T03:56:08.881 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4167-gfa0e62c4-1jammy [429 kB] 2023-05-24T03:56:08.905 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-24T03:56:08.957 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-24T03:56:08.963 INFO:teuthology.orchestra.run.smithi067.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-24T03:56:08.968 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4167-gfa0e62c4-1jammy [21.9 MB] 2023-05-24T03:56:08.977 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-24T03:56:08.980 INFO:teuthology.orchestra.run.smithi121.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-24T03:56:08.996 INFO:teuthology.orchestra.run.smithi067.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-24T03:56:09.004 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-24T03:56:09.012 INFO:teuthology.orchestra.run.smithi121.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-24T03:56:09.024 INFO:teuthology.orchestra.run.smithi067.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-24T03:56:09.030 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-24T03:56:09.040 INFO:teuthology.orchestra.run.smithi121.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-24T03:56:09.063 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-24T03:56:09.077 INFO:teuthology.orchestra.run.smithi067.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-24T03:56:09.089 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-24T03:56:09.091 INFO:teuthology.orchestra.run.smithi121.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-24T03:56:09.096 INFO:teuthology.orchestra.run.smithi067.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-24T03:56:09.110 INFO:teuthology.orchestra.run.smithi121.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-24T03:56:09.123 INFO:teuthology.orchestra.run.smithi067.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-24T03:56:09.133 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-24T03:56:09.139 INFO:teuthology.orchestra.run.smithi121.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-24T03:56:09.140 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-24T03:56:09.161 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-24T03:56:09.164 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-24T03:56:09.184 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-24T03:56:09.188 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-24T03:56:09.192 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-24T03:56:09.252 INFO:teuthology.orchestra.run.smithi067.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-24T03:56:09.267 INFO:teuthology.orchestra.run.smithi121.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-24T03:56:09.283 INFO:teuthology.orchestra.run.smithi067.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-24T03:56:09.298 INFO:teuthology.orchestra.run.smithi121.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-24T03:56:09.303 INFO:teuthology.orchestra.run.smithi067.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-24T03:56:09.311 INFO:teuthology.orchestra.run.smithi067.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-24T03:56:09.317 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-24T03:56:09.318 INFO:teuthology.orchestra.run.smithi121.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-24T03:56:09.326 INFO:teuthology.orchestra.run.smithi121.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-24T03:56:09.349 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-24T03:56:09.369 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-24T03:56:09.377 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-24T03:56:09.396 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-24T03:56:09.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-24T03:56:09.530 INFO:teuthology.orchestra.run.smithi121.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-24T03:56:09.581 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-24T03:56:09.663 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4167-gfa0e62c4-1jammy [31.5 MB] 2023-05-24T03:56:09.857 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-24T03:56:09.862 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-24T03:56:09.976 INFO:teuthology.orchestra.run.smithi067.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-24T03:56:09.982 INFO:teuthology.orchestra.run.smithi067.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-24T03:56:09.988 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-24T03:56:09.990 INFO:teuthology.orchestra.run.smithi121.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-24T03:56:09.995 INFO:teuthology.orchestra.run.smithi121.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-24T03:56:10.035 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-24T03:56:10.036 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-24T03:56:10.041 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-24T03:56:10.041 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-24T03:56:10.043 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-24T03:56:10.046 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-24T03:56:10.059 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-24T03:56:10.066 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-24T03:56:10.108 INFO:teuthology.orchestra.run.smithi067.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-24T03:56:10.122 INFO:teuthology.orchestra.run.smithi121.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-24T03:56:10.127 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-24T03:56:10.155 INFO:teuthology.orchestra.run.smithi067.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-24T03:56:10.155 INFO:teuthology.orchestra.run.smithi067.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-24T03:56:10.161 INFO:teuthology.orchestra.run.smithi067.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-24T03:56:10.163 INFO:teuthology.orchestra.run.smithi067.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-24T03:56:10.168 INFO:teuthology.orchestra.run.smithi121.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-24T03:56:10.169 INFO:teuthology.orchestra.run.smithi121.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-24T03:56:10.173 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-24T03:56:10.175 INFO:teuthology.orchestra.run.smithi121.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-24T03:56:10.177 INFO:teuthology.orchestra.run.smithi121.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-24T03:56:10.178 INFO:teuthology.orchestra.run.smithi067.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-24T03:56:10.186 INFO:teuthology.orchestra.run.smithi067.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-24T03:56:10.193 INFO:teuthology.orchestra.run.smithi121.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-24T03:56:10.200 INFO:teuthology.orchestra.run.smithi121.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-24T03:56:10.220 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-24T03:56:10.221 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-24T03:56:10.227 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-24T03:56:10.228 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-24T03:56:10.244 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-24T03:56:10.247 INFO:teuthology.orchestra.run.smithi067.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-24T03:56:10.252 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-24T03:56:10.261 INFO:teuthology.orchestra.run.smithi121.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-24T03:56:10.292 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-24T03:56:10.313 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-24T03:56:10.412 INFO:teuthology.orchestra.run.smithi067.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-24T03:56:10.425 INFO:teuthology.orchestra.run.smithi121.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-24T03:56:10.457 INFO:teuthology.orchestra.run.smithi162.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-24T03:56:10.478 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-24T03:56:10.578 INFO:teuthology.orchestra.run.smithi067.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-24T03:56:10.591 INFO:teuthology.orchestra.run.smithi121.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-24T03:56:10.644 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-24T03:56:10.731 INFO:teuthology.orchestra.run.smithi162.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-24T03:56:10.756 INFO:teuthology.orchestra.run.smithi162.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-24T03:56:10.870 INFO:teuthology.orchestra.run.smithi121.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-24T03:56:10.872 INFO:teuthology.orchestra.run.smithi067.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-24T03:56:10.872 INFO:teuthology.orchestra.run.smithi067.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4167-gfa0e62c4-1jammy [6,824 kB] 2023-05-24T03:56:10.880 INFO:teuthology.orchestra.run.smithi067.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-24T03:56:10.895 INFO:teuthology.orchestra.run.smithi121.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-24T03:56:10.923 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-24T03:56:10.949 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-24T03:56:11.669 INFO:teuthology.orchestra.run.smithi067.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4167-gfa0e62c4-1jammy [226 kB] 2023-05-24T03:56:11.697 INFO:teuthology.orchestra.run.smithi067.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [114 kB] 2023-05-24T03:56:11.702 INFO:teuthology.orchestra.run.smithi067.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4167-gfa0e62c4-1jammy [1,469 kB] 2023-05-24T03:56:11.889 INFO:teuthology.orchestra.run.smithi067.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4167-gfa0e62c4-1jammy [9,851 kB] 2023-05-24T03:56:12.251 INFO:teuthology.orchestra.run.smithi040.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4167-gfa0e62c4-1jammy [6,824 kB] 2023-05-24T03:56:12.817 INFO:teuthology.orchestra.run.smithi121.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4167-gfa0e62c4-1jammy [6,824 kB] 2023-05-24T03:56:13.077 INFO:teuthology.orchestra.run.smithi162.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [3,594 B] 2023-05-24T03:56:13.077 INFO:teuthology.orchestra.run.smithi162.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [810 kB] 2023-05-24T03:56:13.093 INFO:teuthology.orchestra.run.smithi162.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4167-gfa0e62c4-1jammy [2,165 kB] 2023-05-24T03:56:13.170 INFO:teuthology.orchestra.run.smithi067.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4167-gfa0e62c4-1jammy [31.5 MB] 2023-05-24T03:56:13.340 INFO:teuthology.orchestra.run.smithi162.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4167-gfa0e62c4-1jammy [211 kB] 2023-05-24T03:56:13.381 INFO:teuthology.orchestra.run.smithi162.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4167-gfa0e62c4-1jammy [124 kB] 2023-05-24T03:56:13.384 INFO:teuthology.orchestra.run.smithi162.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4167-gfa0e62c4-1jammy [1,841 kB] 2023-05-24T03:56:13.542 INFO:teuthology.orchestra.run.smithi162.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4167-gfa0e62c4-1jammy [8,615 kB] 2023-05-24T03:56:13.674 INFO:teuthology.orchestra.run.smithi040.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4167-gfa0e62c4-1jammy [226 kB] 2023-05-24T03:56:13.741 INFO:teuthology.orchestra.run.smithi040.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [114 kB] 2023-05-24T03:56:13.764 INFO:teuthology.orchestra.run.smithi040.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4167-gfa0e62c4-1jammy [1,469 kB] 2023-05-24T03:56:14.123 INFO:teuthology.orchestra.run.smithi040.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4167-gfa0e62c4-1jammy [9,851 kB] 2023-05-24T03:56:14.167 INFO:teuthology.orchestra.run.smithi121.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4167-gfa0e62c4-1jammy [226 kB] 2023-05-24T03:56:14.228 INFO:teuthology.orchestra.run.smithi121.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [114 kB] 2023-05-24T03:56:14.250 INFO:teuthology.orchestra.run.smithi121.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4167-gfa0e62c4-1jammy [1,469 kB] 2023-05-24T03:56:14.461 INFO:teuthology.orchestra.run.smithi162.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4167-gfa0e62c4-1jammy [3,724 B] 2023-05-24T03:56:14.501 INFO:teuthology.orchestra.run.smithi162.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4167-gfa0e62c4-1jammy [40.9 MB] 2023-05-24T03:56:14.535 INFO:teuthology.orchestra.run.smithi121.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4167-gfa0e62c4-1jammy [9,851 kB] 2023-05-24T03:56:14.658 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4167-gfa0e62c4-1jammy [6,824 kB] 2023-05-24T03:56:16.265 INFO:teuthology.orchestra.run.smithi040.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4167-gfa0e62c4-1jammy [31.5 MB] 2023-05-24T03:56:16.269 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4167-gfa0e62c4-1jammy [226 kB] 2023-05-24T03:56:16.278 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [114 kB] 2023-05-24T03:56:16.357 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4167-gfa0e62c4-1jammy [1,469 kB] 2023-05-24T03:56:16.552 INFO:teuthology.orchestra.run.smithi121.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4167-gfa0e62c4-1jammy [31.5 MB] 2023-05-24T03:56:16.648 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4167-gfa0e62c4-1jammy [9,851 kB] 2023-05-24T03:56:17.061 INFO:teuthology.orchestra.run.smithi067.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [3,594 B] 2023-05-24T03:56:17.062 INFO:teuthology.orchestra.run.smithi067.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [810 kB] 2023-05-24T03:56:17.078 INFO:teuthology.orchestra.run.smithi067.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4167-gfa0e62c4-1jammy [2,165 kB] 2023-05-24T03:56:17.352 INFO:teuthology.orchestra.run.smithi067.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4167-gfa0e62c4-1jammy [211 kB] 2023-05-24T03:56:17.357 INFO:teuthology.orchestra.run.smithi067.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4167-gfa0e62c4-1jammy [124 kB] 2023-05-24T03:56:17.359 INFO:teuthology.orchestra.run.smithi067.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4167-gfa0e62c4-1jammy [1,841 kB] 2023-05-24T03:56:17.652 INFO:teuthology.orchestra.run.smithi067.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4167-gfa0e62c4-1jammy [8,615 kB] 2023-05-24T03:56:18.929 INFO:teuthology.orchestra.run.smithi155.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4167-gfa0e62c4-1jammy [31.5 MB] 2023-05-24T03:56:18.991 INFO:teuthology.orchestra.run.smithi067.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4167-gfa0e62c4-1jammy [3,724 B] 2023-05-24T03:56:18.992 INFO:teuthology.orchestra.run.smithi067.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4167-gfa0e62c4-1jammy [40.9 MB] 2023-05-24T03:56:19.471 INFO:teuthology.orchestra.run.smithi162.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4167-gfa0e62c4-1jammy [231 kB] 2023-05-24T03:56:19.475 INFO:teuthology.orchestra.run.smithi162.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4167-gfa0e62c4-1jammy [214 kB] 2023-05-24T03:56:19.480 INFO:teuthology.orchestra.run.smithi162.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4167-gfa0e62c4-1jammy [23.8 kB] 2023-05-24T03:56:19.480 INFO:teuthology.orchestra.run.smithi162.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4167-gfa0e62c4-1jammy [13.2 kB] 2023-05-24T03:56:19.481 INFO:teuthology.orchestra.run.smithi162.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4167-gfa0e62c4-1jammy [28.3 kB] 2023-05-24T03:56:19.482 INFO:teuthology.orchestra.run.smithi162.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4167-gfa0e62c4-1jammy [11.6 MB] 2023-05-24T03:56:20.576 INFO:teuthology.orchestra.run.smithi162.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [82.1 kB] 2023-05-24T03:56:21.119 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 175 MB in 16s (10.7 MB/s) 2023-05-24T03:56:21.256 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-24T03:56:21.349 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-05-24T03:56:21.355 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-24T03:56:21.396 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-24T03:56:21.699 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-24T03:56:21.726 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-24T03:56:21.766 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:56:21.917 INFO:teuthology.orchestra.run.smithi040.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [3,594 B] 2023-05-24T03:56:21.918 INFO:teuthology.orchestra.run.smithi040.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [810 kB] 2023-05-24T03:56:21.933 INFO:teuthology.orchestra.run.smithi040.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4167-gfa0e62c4-1jammy [2,165 kB] 2023-05-24T03:56:22.052 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cmd2. 2023-05-24T03:56:22.078 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-24T03:56:22.111 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-24T03:56:22.169 INFO:teuthology.orchestra.run.smithi040.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4167-gfa0e62c4-1jammy [211 kB] 2023-05-24T03:56:22.188 INFO:teuthology.orchestra.run.smithi040.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4167-gfa0e62c4-1jammy [124 kB] 2023-05-24T03:56:22.191 INFO:teuthology.orchestra.run.smithi040.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4167-gfa0e62c4-1jammy [1,841 kB] 2023-05-24T03:56:22.388 INFO:teuthology.orchestra.run.smithi040.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4167-gfa0e62c4-1jammy [8,615 kB] 2023-05-24T03:56:22.483 INFO:teuthology.orchestra.run.smithi121.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [3,594 B] 2023-05-24T03:56:22.492 INFO:teuthology.orchestra.run.smithi121.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [810 kB] 2023-05-24T03:56:22.510 INFO:teuthology.orchestra.run.smithi121.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4167-gfa0e62c4-1jammy [2,165 kB] 2023-05-24T03:56:22.606 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-24T03:56:22.632 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-24T03:56:22.764 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:56:22.804 INFO:teuthology.orchestra.run.smithi121.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4167-gfa0e62c4-1jammy [211 kB] 2023-05-24T03:56:22.847 INFO:teuthology.orchestra.run.smithi121.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4167-gfa0e62c4-1jammy [124 kB] 2023-05-24T03:56:22.857 INFO:teuthology.orchestra.run.smithi121.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4167-gfa0e62c4-1jammy [1,841 kB] 2023-05-24T03:56:23.101 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-24T03:56:23.127 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-24T03:56:23.135 INFO:teuthology.orchestra.run.smithi121.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4167-gfa0e62c4-1jammy [8,615 kB] 2023-05-24T03:56:23.167 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:56:23.397 INFO:teuthology.orchestra.run.smithi040.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4167-gfa0e62c4-1jammy [3,724 B] 2023-05-24T03:56:23.397 INFO:teuthology.orchestra.run.smithi040.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4167-gfa0e62c4-1jammy [40.9 MB] 2023-05-24T03:56:23.529 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-24T03:56:23.545 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-24T03:56:23.579 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:56:23.644 INFO:teuthology.orchestra.run.smithi067.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4167-gfa0e62c4-1jammy [231 kB] 2023-05-24T03:56:23.648 INFO:teuthology.orchestra.run.smithi067.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4167-gfa0e62c4-1jammy [214 kB] 2023-05-24T03:56:23.652 INFO:teuthology.orchestra.run.smithi067.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4167-gfa0e62c4-1jammy [23.8 kB] 2023-05-24T03:56:23.653 INFO:teuthology.orchestra.run.smithi067.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4167-gfa0e62c4-1jammy [13.2 kB] 2023-05-24T03:56:23.707 INFO:teuthology.orchestra.run.smithi067.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4167-gfa0e62c4-1jammy [28.3 kB] 2023-05-24T03:56:23.708 INFO:teuthology.orchestra.run.smithi067.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4167-gfa0e62c4-1jammy [11.6 MB] 2023-05-24T03:56:23.866 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-24T03:56:23.892 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-24T03:56:23.932 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:56:24.378 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-24T03:56:24.404 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:24.453 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:24.488 INFO:teuthology.orchestra.run.smithi121.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4167-gfa0e62c4-1jammy [3,724 B] 2023-05-24T03:56:24.488 INFO:teuthology.orchestra.run.smithi121.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4167-gfa0e62c4-1jammy [40.9 MB] 2023-05-24T03:56:24.819 INFO:teuthology.orchestra.run.smithi067.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [82.1 kB] 2023-05-24T03:56:24.839 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-24T03:56:24.866 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:24.867 INFO:teuthology.orchestra.run.smithi155.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4167-gfa0e62c4-1jammy [3,594 B] 2023-05-24T03:56:24.868 INFO:teuthology.orchestra.run.smithi155.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [810 kB] 2023-05-24T03:56:24.883 INFO:teuthology.orchestra.run.smithi155.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4167-gfa0e62c4-1jammy [2,165 kB] 2023-05-24T03:56:24.906 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:25.118 INFO:teuthology.orchestra.run.smithi155.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4167-gfa0e62c4-1jammy [211 kB] 2023-05-24T03:56:25.150 INFO:teuthology.orchestra.run.smithi155.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4167-gfa0e62c4-1jammy [124 kB] 2023-05-24T03:56:25.155 INFO:teuthology.orchestra.run.smithi155.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4167-gfa0e62c4-1jammy [1,841 kB] 2023-05-24T03:56:25.259 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-24T03:56:25.286 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:25.326 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:25.374 INFO:teuthology.orchestra.run.smithi155.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4167-gfa0e62c4-1jammy [8,615 kB] 2023-05-24T03:56:25.382 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 175 MB in 21s (8,524 kB/s) 2023-05-24T03:56:25.536 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-24T03:56:25.638 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-05-24T03:56:25.644 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-24T03:56:25.654 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-24T03:56:25.681 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-24T03:56:25.683 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-24T03:56:25.720 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:56:26.094 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-24T03:56:26.121 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-24T03:56:26.161 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:56:26.249 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2. 2023-05-24T03:56:26.275 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../011-librados2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:26.315 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:26.430 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cmd2. 2023-05-24T03:56:26.446 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-24T03:56:26.480 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-24T03:56:26.644 INFO:teuthology.orchestra.run.smithi155.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4167-gfa0e62c4-1jammy [3,724 B] 2023-05-24T03:56:26.645 INFO:teuthology.orchestra.run.smithi155.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4167-gfa0e62c4-1jammy [40.9 MB] 2023-05-24T03:56:26.760 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1. 2023-05-24T03:56:26.787 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../012-librbd1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:26.792 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-24T03:56:26.818 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-24T03:56:26.827 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:26.900 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:56:27.230 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2023-05-24T03:56:27.256 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:27.296 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:27.420 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-24T03:56:27.446 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-24T03:56:27.486 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:56:27.524 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2023-05-24T03:56:27.550 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:27.590 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4167-gfa0e62c4-1jammy [231 kB] 2023-05-24T03:56:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4167-gfa0e62c4-1jammy [214 kB] 2023-05-24T03:56:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4167-gfa0e62c4-1jammy [23.8 kB] 2023-05-24T03:56:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4167-gfa0e62c4-1jammy [13.2 kB] 2023-05-24T03:56:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4167-gfa0e62c4-1jammy [28.3 kB] 2023-05-24T03:56:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4167-gfa0e62c4-1jammy [11.6 MB] 2023-05-24T03:56:27.814 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-24T03:56:27.841 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-24T03:56:27.881 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:56:27.918 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-24T03:56:27.944 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:27.985 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:28.176 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-24T03:56:28.202 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-24T03:56:28.234 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:56:28.237 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2023-05-24T03:56:28.253 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:28.296 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [82.1 kB] 2023-05-24T03:56:28.557 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-24T03:56:28.583 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:28.615 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:28.662 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-24T03:56:28.689 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:28.737 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:28.935 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2023-05-24T03:56:28.962 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-24T03:56:29.010 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-24T03:56:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 175 MB in 24s (7,203 kB/s) 2023-05-24T03:56:29.132 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-24T03:56:29.146 INFO:teuthology.orchestra.run.smithi121.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4167-gfa0e62c4-1jammy [231 kB] 2023-05-24T03:56:29.151 INFO:teuthology.orchestra.run.smithi121.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4167-gfa0e62c4-1jammy [214 kB] 2023-05-24T03:56:29.155 INFO:teuthology.orchestra.run.smithi121.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4167-gfa0e62c4-1jammy [23.8 kB] 2023-05-24T03:56:29.156 INFO:teuthology.orchestra.run.smithi121.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4167-gfa0e62c4-1jammy [13.2 kB] 2023-05-24T03:56:29.156 INFO:teuthology.orchestra.run.smithi121.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4167-gfa0e62c4-1jammy [28.3 kB] 2023-05-24T03:56:29.157 INFO:teuthology.orchestra.run.smithi121.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4167-gfa0e62c4-1jammy [11.6 MB] 2023-05-24T03:56:29.158 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:29.198 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-24T03:56:29.263 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2023-05-24T03:56:29.289 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-05-24T03:56:29.329 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-24T03:56:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-24T03:56:29.501 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-24T03:56:29.528 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:29.560 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-24T03:56:29.649 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-24T03:56:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-24T03:56:29.675 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-24T03:56:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:56:29.716 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:56:29.913 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-24T03:56:29.940 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-24T03:56:29.979 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:56:30.002 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2023-05-24T03:56:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cmd2. 2023-05-24T03:56:30.029 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../021-librgw2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-24T03:56:30.069 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-24T03:56:30.104 INFO:teuthology.orchestra.run.smithi121.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [82.1 kB] 2023-05-24T03:56:30.332 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2. 2023-05-24T03:56:30.359 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../011-librados2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:30.399 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-24T03:56:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-24T03:56:30.563 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2023-05-24T03:56:30.578 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:30.621 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:56:30.649 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 175 MB in 26s (6,780 kB/s) 2023-05-24T03:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4167-gfa0e62c4-1jammy [231 kB] 2023-05-24T03:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4167-gfa0e62c4-1jammy [214 kB] 2023-05-24T03:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4167-gfa0e62c4-1jammy [23.8 kB] 2023-05-24T03:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4167-gfa0e62c4-1jammy [13.2 kB] 2023-05-24T03:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4167-gfa0e62c4-1jammy [28.3 kB] 2023-05-24T03:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4167-gfa0e62c4-1jammy [11.6 MB] 2023-05-24T03:56:30.791 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-24T03:56:30.835 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1. 2023-05-24T03:56:30.862 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../012-librbd1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:30.887 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-05-24T03:56:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-24T03:56:30.901 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:30.939 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-24T03:56:30.958 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-24T03:56:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-24T03:56:30.984 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-24T03:56:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-24T03:56:31.024 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:56:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:56:31.209 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-24T03:56:31.235 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-24T03:56:31.267 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:56:31.329 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2. 2023-05-24T03:56:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-24T03:56:31.356 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-24T03:56:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:56:31.395 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:31.428 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2023-05-24T03:56:31.454 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:31.494 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:31.520 INFO:teuthology.orchestra.run.smithi155.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4167-gfa0e62c4-1jammy [82.1 kB] 2023-05-24T03:56:31.595 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cmd2. 2023-05-24T03:56:31.621 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-24T03:56:31.661 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-24T03:56:31.673 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rados. 2023-05-24T03:56:31.689 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-24T03:56:31.731 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-24T03:56:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:56:31.906 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2023-05-24T03:56:31.933 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:31.972 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:31.989 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-24T03:56:32.009 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-24T03:56:32.015 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-24T03:56:32.036 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:32.067 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:32.094 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 175 MB in 27s (6,434 kB/s) 2023-05-24T03:56:32.098 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:56:32.218 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-24T03:56:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-24T03:56:32.299 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:32.303 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cephfs. 2023-05-24T03:56:32.307 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-05-24T03:56:32.312 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-24T03:56:32.319 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:32.350 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-24T03:56:32.361 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:32.426 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-24T03:56:32.452 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-24T03:56:32.492 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:56:32.637 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-24T03:56:32.663 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-24T03:56:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-24T03:56:32.703 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:56:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:32.780 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-24T03:56:32.807 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:32.821 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-24T03:56:32.847 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:32.847 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-24T03:56:32.879 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:56:33.056 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2023-05-24T03:56:33.082 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-24T03:56:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-24T03:56:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:33.122 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-24T03:56:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:33.183 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-prettytable. 2023-05-24T03:56:33.210 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-24T03:56:33.212 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2023-05-24T03:56:33.238 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:33.250 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-24T03:56:33.288 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:33.332 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-24T03:56:33.359 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-24T03:56:33.399 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-24T03:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-24T03:56:33.477 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rbd. 2023-05-24T03:56:33.493 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-24T03:56:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-24T03:56:33.527 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:56:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:56:33.853 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-24T03:56:33.872 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-24T03:56:33.877 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-24T03:56:33.879 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-24T03:56:33.898 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-24T03:56:33.904 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:33.920 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:56:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librados2. 2023-05-24T03:56:33.938 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:56:33.961 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../011-librados2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:33.961 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:34.000 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-24T03:56:34.026 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-24T03:56:34.066 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:56:34.075 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:34.215 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-24T03:56:34.241 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-24T03:56:34.282 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:56:34.283 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2. 2023-05-24T03:56:34.297 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-24T03:56:34.310 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../021-librgw2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:34.312 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:34.327 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cheroot. 2023-05-24T03:56:34.343 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-24T03:56:34.347 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:34.349 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:34.377 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:56:34.495 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librbd1. 2023-05-24T03:56:34.522 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../012-librbd1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:34.553 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:34.610 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-24T03:56:34.636 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-24T03:56:34.676 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:56:34.683 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-24T03:56:34.708 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-24T03:56:34.710 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:34.732 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-24T03:56:34.750 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:34.772 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:56:34.852 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rgw. 2023-05-24T03:56:34.878 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:34.918 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:34.990 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs2. 2023-05-24T03:56:35.016 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:35.056 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:35.078 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-24T03:56:35.084 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-24T03:56:35.105 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-24T03:56:35.110 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-24T03:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-24T03:56:35.145 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:35.150 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:56:35.188 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-24T03:56:35.196 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:35.215 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-24T03:56:35.246 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:56:35.342 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rados. 2023-05-24T03:56:35.358 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:35.400 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:35.411 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-24T03:56:35.427 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-24T03:56:35.461 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:56:35.473 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librados2. 2023-05-24T03:56:35.499 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../011-librados2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:35.539 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:35.557 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1. 2023-05-24T03:56:35.558 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-24T03:56:35.584 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:35.584 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:35.624 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:35.625 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:35.720 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-24T03:56:35.747 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:35.756 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempora. 2023-05-24T03:56:35.782 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-24T03:56:35.786 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:35.823 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-24T03:56:35.977 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-24T03:56:35.984 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librbd1. 2023-05-24T03:56:36.003 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-24T03:56:36.010 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../012-librbd1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:36.014 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cephfs. 2023-05-24T03:56:36.030 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:36.044 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:56:36.050 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:36.072 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:36.119 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common. 2023-05-24T03:56:36.126 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-portend. 2023-05-24T03:56:36.146 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:36.152 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-24T03:56:36.185 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:36.192 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-24T03:56:36.392 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-24T03:56:36.419 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:36.458 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:36.470 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs2. 2023-05-24T03:56:36.497 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:36.536 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:36.612 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-24T03:56:36.639 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-24T03:56:36.664 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-24T03:56:36.670 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-24T03:56:36.690 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-24T03:56:36.728 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-prettytable. 2023-05-24T03:56:36.730 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:56:36.755 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-24T03:56:36.786 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-24T03:56:36.822 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rados. 2023-05-24T03:56:36.838 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:36.880 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:36.973 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-24T03:56:36.989 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-24T03:56:37.032 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:56:37.033 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librados2. 2023-05-24T03:56:37.055 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rbd. 2023-05-24T03:56:37.060 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../011-librados2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:37.082 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:37.091 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:37.122 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:37.200 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-24T03:56:37.227 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:37.267 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:37.352 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-natsort. 2023-05-24T03:56:37.379 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-24T03:56:37.436 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-24T03:56:37.475 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-24T03:56:37.494 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cephfs. 2023-05-24T03:56:37.501 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-24T03:56:37.520 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:37.524 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-base. 2023-05-24T03:56:37.536 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librbd1. 2023-05-24T03:56:37.541 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:56:37.551 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:37.552 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:37.562 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../012-librbd1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:37.592 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:37.602 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:38.340 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2023-05-24T03:56:38.366 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-24T03:56:38.406 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-24T03:56:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librgw2. 2023-05-24T03:56:38.480 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../021-librgw2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:38.511 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:38.622 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-24T03:56:38.649 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:38.689 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:38.689 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2023-05-24T03:56:38.701 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-24T03:56:38.715 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:38.727 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-24T03:56:38.755 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:38.767 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:56:39.017 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-prettytable. 2023-05-24T03:56:39.032 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2023-05-24T03:56:39.043 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-24T03:56:39.045 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-24T03:56:39.045 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2023-05-24T03:56:39.047 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:39.071 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-24T03:56:39.072 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-24T03:56:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-24T03:56:39.091 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:39.103 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:56:39.111 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:56:39.164 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rgw. 2023-05-24T03:56:39.191 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:39.230 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:39.353 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rbd. 2023-05-24T03:56:39.364 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cheroot. 2023-05-24T03:56:39.368 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-24T03:56:39.379 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-24T03:56:39.390 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-24T03:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:39.411 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:39.414 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:56:39.416 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-24T03:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:39.456 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:56:39.600 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-24T03:56:39.627 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-24T03:56:39.666 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:56:39.688 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2023-05-24T03:56:39.714 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-24T03:56:39.714 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:39.717 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-24T03:56:39.741 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-24T03:56:39.744 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-24T03:56:39.754 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:39.760 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-24T03:56:39.781 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:56:39.783 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:56:39.786 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-24T03:56:39.826 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:56:39.936 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libradosstriper1. 2023-05-24T03:56:39.963 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:40.019 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:40.024 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-24T03:56:40.039 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:40.073 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:40.087 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-24T03:56:40.108 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librgw2. 2023-05-24T03:56:40.114 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-24T03:56:40.135 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../021-librgw2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:40.137 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2023-05-24T03:56:40.153 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:56:40.164 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-24T03:56:40.175 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:40.204 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:56:40.343 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2023-05-24T03:56:40.370 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-24T03:56:40.401 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-24T03:56:40.456 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-24T03:56:40.464 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-common. 2023-05-24T03:56:40.482 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-24T03:56:40.491 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:40.531 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:40.539 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:56:40.549 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2023-05-24T03:56:40.575 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-24T03:56:40.619 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:56:40.654 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2023-05-24T03:56:40.680 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:40.694 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rgw. 2023-05-24T03:56:40.720 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:40.721 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:40.761 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:40.817 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempora. 2023-05-24T03:56:40.843 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-24T03:56:40.877 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2023-05-24T03:56:40.883 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-24T03:56:40.903 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-24T03:56:40.944 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:56:41.090 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-24T03:56:41.105 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-24T03:56:41.116 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-24T03:56:41.132 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-24T03:56:41.157 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:56:41.161 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-portend. 2023-05-24T03:56:41.163 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:56:41.187 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-24T03:56:41.227 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-24T03:56:41.246 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2023-05-24T03:56:41.273 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-24T03:56:41.313 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:56:41.466 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libradosstriper1. 2023-05-24T03:56:41.485 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2023-05-24T03:56:41.493 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:41.511 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../021-librgw2_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:41.530 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-24T03:56:41.533 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:41.551 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:41.557 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-24T03:56:41.596 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-24T03:56:41.708 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-24T03:56:41.723 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-24T03:56:41.766 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:56:41.900 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-24T03:56:41.920 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-base. 2023-05-24T03:56:41.927 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-24T03:56:41.947 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:41.966 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:56:41.987 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-common. 2023-05-24T03:56:42.004 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:42.013 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:42.028 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2023-05-24T03:56:42.044 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:42.053 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:42.069 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-24T03:56:42.079 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:42.096 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-24T03:56:42.136 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:56:42.320 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-natsort. 2023-05-24T03:56:42.347 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-24T03:56:42.386 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-24T03:56:42.417 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-24T03:56:42.422 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2023-05-24T03:56:42.443 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-24T03:56:42.449 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-24T03:56:42.483 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:56:42.489 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-24T03:56:42.689 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-logutils. 2023-05-24T03:56:42.716 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-24T03:56:42.743 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-24T03:56:42.755 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-24T03:56:42.773 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-24T03:56:42.775 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2023-05-24T03:56:42.790 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-24T03:56:42.794 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2023-05-24T03:56:42.809 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:56:42.821 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:42.825 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:56:42.860 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:42.992 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-24T03:56:43.008 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-24T03:56:43.042 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:56:43.112 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cheroot. 2023-05-24T03:56:43.139 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-24T03:56:43.164 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-certifi. 2023-05-24T03:56:43.179 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:56:43.180 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2023-05-24T03:56:43.190 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-24T03:56:43.207 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:43.222 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-24T03:56:43.238 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-base. 2023-05-24T03:56:43.285 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:43.334 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:43.478 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-mako. 2023-05-24T03:56:43.504 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-24T03:56:43.515 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-24T03:56:43.536 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:56:43.542 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-idna. 2023-05-24T03:56:43.542 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-24T03:56:43.568 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-24T03:56:43.582 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:56:43.608 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-24T03:56:43.831 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-24T03:56:43.851 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-24T03:56:43.857 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-24T03:56:43.878 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-24T03:56:43.889 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:56:43.911 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-urllib3. 2023-05-24T03:56:43.918 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:56:43.938 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-24T03:56:43.978 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:56:44.146 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-24T03:56:44.173 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-24T03:56:44.183 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-24T03:56:44.204 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:56:44.210 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-24T03:56:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-24T03:56:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-24T03:56:44.250 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:56:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:56:44.315 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests. 2023-05-24T03:56:44.341 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-24T03:56:44.381 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:56:44.452 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2023-05-24T03:56:44.478 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:44.491 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cheroot. 2023-05-24T03:56:44.518 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-24T03:56:44.528 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:44.558 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:56:44.569 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webob. 2023-05-24T03:56:44.596 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-24T03:56:44.636 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:56:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-24T03:56:44.702 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-24T03:56:44.742 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:56:44.774 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempora. 2023-05-24T03:56:44.801 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-24T03:56:44.840 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-24T03:56:44.877 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-24T03:56:44.904 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-24T03:56:44.944 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:56:44.989 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-waitress. 2023-05-24T03:56:45.015 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-24T03:56:45.029 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-24T03:56:45.055 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:45.059 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:56:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:45.143 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-portend. 2023-05-24T03:56:45.171 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-24T03:56:45.218 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-24T03:56:45.239 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-24T03:56:45.246 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-24T03:56:45.265 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-24T03:56:45.273 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-24T03:56:45.306 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:56:45.313 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:56:45.392 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempita. 2023-05-24T03:56:45.419 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-24T03:56:45.458 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:56:45.484 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-24T03:56:45.488 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-24T03:56:45.504 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-24T03:56:45.511 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:45.538 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-24T03:56:45.551 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:45.591 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-24T03:56:45.617 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cheroot. 2023-05-24T03:56:45.617 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-24T03:56:45.643 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-24T03:56:45.649 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:56:45.684 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:56:45.727 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-paste. 2023-05-24T03:56:45.743 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-24T03:56:45.777 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:56:45.841 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-24T03:56:45.868 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-24T03:56:45.887 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2023-05-24T03:56:45.907 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:56:45.913 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-24T03:56:45.944 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempora. 2023-05-24T03:56:45.953 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-24T03:56:45.970 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-24T03:56:45.986 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-24T03:56:46.010 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-24T03:56:46.013 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-24T03:56:46.053 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:56:46.089 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-24T03:56:46.105 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-24T03:56:46.147 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:56:46.236 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-natsort. 2023-05-24T03:56:46.263 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-24T03:56:46.265 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2023-05-24T03:56:46.292 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:46.294 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-24T03:56:46.313 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-portend. 2023-05-24T03:56:46.314 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-24T03:56:46.329 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-24T03:56:46.331 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:46.340 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-24T03:56:46.363 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:56:46.380 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-24T03:56:46.425 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-24T03:56:46.452 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-24T03:56:46.483 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:56:46.580 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-logutils. 2023-05-24T03:56:46.608 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-24T03:56:46.647 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-24T03:56:46.658 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-24T03:56:46.684 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-24T03:56:46.716 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-24T03:56:46.718 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2023-05-24T03:56:46.745 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:46.752 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webtest. 2023-05-24T03:56:46.769 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-24T03:56:46.785 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:46.811 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-24T03:56:46.821 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-24T03:56:46.847 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-24T03:56:46.916 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:56:46.950 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-24T03:56:46.977 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-24T03:56:46.986 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-24T03:56:47.012 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-24T03:56:47.017 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:56:47.052 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:56:47.114 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pecan. 2023-05-24T03:56:47.141 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-24T03:56:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:56:47.203 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempora. 2023-05-24T03:56:47.229 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-24T03:56:47.269 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-24T03:56:47.345 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-mako. 2023-05-24T03:56:47.372 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-24T03:56:47.381 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-natsort. 2023-05-24T03:56:47.396 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-24T03:56:47.411 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:56:47.431 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-24T03:56:47.552 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-certifi. 2023-05-24T03:56:47.572 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-portend. 2023-05-24T03:56:47.579 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-24T03:56:47.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-24T03:56:47.618 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-24T03:56:47.638 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-24T03:56:47.655 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2023-05-24T03:56:47.681 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:47.692 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-logutils. 2023-05-24T03:56:47.707 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-24T03:56:47.714 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-24T03:56:47.721 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:47.741 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-24T03:56:47.742 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-24T03:56:47.773 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:56:47.912 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-idna. 2023-05-24T03:56:47.925 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-24T03:56:47.940 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-24T03:56:47.951 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-24T03:56:47.970 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-24T03:56:47.991 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-24T03:56:48.025 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-24T03:56:48.029 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-24T03:56:48.052 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-24T03:56:48.055 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-24T03:56:48.092 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:56:48.095 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:56:48.294 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-24T03:56:48.298 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-urllib3. 2023-05-24T03:56:48.320 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-24T03:56:48.326 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-24T03:56:48.360 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:56:48.364 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:56:48.395 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webob. 2023-05-24T03:56:48.406 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-mako. 2023-05-24T03:56:48.421 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-24T03:56:48.432 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-24T03:56:48.461 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:56:48.472 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:56:48.676 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests. 2023-05-24T03:56:48.704 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-24T03:56:48.714 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-natsort. 2023-05-24T03:56:48.740 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-24T03:56:48.743 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:56:48.797 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-24T03:56:48.801 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-24T03:56:48.806 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-waitress. 2023-05-24T03:56:48.827 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-24T03:56:48.833 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-24T03:56:48.867 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:56:48.876 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:56:49.054 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-24T03:56:49.081 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-24T03:56:49.116 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2023-05-24T03:56:49.120 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:56:49.143 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-24T03:56:49.150 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempita. 2023-05-24T03:56:49.167 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-24T03:56:49.183 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-24T03:56:49.200 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:56:49.312 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-24T03:56:49.340 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-24T03:56:49.370 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:56:49.407 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-24T03:56:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:49.486 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-24T03:56:49.486 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-paste. 2023-05-24T03:56:49.512 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-24T03:56:49.513 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-24T03:56:49.541 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2023-05-24T03:56:49.543 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:56:49.553 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:56:49.557 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../061-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:49.600 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:49.665 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webob. 2023-05-24T03:56:49.691 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-24T03:56:49.731 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:56:49.812 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-24T03:56:49.822 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2023-05-24T03:56:49.838 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:49.848 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-24T03:56:49.849 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-24T03:56:49.864 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-24T03:56:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:49.888 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:56:49.898 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:56:49.944 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2023-05-24T03:56:49.971 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:50.011 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:50.068 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-waitress. 2023-05-24T03:56:50.095 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-24T03:56:50.137 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:56:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-24T03:56:50.156 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-openssl. 2023-05-24T03:56:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-24T03:56:50.183 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-24T03:56:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:56:50.222 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-24T03:56:50.225 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-24T03:56:50.251 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-24T03:56:50.291 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:56:50.331 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2023-05-24T03:56:50.347 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:50.381 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:50.404 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempita. 2023-05-24T03:56:50.419 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-24T03:56:50.454 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:56:50.520 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webtest. 2023-05-24T03:56:50.547 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-24T03:56:50.575 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr. 2023-05-24T03:56:50.587 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-24T03:56:50.594 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-24T03:56:50.602 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:50.620 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-24T03:56:50.641 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:50.660 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:56:50.765 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-paste. 2023-05-24T03:56:50.776 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2023-05-24T03:56:50.791 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-24T03:56:50.803 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../064-cephadm_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:56:50.843 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:50.881 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pecan. 2023-05-24T03:56:50.908 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-24T03:56:50.948 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:56:50.963 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2023-05-24T03:56:50.989 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-24T03:56:51.029 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:56:51.036 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon. 2023-05-24T03:56:51.064 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:51.103 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:51.154 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-24T03:56:51.159 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-24T03:56:51.175 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-24T03:56:51.181 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-24T03:56:51.218 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:56:51.220 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-24T03:56:51.345 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-certifi. 2023-05-24T03:56:51.372 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-24T03:56:51.383 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2023-05-24T03:56:51.409 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-24T03:56:51.411 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-24T03:56:51.444 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:56:51.521 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-24T03:56:51.548 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-24T03:56:51.557 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-24T03:56:51.574 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:56:51.587 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:56:51.615 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:56:51.710 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2023-05-24T03:56:51.736 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-24T03:56:51.776 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:56:51.789 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-idna. 2023-05-24T03:56:51.816 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-24T03:56:51.857 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webtest. 2023-05-24T03:56:51.864 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-24T03:56:51.884 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-24T03:56:51.915 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-24T03:56:52.079 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2023-05-24T03:56:52.106 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-24T03:56:52.145 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:56:52.156 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd. 2023-05-24T03:56:52.183 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:52.201 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-urllib3. 2023-05-24T03:56:52.210 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pecan. 2023-05-24T03:56:52.222 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:52.227 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-24T03:56:52.237 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-24T03:56:52.267 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:56:52.276 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:56:52.457 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-24T03:56:52.472 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-24T03:56:52.515 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:56:52.587 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests. 2023-05-24T03:56:52.614 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-24T03:56:52.631 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-certifi. 2023-05-24T03:56:52.653 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:56:52.658 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-24T03:56:52.698 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-24T03:56:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-babel. 2023-05-24T03:56:52.751 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-24T03:56:52.756 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:56:52.777 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-24T03:56:52.795 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:56:52.809 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:56:52.965 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-24T03:56:52.992 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-24T03:56:53.031 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:56:53.034 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-idna. 2023-05-24T03:56:53.061 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-24T03:56:53.099 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2023-05-24T03:56:53.101 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-24T03:56:53.112 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2023-05-24T03:56:53.125 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-24T03:56:53.138 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-24T03:56:53.165 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-24T03:56:53.179 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-24T03:56:53.334 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-24T03:56:53.362 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:53.379 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-urllib3. 2023-05-24T03:56:53.395 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-24T03:56:53.401 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:53.429 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:56:53.498 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2023-05-24T03:56:53.515 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-24T03:56:53.519 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-24T03:56:53.546 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:53.556 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:56:53.594 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:53.690 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests. 2023-05-24T03:56:53.717 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-24T03:56:53.748 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:56:53.764 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-24T03:56:53.792 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:53.822 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:53.919 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-certifi. 2023-05-24T03:56:53.922 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-24T03:56:53.948 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-24T03:56:53.950 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-24T03:56:53.986 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-24T03:56:53.989 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:56:54.035 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-24T03:56:54.062 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-24T03:56:54.117 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-openssl. 2023-05-24T03:56:54.144 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-24T03:56:54.184 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-24T03:56:54.193 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph. 2023-05-24T03:56:54.201 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:56:54.209 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../061-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:54.242 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:54.267 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-24T03:56:54.294 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-24T03:56:54.313 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-idna. 2023-05-24T03:56:54.340 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-24T03:56:54.350 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-24T03:56:54.380 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-24T03:56:54.487 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse. 2023-05-24T03:56:54.496 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-24T03:56:54.503 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:54.512 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:54.520 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr. 2023-05-24T03:56:54.537 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:54.546 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:54.547 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:54.587 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:54.637 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2023-05-24T03:56:54.663 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-24T03:56:54.666 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-urllib3. 2023-05-24T03:56:54.693 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-24T03:56:54.695 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:56:54.724 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:56:54.909 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-24T03:56:54.915 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds. 2023-05-24T03:56:54.936 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:54.942 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:54.976 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:54.981 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:55.007 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mon. 2023-05-24T03:56:55.015 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-24T03:56:55.019 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests. 2023-05-24T03:56:55.034 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:55.042 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:55.046 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-24T03:56:55.073 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:55.077 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:56:55.082 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:55.262 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-openssl. 2023-05-24T03:56:55.289 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-24T03:56:55.320 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-24T03:56:55.385 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephadm. 2023-05-24T03:56:55.388 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-24T03:56:55.412 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../064-cephadm_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:55.415 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-24T03:56:55.451 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:55.455 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:56:55.496 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-24T03:56:55.523 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-24T03:56:55.562 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:56:55.657 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr. 2023-05-24T03:56:55.684 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:55.703 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-24T03:56:55.720 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-24T03:56:55.723 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:55.753 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-24T03:56:55.758 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-24T03:56:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:55.824 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:55.985 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-osd. 2023-05-24T03:56:56.013 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:56.051 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:56.064 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-24T03:56:56.081 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:56:56.083 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2023-05-24T03:56:56.110 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-24T03:56:56.123 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:56:56.149 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:56:56.152 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mon. 2023-05-24T03:56:56.179 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:56.196 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-24T03:56:56.218 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:56.222 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:56.262 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:56.478 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-24T03:56:56.505 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-24T03:56:56.545 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:56:56.590 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2023-05-24T03:56:56.616 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-24T03:56:56.656 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-24T03:56:56.848 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2023-05-24T03:56:56.874 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-24T03:56:56.914 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:56:57.009 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2023-05-24T03:56:57.036 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:57.075 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:57.089 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-osd. 2023-05-24T03:56:57.115 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:57.147 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:57.186 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-babel. 2023-05-24T03:56:57.214 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:56:57.252 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:56:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jinja2. 2023-05-24T03:56:57.581 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-24T03:56:57.595 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2023-05-24T03:56:57.597 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-24T03:56:57.622 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:57.640 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-24T03:56:57.661 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:58.009 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-24T03:56:58.036 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:58.075 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:58.105 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph. 2023-05-24T03:56:58.121 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../061-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:58.163 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:58.412 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-24T03:56:58.439 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-24T03:56:58.458 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-fuse. 2023-05-24T03:56:58.478 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:56:58.485 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:58.516 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:58.577 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2023-05-24T03:56:58.603 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-24T03:56:58.643 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-24T03:56:58.715 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2023-05-24T03:56:58.742 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:58.781 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:58.881 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-24T03:56:58.903 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mds. 2023-05-24T03:56:58.909 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-24T03:56:58.930 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:58.948 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-24T03:56:58.969 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:58.983 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph. 2023-05-24T03:56:59.010 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../061-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:59.050 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:59.080 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-24T03:56:59.106 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-24T03:56:59.146 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:56:59.253 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-routes. 2023-05-24T03:56:59.280 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-24T03:56:59.319 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:56:59.356 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephadm. 2023-05-24T03:56:59.378 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-fuse. 2023-05-24T03:56:59.383 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../064-cephadm_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:59.404 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:59.422 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:59.444 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:59.475 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-24T03:56:59.501 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-24T03:56:59.541 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:56:59.631 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-24T03:56:59.658 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:56:59.697 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:59.717 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-24T03:56:59.744 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-24T03:56:59.775 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-24T03:56:59.797 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mds. 2023-05-24T03:56:59.824 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:56:59.856 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:56:59.861 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2023-05-24T03:56:59.888 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-24T03:56:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-24T03:57:00.092 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-24T03:57:00.109 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-24T03:57:00.142 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:00.228 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-24T03:57:00.242 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephadm. 2023-05-24T03:57:00.255 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:57:00.269 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../064-cephadm_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:00.308 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:00.311 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:00.333 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2023-05-24T03:57:00.360 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-24T03:57:00.399 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:00.543 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2023-05-24T03:57:00.570 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../061-ceph_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:00.609 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:00.637 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-24T03:57:00.638 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-joblib. 2023-05-24T03:57:00.664 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-24T03:57:00.665 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-24T03:57:00.703 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:00.704 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:00.711 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-24T03:57:00.739 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-24T03:57:00.778 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:00.904 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2023-05-24T03:57:00.930 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:00.970 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:01.014 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-24T03:57:01.041 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:57:01.081 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:01.083 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-24T03:57:01.089 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2023-05-24T03:57:01.110 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-24T03:57:01.116 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-24T03:57:01.141 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:01.156 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-24T03:57:01.333 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-babel. 2023-05-24T03:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2023-05-24T03:57:01.361 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:01.400 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:01.406 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:01.419 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn. 2023-05-24T03:57:01.446 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-24T03:57:01.467 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-24T03:57:01.485 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:01.494 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-24T03:57:01.534 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:01.719 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jinja2. 2023-05-24T03:57:01.747 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-24T03:57:01.776 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2023-05-24T03:57:01.786 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:01.791 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../064-cephadm_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:01.826 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:02.095 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-babel. 2023-05-24T03:57:02.104 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-24T03:57:02.122 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:57:02.130 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-24T03:57:02.139 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-24T03:57:02.161 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:02.167 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:02.170 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:02.206 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:02.227 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-24T03:57:02.256 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:02.294 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:02.457 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-24T03:57:02.464 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-24T03:57:02.480 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:57:02.481 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:02.489 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jinja2. 2023-05-24T03:57:02.514 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:02.515 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:02.516 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-24T03:57:02.556 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:02.577 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-24T03:57:02.605 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-24T03:57:02.652 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:02.801 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-24T03:57:02.828 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-24T03:57:02.859 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:02.892 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-24T03:57:02.919 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:02.954 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-24T03:57:02.959 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:02.981 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-24T03:57:03.020 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:03.171 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-24T03:57:03.197 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cachetools. 2023-05-24T03:57:03.198 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:03.214 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-24T03:57:03.238 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:03.255 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:03.273 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-routes. 2023-05-24T03:57:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-24T03:57:03.329 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-24T03:57:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:03.356 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-24T03:57:03.396 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:03.486 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-babel. 2023-05-24T03:57:03.498 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2023-05-24T03:57:03.513 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-24T03:57:03.514 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:03.541 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-24T03:57:03.552 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:03.557 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:03.569 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-24T03:57:03.608 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:03.635 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-24T03:57:03.663 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:03.699 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-24T03:57:03.701 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:03.725 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-24T03:57:03.765 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:03.784 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2023-05-24T03:57:03.800 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-24T03:57:03.834 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:03.872 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jinja2. 2023-05-24T03:57:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-24T03:57:03.938 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:03.953 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-24T03:57:03.980 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-24T03:57:04.019 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:04.060 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-routes. 2023-05-24T03:57:04.087 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-24T03:57:04.105 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2023-05-24T03:57:04.126 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:04.130 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-24T03:57:04.132 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-24T03:57:04.146 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-24T03:57:04.172 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:04.292 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-24T03:57:04.319 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:04.358 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:04.492 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2023-05-24T03:57:04.497 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rsa. 2023-05-24T03:57:04.508 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:04.525 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-24T03:57:04.550 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:04.563 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-24T03:57:04.632 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-24T03:57:04.659 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:04.667 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-joblib. 2023-05-24T03:57:04.678 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-24T03:57:04.691 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-24T03:57:04.694 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-24T03:57:04.698 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:04.725 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:04.736 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:04.935 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-google-auth. 2023-05-24T03:57:04.963 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-24T03:57:05.002 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:05.048 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-24T03:57:05.075 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-24T03:57:05.087 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-24T03:57:05.114 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:05.115 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-24T03:57:05.135 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-24T03:57:05.151 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-24T03:57:05.179 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:05.193 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:05.322 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-24T03:57:05.350 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-24T03:57:05.388 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:05.409 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2023-05-24T03:57:05.435 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-24T03:57:05.465 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn. 2023-05-24T03:57:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:05.492 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-24T03:57:05.531 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:05.697 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-joblib. 2023-05-24T03:57:05.700 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-websocket. 2023-05-24T03:57:05.712 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-24T03:57:05.727 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-24T03:57:05.747 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:05.766 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-24T03:57:05.795 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-24T03:57:05.821 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:05.861 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:06.103 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-24T03:57:06.108 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-24T03:57:06.130 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-24T03:57:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-24T03:57:06.169 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:06.175 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:06.216 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-24T03:57:06.244 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:06.282 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:06.290 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-24T03:57:06.316 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-24T03:57:06.356 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:06.446 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-volume. 2023-05-24T03:57:06.474 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:06.478 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn. 2023-05-24T03:57:06.505 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-24T03:57:06.513 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:06.544 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:06.783 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-24T03:57:06.800 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:06.835 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2023-05-24T03:57:06.841 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:06.859 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-24T03:57:06.861 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-24T03:57:06.876 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:06.893 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:06.917 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:07.161 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-24T03:57:07.179 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-colorama. 2023-05-24T03:57:07.188 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-24T03:57:07.195 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-24T03:57:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:07.235 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cachetools. 2023-05-24T03:57:07.237 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-24T03:57:07.251 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-24T03:57:07.254 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-24T03:57:07.278 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-24T03:57:07.281 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-24T03:57:07.285 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:07.306 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:07.321 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:07.344 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:07.515 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-shell. 2023-05-24T03:57:07.542 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:07.546 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-24T03:57:07.564 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-24T03:57:07.574 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-24T03:57:07.581 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:07.591 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:07.613 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:07.630 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:07.815 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2023-05-24T03:57:07.826 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-top. 2023-05-24T03:57:07.842 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:07.842 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-24T03:57:07.866 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package jq. 2023-05-24T03:57:07.882 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:07.883 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:07.884 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:07.924 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:07.949 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-24T03:57:07.977 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-24T03:57:08.015 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:08.137 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-24T03:57:08.153 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:08.177 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package socat. 2023-05-24T03:57:08.193 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-24T03:57:08.195 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:08.235 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:08.314 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cachetools. 2023-05-24T03:57:08.327 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rsa. 2023-05-24T03:57:08.341 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-24T03:57:08.355 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-24T03:57:08.381 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:08.393 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-24T03:57:08.538 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package xmlstarlet. 2023-05-24T03:57:08.555 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-24T03:57:08.573 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-24T03:57:08.582 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2023-05-24T03:57:08.596 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:08.601 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:08.609 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-24T03:57:08.640 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:08.648 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:08.667 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-24T03:57:08.694 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-24T03:57:08.733 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:08.799 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-google-auth. 2023-05-24T03:57:08.827 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-24T03:57:08.865 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:08.967 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test. 2023-05-24T03:57:08.984 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:08.995 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-24T03:57:09.012 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-24T03:57:09.025 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:09.045 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-24T03:57:09.053 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:09.071 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-24T03:57:09.111 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:09.144 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-24T03:57:09.160 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-24T03:57:09.194 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:09.397 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rsa. 2023-05-24T03:57:09.424 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-24T03:57:09.455 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-24T03:57:09.465 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-24T03:57:09.472 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-websocket. 2023-05-24T03:57:09.493 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-24T03:57:09.499 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-24T03:57:09.531 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:09.538 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-24T03:57:09.585 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2023-05-24T03:57:09.612 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-24T03:57:09.651 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:09.834 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2023-05-24T03:57:09.858 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-24T03:57:09.861 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-24T03:57:09.869 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-google-auth. 2023-05-24T03:57:09.886 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-24T03:57:09.896 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-24T03:57:09.901 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:09.933 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:09.935 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:09.970 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-24T03:57:09.998 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-24T03:57:10.037 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:10.221 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2023-05-24T03:57:10.249 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-24T03:57:10.256 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-24T03:57:10.283 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-24T03:57:10.288 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:10.322 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:10.356 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-24T03:57:10.383 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-24T03:57:10.414 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:10.558 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2023-05-24T03:57:10.585 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-24T03:57:10.616 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:10.625 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-websocket. 2023-05-24T03:57:10.652 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-24T03:57:10.655 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-24T03:57:10.672 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:10.684 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2023-05-24T03:57:10.691 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-24T03:57:10.711 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-24T03:57:10.730 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:10.742 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-24T03:57:10.952 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2023-05-24T03:57:10.979 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-24T03:57:10.986 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-24T03:57:11.013 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-24T03:57:11.027 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-24T03:57:11.044 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:11.050 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-24T03:57:11.077 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-24T03:57:11.096 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-volume. 2023-05-24T03:57:11.113 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:11.116 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:11.147 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2023-05-24T03:57:11.154 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:11.174 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-24T03:57:11.213 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:11.356 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pygments. 2023-05-24T03:57:11.383 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-24T03:57:11.411 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-24T03:57:11.413 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:11.439 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:11.469 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:11.509 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-24T03:57:11.525 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:11.534 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-24T03:57:11.561 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-24T03:57:11.567 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:11.592 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:11.730 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package jq. 2023-05-24T03:57:11.733 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-24T03:57:11.749 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:11.758 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:11.797 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:11.843 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-24T03:57:11.870 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-colorama. 2023-05-24T03:57:11.871 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-24T03:57:11.886 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2023-05-24T03:57:11.898 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-24T03:57:11.909 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:11.913 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-24T03:57:11.916 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:11.928 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-24T03:57:11.952 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-24T03:57:12.050 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package socat. 2023-05-24T03:57:12.066 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-24T03:57:12.108 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:12.164 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-shell. 2023-05-24T03:57:12.181 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:12.214 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:12.219 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-24T03:57:12.229 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-toml. 2023-05-24T03:57:12.246 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-24T03:57:12.256 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-24T03:57:12.272 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-24T03:57:12.286 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:12.295 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-24T03:57:12.300 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-24T03:57:12.339 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:12.403 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package xmlstarlet. 2023-05-24T03:57:12.431 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-24T03:57:12.467 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-top. 2023-05-24T03:57:12.469 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:12.495 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:12.533 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:12.590 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2023-05-24T03:57:12.617 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-24T03:57:12.639 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-24T03:57:12.656 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:12.666 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:12.705 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:12.786 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-24T03:57:12.814 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:12.841 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-test. 2023-05-24T03:57:12.852 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:12.868 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:12.907 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:12.975 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package jq. 2023-05-24T03:57:12.985 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplejson. 2023-05-24T03:57:12.990 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:13.016 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-24T03:57:13.019 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-24T03:57:13.034 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:13.035 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:13.052 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:13.077 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:13.248 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package nvme-cli. 2023-05-24T03:57:13.269 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package socat. 2023-05-24T03:57:13.275 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-24T03:57:13.284 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-24T03:57:13.314 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:13.318 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:13.329 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-24T03:57:13.345 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-24T03:57:13.363 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-24T03:57:13.388 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:13.390 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-24T03:57:13.430 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:13.614 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package xmlstarlet. 2023-05-24T03:57:13.630 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-24T03:57:13.644 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-24T03:57:13.664 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:13.672 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-24T03:57:13.710 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:13.795 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-24T03:57:13.823 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:13.866 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:14.051 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-test. 2023-05-24T03:57:14.079 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:14.117 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:14.126 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2023-05-24T03:57:14.139 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-24T03:57:14.142 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-24T03:57:14.150 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2023-05-24T03:57:14.167 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-24T03:57:14.179 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../113-radosgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:14.185 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:14.205 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:14.216 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:14.437 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2023-05-24T03:57:14.449 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastescript. 2023-05-24T03:57:14.453 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-24T03:57:14.466 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-24T03:57:14.487 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:14.508 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:14.765 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2023-05-24T03:57:14.781 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-24T03:57:14.823 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:14.953 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2023-05-24T03:57:14.981 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:15.019 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-volume. 2023-05-24T03:57:15.020 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:15.035 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:15.036 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pluggy. 2023-05-24T03:57:15.064 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-24T03:57:15.077 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:15.102 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:15.169 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2023-05-24T03:57:15.185 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:15.227 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:15.332 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:15.380 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-psutil. 2023-05-24T03:57:15.408 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-24T03:57:15.438 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:15.591 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:57:15.641 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-24T03:57:15.668 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:15.707 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:15.718 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:15.808 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-py. 2023-05-24T03:57:15.836 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-24T03:57:15.883 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-24T03:57:15.986 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-24T03:57:16.027 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-colorama. 2023-05-24T03:57:16.055 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-24T03:57:16.093 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-24T03:57:16.113 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-volume. 2023-05-24T03:57:16.129 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:16.163 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:16.186 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pygments. 2023-05-24T03:57:16.203 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-24T03:57:16.244 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:16.314 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-24T03:57:16.354 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-shell. 2023-05-24T03:57:16.382 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:16.421 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:16.509 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-24T03:57:16.525 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:16.567 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:16.640 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-top. 2023-05-24T03:57:16.668 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:16.698 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-24T03:57:16.744 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-24T03:57:16.782 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:16.794 INFO:teuthology.orchestra.run.smithi162.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-24T03:57:16.853 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-colorama. 2023-05-24T03:57:16.881 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-24T03:57:16.903 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:16.911 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-24T03:57:16.960 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-24T03:57:16.987 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:17.026 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:17.093 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-toml. 2023-05-24T03:57:17.106 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-volume. 2023-05-24T03:57:17.114 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephfs-shell. 2023-05-24T03:57:17.119 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:17.121 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-24T03:57:17.127 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:17.155 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:17.159 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-24T03:57:17.172 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:17.388 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package nvme-cli. 2023-05-24T03:57:17.415 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-24T03:57:17.442 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephfs-top. 2023-05-24T03:57:17.452 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-24T03:57:17.454 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:17.457 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:17.462 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pytest. 2023-05-24T03:57:17.468 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:17.479 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2023-05-24T03:57:17.490 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-24T03:57:17.500 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:17.510 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:17.528 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:17.769 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-24T03:57:17.785 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:17.796 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2023-05-24T03:57:17.809 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-24T03:57:17.824 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-24T03:57:17.827 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:17.837 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-24T03:57:17.854 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-24T03:57:17.876 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:17.892 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:57:17.907 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplejson. 2023-05-24T03:57:17.935 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-24T03:57:17.973 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:18.161 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:57:18.172 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package nvme-cli. 2023-05-24T03:57:18.200 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-24T03:57:18.231 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:18.243 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-24T03:57:18.259 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-24T03:57:18.296 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-24T03:57:18.298 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2023-05-24T03:57:18.301 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:18.314 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:18.324 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-24T03:57:18.356 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:18.362 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:18.412 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:18.538 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:57:18.544 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-24T03:57:18.571 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-24T03:57:18.602 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:18.617 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-top. 2023-05-24T03:57:18.633 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4167-gfa0e62c4-1jammy_all.deb ... 2023-05-24T03:57:18.665 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastescript. 2023-05-24T03:57:18.675 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:18.693 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-24T03:57:18.731 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:18.781 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:18.928 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-24T03:57:18.944 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:18.980 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-24T03:57:18.986 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:18.996 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-24T03:57:19.030 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:19.040 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:57:19.055 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw. 2023-05-24T03:57:19.060 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pluggy. 2023-05-24T03:57:19.083 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../113-radosgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:19.088 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-24T03:57:19.121 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:19.126 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:19.158 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-24T03:57:19.298 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package nvme-cli. 2023-05-24T03:57:19.314 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-24T03:57:19.324 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastescript. 2023-05-24T03:57:19.347 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:19.352 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-24T03:57:19.391 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:19.396 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-psutil. 2023-05-24T03:57:19.424 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-24T03:57:19.454 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:19.469 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:19.694 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-24T03:57:19.710 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-24T03:57:19.710 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pluggy. 2023-05-24T03:57:19.739 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-24T03:57:19.752 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:19.777 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:19.807 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-py. 2023-05-24T03:57:19.824 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-24T03:57:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse. 2023-05-24T03:57:19.845 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:19.857 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-24T03:57:19.857 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:19.899 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:20.072 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-psutil. 2023-05-24T03:57:20.079 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-24T03:57:20.088 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-24T03:57:20.121 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:20.137 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pygments. 2023-05-24T03:57:20.154 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-24T03:57:20.172 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-24T03:57:20.195 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:20.199 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-24T03:57:20.221 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:20.238 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:20.339 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-24T03:57:20.483 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-py. 2023-05-24T03:57:20.511 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-24T03:57:20.540 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2023-05-24T03:57:20.554 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:57:20.557 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-24T03:57:20.568 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-24T03:57:20.607 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:20.607 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:20.689 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:20.750 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-24T03:57:20.778 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-24T03:57:20.824 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:20.850 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:20.852 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pygments. 2023-05-24T03:57:20.880 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-24T03:57:20.919 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:20.929 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2023-05-24T03:57:20.948 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-24T03:57:20.957 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-24T03:57:21.003 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:21.101 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:21.135 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-toml. 2023-05-24T03:57:21.164 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-24T03:57:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-24T03:57:21.276 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-24T03:57:21.281 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2023-05-24T03:57:21.309 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-24T03:57:21.348 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:21.357 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-24T03:57:21.384 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-24T03:57:21.414 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:21.427 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:21.505 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pytest. 2023-05-24T03:57:21.533 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-24T03:57:21.571 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:21.679 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:21.693 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2023-05-24T03:57:21.720 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-24T03:57:21.726 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-toml. 2023-05-24T03:57:21.753 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-24T03:57:21.767 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-24T03:57:21.780 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-24T03:57:21.792 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-24T03:57:21.796 INFO:teuthology.orchestra.run.smithi067.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-24T03:57:21.891 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:21.925 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplejson. 2023-05-24T03:57:21.953 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-24T03:57:21.991 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:22.014 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:57:22.095 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pytest. 2023-05-24T03:57:22.112 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pygments. 2023-05-24T03:57:22.123 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-24T03:57:22.140 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-24T03:57:22.161 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:22.178 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:22.265 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:57:22.294 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-24T03:57:22.311 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-24T03:57:22.352 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:22.391 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:22.443 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user cephadm....done 2023-05-24T03:57:22.490 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplejson. 2023-05-24T03:57:22.517 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-24T03:57:22.556 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:22.563 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:57:22.607 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-24T03:57:22.635 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-24T03:57:22.673 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:22.767 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:22.825 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-24T03:57:22.840 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:57:22.841 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-24T03:57:22.884 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:22.893 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-24T03:57:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-toml. 2023-05-24T03:57:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-24T03:57:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-24T03:57:23.056 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package radosgw. 2023-05-24T03:57:23.074 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:23.085 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../113-radosgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:23.114 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:23.178 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:23.200 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:57:23.346 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2023-05-24T03:57:23.374 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-24T03:57:23.412 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:23.429 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:23.460 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:23.554 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package radosgw. 2023-05-24T03:57:23.583 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../113-radosgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:23.620 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:57:23.739 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:23.757 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplejson. 2023-05-24T03:57:23.785 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-24T03:57:23.823 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:23.871 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-24T03:57:23.958 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package rbd-fuse. 2023-05-24T03:57:23.975 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:24.017 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:24.134 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-24T03:57:24.162 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-24T03:57:24.197 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:24.201 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:24.339 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:24.357 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package rbd-fuse. 2023-05-24T03:57:24.383 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:57:24.384 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:24.423 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:24.541 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:24.580 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:57:24.675 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:57:24.706 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:24.736 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:24.784 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-24T03:57:24.810 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:24.936 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:57:24.963 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2023-05-24T03:57:24.972 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-24T03:57:24.991 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../113-radosgw_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:25.011 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:57:25.029 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:25.043 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-24T03:57:25.137 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:25.220 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:25.324 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-24T03:57:25.371 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-24T03:57:25.444 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:25.630 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-24T03:57:25.715 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-24T03:57:25.741 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2023-05-24T03:57:25.754 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4167-gfa0e62c4-1jammy_amd64.deb ... 2023-05-24T03:57:25.755 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:25.790 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:25.814 INFO:teuthology.orchestra.run.smithi040.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-24T03:57:25.873 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:57:25.933 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:26.013 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:26.077 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-24T03:57:26.152 INFO:teuthology.orchestra.run.smithi121.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-24T03:57:26.239 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:26.241 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:57:26.248 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:26.337 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-24T03:57:26.460 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user cephadm....done 2023-05-24T03:57:26.463 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-24T03:57:26.499 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:26.543 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-24T03:57:26.581 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:57:26.625 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-24T03:57:26.717 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-24T03:57:26.774 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user cephadm....done 2023-05-24T03:57:26.843 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:57:26.884 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:57:26.929 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:57:26.932 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:57:27.076 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-24T03:57:27.135 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:57:27.175 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:27.180 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:57:27.187 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:57:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:57:27.431 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:27.438 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:27.519 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:27.524 INFO:teuthology.orchestra.run.smithi155.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-24T03:57:27.547 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:57:27.622 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:27.629 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:27.738 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-24T03:57:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:57:27.808 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:27.832 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-idna (3.3-1) ... 2023-05-24T03:57:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-24T03:57:28.006 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:28.068 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:57:28.141 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:28.174 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2023-05-24T03:57:28.194 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-24T03:57:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:28.266 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:28.329 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-24T03:57:28.521 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:28.575 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:28.613 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-24T03:57:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-24T03:57:28.839 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-24T03:57:28.898 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:28.965 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-24T03:57:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-24T03:57:29.149 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-24T03:57:29.216 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-24T03:57:29.294 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:57:29.297 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:29.400 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-24T03:57:29.431 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-24T03:57:29.459 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-24T03:57:29.561 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:57:29.585 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-24T03:57:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:29.670 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:29.683 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:57:29.687 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:29.797 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:57:29.809 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:29.895 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-24T03:57:29.919 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:29.935 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:57:30.081 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:30.187 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:30.228 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:30.305 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-24T03:57:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:30.474 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-24T03:57:30.479 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-24T03:57:30.529 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:30.548 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-24T03:57:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-24T03:57:30.722 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:30.725 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:57:30.780 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:30.782 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-24T03:57:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:57:30.840 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:57:30.931 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-24T03:57:30.974 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:31.042 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-24T03:57:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:57:31.110 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:57:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:31.199 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:57:31.284 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-24T03:57:31.309 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:57:31.411 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-24T03:57:31.450 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:57:31.552 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-24T03:57:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:31.568 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-24T03:57:31.576 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-24T03:57:31.729 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:57:31.811 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:31.813 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-24T03:57:31.936 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:32.071 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:57:32.071 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-24T03:57:32.080 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:57:32.086 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-24T03:57:32.197 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-24T03:57:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:32.313 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-24T03:57:32.315 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:32.329 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:32.416 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:32.448 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-24T03:57:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:32.573 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:57:32.589 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:32.690 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-24T03:57:32.699 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-24T03:57:32.700 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-idna (3.3-1) ... 2023-05-24T03:57:32.816 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-24T03:57:32.915 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:32.992 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:33.018 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:33.118 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:57:33.167 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:57:33.294 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-24T03:57:33.403 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:57:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:57:33.608 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:57:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:57:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:57:33.787 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-24T03:57:33.868 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:57:33.964 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:33.994 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:34.054 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-24T03:57:34.073 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:34.128 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:57:34.224 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:34.333 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-24T03:57:34.364 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-24T03:57:34.372 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-24T03:57:34.404 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:34.483 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-24T03:57:34.576 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:57:34.608 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:34.727 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:34.734 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:34.742 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:57:34.806 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-24T03:57:34.853 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:57:35.083 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-24T03:57:35.090 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:57:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:57:35.128 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:57:35.163 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:35.325 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-24T03:57:35.387 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-24T03:57:35.412 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-24T03:57:35.414 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-24T03:57:35.426 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-24T03:57:35.492 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:57:35.553 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-24T03:57:35.621 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:35.738 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:57:35.747 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:35.807 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:35.809 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-24T03:57:35.853 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-24T03:57:35.907 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:57:36.008 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:36.065 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:36.089 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:57:36.144 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:57:36.229 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-24T03:57:36.302 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:57:36.349 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:57:36.365 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:36.472 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-24T03:57:36.491 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:36.512 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:57:36.561 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-24T03:57:36.618 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:36.744 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-24T03:57:36.771 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:36.792 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-idna (3.3-1) ... 2023-05-24T03:57:36.828 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-24T03:57:36.840 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-24T03:57:36.889 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:37.003 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-24T03:57:37.088 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:57:37.124 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-24T03:57:37.126 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:37.182 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-idna (3.3-1) ... 2023-05-24T03:57:37.271 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:37.331 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-24T03:57:37.417 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-24T03:57:37.499 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:37.539 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:57:37.607 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:57:37.733 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-24T03:57:37.736 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-24T03:57:37.915 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:37.986 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-24T03:57:38.025 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:38.137 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:38.151 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:57:38.208 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:57:38.307 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:38.421 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-idna (3.3-1) ... 2023-05-24T03:57:38.441 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-24T03:57:38.519 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:57:38.544 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:57:38.645 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:38.680 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:38.709 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:57:38.722 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-24T03:57:38.763 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:38.814 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-24T03:57:38.829 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:57:38.835 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:38.945 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:57:38.974 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:39.074 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:57:39.088 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:39.101 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:39.216 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:39.221 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:39.229 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:39.319 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:39.342 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:57:39.489 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-24T03:57:39.491 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-24T03:57:39.588 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:39.644 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:39.714 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:39.733 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:39.748 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:39.840 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:39.859 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:39.874 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:57:39.887 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-24T03:57:39.920 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:40.037 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-24T03:57:40.042 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:40.065 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:40.065 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:40.163 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:57:40.280 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-24T03:57:40.305 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:57:40.343 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:57:40.406 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-24T03:57:40.432 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:40.528 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-24T03:57:40.532 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-24T03:57:40.577 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-24T03:57:40.635 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:40.733 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:57:40.762 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:40.787 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:40.829 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-24T03:57:40.833 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-24T03:57:40.888 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:40.913 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:41.005 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:41.084 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-24T03:57:41.096 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:57:41.200 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-24T03:57:41.241 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:41.335 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:41.347 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-24T03:57:41.444 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-24T03:57:41.468 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-24T03:57:41.549 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:57:41.570 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-24T03:57:41.615 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:57:41.741 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-24T03:57:41.744 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:57:41.825 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:41.855 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-24T03:57:41.951 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-24T03:57:41.987 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-24T03:57:42.034 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:42.106 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-24T03:57:42.143 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:57:42.219 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-24T03:57:42.230 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:57:42.268 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:42.356 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-24T03:57:42.365 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-24T03:57:42.394 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:42.436 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:57:42.495 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:42.520 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:42.632 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:42.641 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-24T03:57:42.646 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:42.737 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:57:42.771 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:57:42.772 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:42.783 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:57:42.892 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-24T03:57:42.898 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:42.996 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:43.075 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:57:43.139 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:43.160 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-24T03:57:43.269 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-24T03:57:43.377 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:57:43.392 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-24T03:57:43.399 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2023-05-24T03:57:43.415 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:57:43.553 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-24T03:57:43.653 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:43.657 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:43.663 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-24T03:57:43.767 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:57:43.783 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:43.784 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2023-05-24T03:57:43.893 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:43.961 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2023-05-24T03:57:43.975 INFO:teuthology.orchestra.run.smithi162.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-24T03:57:44.019 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:44.051 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-24T03:57:44.097 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-24T03:57:44.104 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-24T03:57:44.176 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:57:44.231 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:44.306 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:44.344 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:44.406 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-24T03:57:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-24T03:57:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:44.450 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:44.450 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-24T03:57:44.559 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:44.654 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:44.657 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-24T03:57:44.771 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:44.816 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:57:44.844 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:44.970 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:45.050 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:45.076 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-24T03:57:45.096 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:45.114 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:45.251 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-24T03:57:45.307 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:45.308 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:45.310 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:45.335 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:45.415 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:57:45.445 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:45.502 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-24T03:57:45.590 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:45.591 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:45.628 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-24T03:57:45.708 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:45.762 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:45.834 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-24T03:57:45.840 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:45.966 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:46.013 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-24T03:57:46.072 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:57:46.092 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:46.218 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:46.233 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-24T03:57:46.280 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-24T03:57:46.354 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:46.356 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:46.482 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-24T03:57:46.531 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-24T03:57:46.674 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-24T03:57:46.703 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:46.742 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-24T03:57:46.766 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-24T03:57:46.970 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:57:47.000 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-24T03:57:47.051 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:47.298 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:47.309 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-24T03:57:47.336 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:57:47.355 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:47.474 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:47.530 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:47.530 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:47.575 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:47.594 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-24T03:57:47.665 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:57:47.701 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:47.711 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-24T03:57:47.721 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:47.827 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:47.953 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:47.962 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-24T03:57:48.005 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:57:48.049 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.050 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:57:48.079 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.168 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.230 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-24T03:57:48.263 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:48.263 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:48.277 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.340 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:57:48.466 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.482 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.498 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-24T03:57:48.592 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.607 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.613 INFO:teuthology.orchestra.run.smithi067.stdout:Adding group ceph....done 2023-05-24T03:57:48.733 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.806 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.858 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:48.874 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-24T03:57:48.923 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user ceph....done 2023-05-24T03:57:48.932 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:48.978 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.058 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.092 INFO:teuthology.orchestra.run.smithi067.stdout:Setting system user ceph properties....done 2023-05-24T03:57:49.111 INFO:teuthology.orchestra.run.smithi067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-24T03:57:49.158 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-24T03:57:49.160 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.184 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:49.249 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-24T03:57:49.270 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.293 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:49.293 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:49.396 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.485 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.486 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-24T03:57:49.595 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.595 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.604 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-24T03:57:49.623 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:49.623 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:49.704 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.705 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.780 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.889 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.915 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:49.918 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:49.918 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:50.040 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.041 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.122 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.139 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.167 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.249 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.252 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:57:50.253 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:57:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.302 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-24T03:57:50.391 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.392 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.464 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:50.587 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.590 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.716 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.721 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.754 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:50.754 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:50.775 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.842 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:50.847 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:50.909 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.027 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.059 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:51.059 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-24T03:57:51.170 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.297 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:57:51.510 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.582 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.708 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.772 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.833 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-top (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.857 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-24T03:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:51.951 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-24T03:57:52.024 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.113 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.150 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.239 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.276 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.361 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.366 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.372 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:57:52.385 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.491 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.607 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:52.607 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:52.617 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.743 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:52.825 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:57:52.827 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-24T03:57:52.882 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-05-24T03:57:52.970 INFO:teuthology.orchestra.run.smithi040.stdout:Adding group ceph....done 2023-05-24T03:57:53.053 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2023-05-24T03:57:53.054 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2023-05-24T03:57:53.105 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.130 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.207 INFO:teuthology.orchestra.run.smithi162.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-24T03:57:53.207 INFO:teuthology.orchestra.run.smithi162.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:57:53.208 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:57:53.209 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:57:53.210 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:57:53.210 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:57:53.210 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2023-05-24T03:57:53.210 INFO:teuthology.orchestra.run.smithi162.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-24T03:57:53.210 INFO:teuthology.orchestra.run.smithi162.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-24T03:57:53.210 INFO:teuthology.orchestra.run.smithi162.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-24T03:57:53.211 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-24T03:57:53.211 INFO:teuthology.orchestra.run.smithi162.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:57:53.211 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2023-05-24T03:57:53.211 INFO:teuthology.orchestra.run.smithi162.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-24T03:57:53.211 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-24T03:57:53.212 INFO:teuthology.orchestra.run.smithi162.stdout: libengine-pkcs11-openssl 2023-05-24T03:57:53.227 INFO:teuthology.orchestra.run.smithi121.stdout:Adding group ceph....done 2023-05-24T03:57:53.231 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.245 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2023-05-24T03:57:53.246 INFO:teuthology.orchestra.run.smithi162.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-24T03:57:53.246 INFO:teuthology.orchestra.run.smithi162.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-24T03:57:53.246 INFO:teuthology.orchestra.run.smithi162.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-24T03:57:53.246 INFO:teuthology.orchestra.run.smithi162.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-24T03:57:53.246 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-24T03:57:53.247 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-24T03:57:53.247 INFO:teuthology.orchestra.run.smithi162.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:57:53.247 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2023-05-24T03:57:53.248 INFO:teuthology.orchestra.run.smithi162.stdout: libssl3 2023-05-24T03:57:53.263 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user ceph....done 2023-05-24T03:57:53.315 INFO:teuthology.orchestra.run.smithi162.stdout:1 upgraded, 39 newly installed, 0 to remove and 165 not upgraded. 2023-05-24T03:57:53.316 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 54.6 MB of archives. 2023-05-24T03:57:53.316 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-24T03:57:53.316 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-24T03:57:53.358 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.379 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:53.379 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:53.389 INFO:teuthology.orchestra.run.smithi040.stdout:Setting system user ceph properties....done 2023-05-24T03:57:53.403 INFO:teuthology.orchestra.run.smithi040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-24T03:57:53.414 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-24T03:57:53.473 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-24T03:57:53.483 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.488 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-24T03:57:53.489 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-24T03:57:53.491 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-24T03:57:53.492 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-24T03:57:53.493 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-24T03:57:53.495 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-24T03:57:53.496 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-24T03:57:53.532 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-24T03:57:53.533 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-24T03:57:53.540 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-24T03:57:53.582 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-24T03:57:53.618 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.645 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user ceph....done 2023-05-24T03:57:53.744 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.856 INFO:teuthology.orchestra.run.smithi121.stdout:Setting system user ceph properties....done 2023-05-24T03:57:53.873 INFO:teuthology.orchestra.run.smithi121.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-24T03:57:53.883 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-24T03:57:53.932 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:53.977 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-24T03:57:53.979 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-24T03:57:53.979 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-24T03:57:54.005 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-24T03:57:54.018 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-24T03:57:54.019 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-24T03:57:54.043 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-24T03:57:54.045 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-24T03:57:54.084 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-24T03:57:54.118 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-24T03:57:54.245 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2023-05-24T03:57:54.250 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:54.250 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:54.277 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-24T03:57:54.278 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-24T03:57:54.298 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-24T03:57:54.331 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-24T03:57:54.336 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-24T03:57:54.336 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-24T03:57:54.337 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-24T03:57:54.337 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-24T03:57:54.350 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-24T03:57:54.352 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-24T03:57:54.370 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-24T03:57:54.478 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:54.591 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-24T03:57:54.596 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:54.609 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-24T03:57:54.609 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-24T03:57:54.609 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-24T03:57:54.627 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-24T03:57:54.628 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-24T03:57:54.629 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2023-05-24T03:57:54.721 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:54.726 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-24T03:57:54.727 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-24T03:57:54.823 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2023-05-24T03:57:54.836 INFO:teuthology.orchestra.run.smithi155.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-24T03:57:54.850 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:54.952 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-24T03:57:54.976 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:54.995 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:54.995 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:55.127 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:55.128 INFO:teuthology.orchestra.run.smithi162.stdout:Preconfiguring packages ... 2023-05-24T03:57:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:55.282 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 54.6 MB in 1s (37.0 MB/s) 2023-05-24T03:57:55.296 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:55.317 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-24T03:57:55.348 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:57:55.349 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:57:55.414 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package flex. 2023-05-24T03:57:55.504 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-05-24T03:57:55.510 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-24T03:57:55.555 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-24T03:57:55.557 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:55.557 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:55.757 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:55.844 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-mirror (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:55.909 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:55.954 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:56.063 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:56.146 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:57:56.264 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:56.281 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-24T03:57:56.283 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:56.320 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:56.321 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-24T03:57:56.327 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-24T03:57:56.417 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:56.568 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:56.604 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-24T03:57:56.695 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:57:56.711 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:57:56.801 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:57.044 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:57.044 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:57.098 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:57.166 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:57.237 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package bison. 2023-05-24T03:57:57.340 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-05-24T03:57:57.346 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-24T03:57:57.405 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:57:57.408 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:57.408 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:57.442 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-24T03:57:57.478 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:57:57.553 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:57.779 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:57.780 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:57.814 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-24T03:57:57.842 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-24T03:57:57.881 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:57:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:57:57.923 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-24T03:57:57.952 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:57.977 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2023-05-24T03:57:57.999 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:58.152 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2023-05-24T03:57:58.152 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2023-05-24T03:57:58.188 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:58.188 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:58.218 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package dump. 2023-05-24T03:57:58.224 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:58.225 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-24T03:57:58.244 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-24T03:57:58.288 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:58.292 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking dump (0.4b47-3) ... 2023-05-24T03:57:58.311 INFO:teuthology.orchestra.run.smithi067.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-24T03:57:58.311 INFO:teuthology.orchestra.run.smithi067.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-24T03:57:58.311 INFO:teuthology.orchestra.run.smithi067.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:57:58.311 INFO:teuthology.orchestra.run.smithi067.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:57:58.311 INFO:teuthology.orchestra.run.smithi067.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-24T03:57:58.312 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:57:58.312 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:57:58.312 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:57:58.312 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:57:58.313 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:57:58.313 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:57:58.313 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:57:58.313 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2023-05-24T03:57:58.314 INFO:teuthology.orchestra.run.smithi067.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-24T03:57:58.314 INFO:teuthology.orchestra.run.smithi067.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-24T03:57:58.314 INFO:teuthology.orchestra.run.smithi067.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-24T03:57:58.314 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-24T03:57:58.314 INFO:teuthology.orchestra.run.smithi067.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:57:58.314 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2023-05-24T03:57:58.315 INFO:teuthology.orchestra.run.smithi067.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-24T03:57:58.315 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-24T03:57:58.315 INFO:teuthology.orchestra.run.smithi067.stdout: libengine-pkcs11-openssl 2023-05-24T03:57:58.350 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2023-05-24T03:57:58.350 INFO:teuthology.orchestra.run.smithi067.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-24T03:57:58.351 INFO:teuthology.orchestra.run.smithi067.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-24T03:57:58.351 INFO:teuthology.orchestra.run.smithi067.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-24T03:57:58.351 INFO:teuthology.orchestra.run.smithi067.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-24T03:57:58.352 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-24T03:57:58.352 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-24T03:57:58.352 INFO:teuthology.orchestra.run.smithi067.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:57:58.352 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2023-05-24T03:57:58.353 INFO:teuthology.orchestra.run.smithi067.stdout: libssl3 2023-05-24T03:57:58.534 INFO:teuthology.orchestra.run.smithi067.stdout:1 upgraded, 39 newly installed, 0 to remove and 165 not upgraded. 2023-05-24T03:57:58.534 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 54.6 MB of archives. 2023-05-24T03:57:58.534 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-24T03:57:58.534 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-24T03:57:58.571 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package indent. 2023-05-24T03:57:58.586 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-24T03:57:58.616 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:58.617 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:58.620 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-24T03:57:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:58.726 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:58.848 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-24T03:57:58.864 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-24T03:57:58.906 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:57:58.922 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:58.923 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-24T03:57:59.011 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-24T03:57:59.042 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:59.042 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:59.173 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.260 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-24T03:57:59.267 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-24T03:57:59.288 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-24T03:57:59.299 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.301 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-24T03:57:59.303 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-24T03:57:59.308 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-24T03:57:59.312 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-24T03:57:59.313 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-24T03:57:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-24T03:57:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-24T03:57:59.327 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:57:59.453 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.458 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.484 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-24T03:57:59.484 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-24T03:57:59.563 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.571 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-24T03:57:59.598 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-24T03:57:59.637 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:57:59.689 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.698 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:57:59.698 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:57:59.730 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-24T03:57:59.749 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:59.749 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-24T03:57:59.865 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:57:59.932 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-24T03:57:59.960 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-24T03:57:59.991 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:00.093 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:58:00.093 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:58:00.209 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-24T03:58:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:00.296 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.377 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.397 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.537 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.540 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.545 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjson-perl. 2023-05-24T03:58:00.561 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-24T03:58:00.604 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-24T03:58:00.684 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.687 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.752 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:58:00.753 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-24T03:58:00.815 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:00.852 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:00.904 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-24T03:58:00.907 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-24T03:58:00.909 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-24T03:58:00.909 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-24T03:58:00.916 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-24T03:58:00.916 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-24T03:58:00.927 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-24T03:58:00.931 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-24T03:58:00.934 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-24T03:58:00.948 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-24T03:58:00.973 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:00.994 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:01.112 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-24T03:58:01.154 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:01.281 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:01.291 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:01.444 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:01.719 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-volume (18.0.0-4167-gfa0e62c4-1jammy) ... 2023-05-24T03:58:01.830 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:01.839 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-24T03:58:01.839 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-24T03:58:01.867 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-24T03:58:01.899 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:01.944 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-24T03:58:01.953 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-24T03:58:01.954 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-24T03:58:01.955 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-24T03:58:01.956 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-24T03:58:01.983 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-24T03:58:01.987 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-24T03:58:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:02.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-24T03:58:02.428 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-05-24T03:58:02.603 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-05-24T03:58:02.604 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-05-24T03:58:02.607 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:02.618 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-24T03:58:02.646 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:02.661 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-24T03:58:02.676 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:02.744 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-24T03:58:02.745 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-24T03:58:02.745 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-24T03:58:02.764 INFO:teuthology.orchestra.run.smithi040.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-24T03:58:02.764 INFO:teuthology.orchestra.run.smithi040.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-24T03:58:02.764 INFO:teuthology.orchestra.run.smithi040.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:58:02.764 INFO:teuthology.orchestra.run.smithi040.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:58:02.764 INFO:teuthology.orchestra.run.smithi040.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-24T03:58:02.764 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:58:02.765 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:58:02.765 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:58:02.765 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:58:02.766 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:58:02.766 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:58:02.766 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:58:02.766 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-05-24T03:58:02.766 INFO:teuthology.orchestra.run.smithi040.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-24T03:58:02.767 INFO:teuthology.orchestra.run.smithi040.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-24T03:58:02.767 INFO:teuthology.orchestra.run.smithi040.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-24T03:58:02.767 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-24T03:58:02.767 INFO:teuthology.orchestra.run.smithi040.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:58:02.767 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-05-24T03:58:02.768 INFO:teuthology.orchestra.run.smithi040.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-24T03:58:02.768 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-24T03:58:02.768 INFO:teuthology.orchestra.run.smithi040.stdout: libengine-pkcs11-openssl 2023-05-24T03:58:02.803 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-05-24T03:58:02.804 INFO:teuthology.orchestra.run.smithi040.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-24T03:58:02.804 INFO:teuthology.orchestra.run.smithi040.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-24T03:58:02.805 INFO:teuthology.orchestra.run.smithi040.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-24T03:58:02.805 INFO:teuthology.orchestra.run.smithi040.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-24T03:58:02.805 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-24T03:58:02.805 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-24T03:58:02.805 INFO:teuthology.orchestra.run.smithi040.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:58:02.806 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-05-24T03:58:02.806 INFO:teuthology.orchestra.run.smithi040.stdout: libssl3 2023-05-24T03:58:02.834 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-24T03:58:02.840 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-24T03:58:02.905 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:02.945 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-24T03:58:02.961 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:02.986 INFO:teuthology.orchestra.run.smithi040.stdout:1 upgraded, 39 newly installed, 0 to remove and 165 not upgraded. 2023-05-24T03:58:02.987 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 54.6 MB of archives. 2023-05-24T03:58:02.987 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-24T03:58:02.987 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-24T03:58:03.003 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:03.062 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:03.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-24T03:58:03.122 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2023-05-24T03:58:03.295 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2023-05-24T03:58:03.296 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2023-05-24T03:58:03.296 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-24T03:58:03.299 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-24T03:58:03.323 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-24T03:58:03.350 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:03.362 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:03.364 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-24T03:58:03.389 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:03.420 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-05-24T03:58:03.450 INFO:teuthology.orchestra.run.smithi121.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-24T03:58:03.450 INFO:teuthology.orchestra.run.smithi121.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-24T03:58:03.450 INFO:teuthology.orchestra.run.smithi121.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:58:03.450 INFO:teuthology.orchestra.run.smithi121.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:58:03.450 INFO:teuthology.orchestra.run.smithi121.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-24T03:58:03.451 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:58:03.451 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:58:03.451 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:58:03.451 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:58:03.451 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:58:03.452 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:58:03.452 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:58:03.452 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2023-05-24T03:58:03.452 INFO:teuthology.orchestra.run.smithi121.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-24T03:58:03.453 INFO:teuthology.orchestra.run.smithi121.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-24T03:58:03.453 INFO:teuthology.orchestra.run.smithi121.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-24T03:58:03.453 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-24T03:58:03.453 INFO:teuthology.orchestra.run.smithi121.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:58:03.454 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2023-05-24T03:58:03.454 INFO:teuthology.orchestra.run.smithi121.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-24T03:58:03.454 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-24T03:58:03.454 INFO:teuthology.orchestra.run.smithi121.stdout: libengine-pkcs11-openssl 2023-05-24T03:58:03.464 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-24T03:58:03.486 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2023-05-24T03:58:03.487 INFO:teuthology.orchestra.run.smithi121.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-24T03:58:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-24T03:58:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-24T03:58:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-24T03:58:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-24T03:58:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-24T03:58:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:58:03.489 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2023-05-24T03:58:03.489 INFO:teuthology.orchestra.run.smithi121.stdout: libssl3 2023-05-24T03:58:03.538 INFO:teuthology.orchestra.run.smithi121.stdout:1 upgraded, 39 newly installed, 0 to remove and 165 not upgraded. 2023-05-24T03:58:03.538 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 54.6 MB of archives. 2023-05-24T03:58:03.538 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-24T03:58:03.538 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-24T03:58:03.593 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2023-05-24T03:58:03.593 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2023-05-24T03:58:03.637 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-24T03:58:03.700 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-24T03:58:03.701 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-24T03:58:03.714 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-24T03:58:03.715 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-24T03:58:03.717 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-24T03:58:03.719 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-24T03:58:03.719 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-24T03:58:03.721 INFO:teuthology.orchestra.run.smithi067.stdout:Preconfiguring packages ... 2023-05-24T03:58:03.721 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-24T03:58:03.722 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-24T03:58:03.722 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-24T03:58:03.728 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-24T03:58:03.749 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-24T03:58:03.749 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-24T03:58:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-24T03:58:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-24T03:58:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-24T03:58:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:58:03.753 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2023-05-24T03:58:03.753 INFO:teuthology.orchestra.run.smithi155.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-24T03:58:03.753 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-24T03:58:03.753 INFO:teuthology.orchestra.run.smithi155.stdout: libengine-pkcs11-openssl 2023-05-24T03:58:03.756 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-24T03:58:03.758 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-24T03:58:03.758 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-24T03:58:03.758 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-24T03:58:03.763 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-24T03:58:03.766 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-24T03:58:03.768 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-24T03:58:03.771 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-24T03:58:03.773 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-24T03:58:03.775 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:03.787 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2023-05-24T03:58:03.787 INFO:teuthology.orchestra.run.smithi155.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-24T03:58:03.788 INFO:teuthology.orchestra.run.smithi155.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-24T03:58:03.788 INFO:teuthology.orchestra.run.smithi155.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-24T03:58:03.788 INFO:teuthology.orchestra.run.smithi155.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-24T03:58:03.788 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-24T03:58:03.789 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-24T03:58:03.789 INFO:teuthology.orchestra.run.smithi155.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-24T03:58:03.789 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2023-05-24T03:58:03.789 INFO:teuthology.orchestra.run.smithi155.stdout: libssl3 2023-05-24T03:58:03.808 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-24T03:58:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2023-05-24T03:58:03.938 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-24T03:58:03.939 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-24T03:58:03.969 INFO:teuthology.orchestra.run.smithi155.stdout:1 upgraded, 39 newly installed, 0 to remove and 165 not upgraded. 2023-05-24T03:58:03.970 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 54.6 MB of archives. 2023-05-24T03:58:03.970 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-24T03:58:03.970 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-24T03:58:04.005 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package flex. 2023-05-24T03:58:04.070 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-24T03:58:04.097 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:04.109 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-05-24T03:58:04.115 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:04.136 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:04.161 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-24T03:58:04.183 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-24T03:58:04.213 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-24T03:58:04.215 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-24T03:58:04.216 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-24T03:58:04.218 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-24T03:58:04.218 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-24T03:58:04.222 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-24T03:58:04.223 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-24T03:58:04.230 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-24T03:58:04.264 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-24T03:58:04.423 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-24T03:58:04.424 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-24T03:58:04.444 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-24T03:58:04.448 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-24T03:58:04.477 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-24T03:58:04.481 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-24T03:58:04.481 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-24T03:58:04.482 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-24T03:58:04.483 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-24T03:58:04.483 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-24T03:58:04.496 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-24T03:58:04.498 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-24T03:58:04.508 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:04.547 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:04.703 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:04.706 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-24T03:58:04.739 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-24T03:58:04.741 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-24T03:58:04.743 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-24T03:58:04.748 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-24T03:58:04.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-24T03:58:04.752 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-24T03:58:04.755 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-24T03:58:04.756 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-24T03:58:04.757 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-24T03:58:04.757 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-24T03:58:04.758 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-24T03:58:04.775 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-24T03:58:04.776 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-24T03:58:04.842 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-24T03:58:04.873 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-24T03:58:04.874 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-24T03:58:04.900 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-24T03:58:04.923 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-24T03:58:04.924 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-24T03:58:04.927 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:04.967 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:05.168 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-24T03:58:05.236 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-24T03:58:05.243 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:05.252 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:05.274 INFO:teuthology.orchestra.run.smithi121.stdout:Preconfiguring packages ... 2023-05-24T03:58:05.294 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-24T03:58:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-24T03:58:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-24T03:58:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-24T03:58:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-24T03:58:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-24T03:58:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-24T03:58:05.364 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-24T03:58:05.424 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 54.6 MB in 1s (39.5 MB/s) 2023-05-24T03:58:05.528 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-24T03:58:05.547 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-24T03:58:05.563 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:05.598 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package flex. 2023-05-24T03:58:05.605 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:05.702 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-05-24T03:58:05.872 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:05.873 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-24T03:58:05.874 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package bison. 2023-05-24T03:58:05.875 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-05-24T03:58:05.875 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:05.928 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:06.108 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-24T03:58:06.136 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-24T03:58:06.175 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:06.250 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-24T03:58:06.251 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-24T03:58:06.278 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-24T03:58:06.298 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-24T03:58:06.302 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-24T03:58:06.303 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-24T03:58:06.309 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-24T03:58:06.329 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-24T03:58:06.345 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:06.354 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-24T03:58:06.357 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-24T03:58:06.357 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-24T03:58:06.362 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-24T03:58:06.364 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-24T03:58:06.365 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-24T03:58:06.366 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-24T03:58:06.369 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-24T03:58:06.372 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-24T03:58:06.389 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-24T03:58:06.392 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-24T03:58:06.396 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-24T03:58:06.454 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:06.469 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package modemmanager. 2023-05-24T03:58:06.497 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:06.518 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-24T03:58:06.536 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:06.553 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-24T03:58:06.799 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package dump. 2023-05-24T03:58:06.827 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-24T03:58:06.899 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking dump (0.4b47-3) ... 2023-05-24T03:58:06.961 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:07.099 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-24T03:58:07.182 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-24T03:58:07.183 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-24T03:58:07.183 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-24T03:58:07.185 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package indent. 2023-05-24T03:58:07.192 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager. 2023-05-24T03:58:07.214 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-24T03:58:07.219 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:07.252 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-24T03:58:07.267 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:07.272 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-24T03:58:07.277 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-24T03:58:07.277 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-24T03:58:07.278 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-24T03:58:07.304 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-24T03:58:07.381 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-24T03:58:07.389 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-24T03:58:07.391 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-24T03:58:07.392 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-24T03:58:07.393 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-24T03:58:07.419 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-24T03:58:07.422 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-24T03:58:07.479 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-24T03:58:07.486 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package bison. 2023-05-24T03:58:07.496 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-24T03:58:07.529 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:07.589 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-05-24T03:58:07.596 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:07.646 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:07.738 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-24T03:58:07.740 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-24T03:58:07.858 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-24T03:58:07.886 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-24T03:58:07.891 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ppp. 2023-05-24T03:58:07.919 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-24T03:58:07.925 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:08.089 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-24T03:58:08.116 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-24T03:58:08.128 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-24T03:58:08.155 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:08.163 INFO:teuthology.orchestra.run.smithi040.stdout:Preconfiguring packages ... 2023-05-24T03:58:08.186 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-24T03:58:08.211 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-24T03:58:08.211 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-24T03:58:08.212 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-24T03:58:08.213 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-24T03:58:08.238 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:08.252 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:08.301 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-24T03:58:08.307 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-24T03:58:08.319 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2023-05-24T03:58:08.441 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package flex. 2023-05-24T03:58:08.474 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package dump. 2023-05-24T03:58:08.502 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-24T03:58:08.539 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-24T03:58:08.541 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking dump (0.4b47-3) ... 2023-05-24T03:58:08.543 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-05-24T03:58:08.545 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pptp-linux. 2023-05-24T03:58:08.549 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:08.567 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:08.573 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-24T03:58:08.597 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:08.598 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-24T03:58:08.612 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:08.762 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-24T03:58:08.765 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-24T03:58:08.811 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package indent. 2023-05-24T03:58:08.827 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-24T03:58:08.833 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-24T03:58:08.849 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:08.861 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-24T03:58:08.864 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-24T03:58:08.880 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-24T03:58:08.899 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:08.923 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:09.105 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-24T03:58:09.121 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-24T03:58:09.140 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:09.152 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjson-perl. 2023-05-24T03:58:09.163 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:09.166 INFO:teuthology.orchestra.run.smithi155.stdout:Preconfiguring packages ... 2023-05-24T03:58:09.168 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-24T03:58:09.184 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-24T03:58:09.208 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-24T03:58:09.210 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-24T03:58:09.267 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-common (238) ... 2023-05-24T03:58:09.278 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-24T03:58:09.322 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-05-24T03:58:09.428 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package flex. 2023-05-24T03:58:09.492 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-24T03:58:09.493 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-05-24T03:58:09.498 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:09.519 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-24T03:58:09.527 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-24T03:58:09.530 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-24T03:58:09.558 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-24T03:58:09.558 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:09.571 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-24T03:58:09.596 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:09.599 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:09.638 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:09.697 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:09.786 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-24T03:58:09.802 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-24T03:58:09.836 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:10.181 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-24T03:58:10.208 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:10.209 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-common. 2023-05-24T03:58:10.221 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package bison. 2023-05-24T03:58:10.237 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-24T03:58:10.237 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:10.247 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:10.303 INFO:teuthology.orchestra.run.smithi162.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-24T03:58:10.329 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-05-24T03:58:10.332 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-common (238) ... 2023-05-24T03:58:10.334 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:10.390 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:10.410 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-24T03:58:10.483 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-24T03:58:10.499 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:10.533 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:10.766 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-24T03:58:10.775 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-14. 2023-05-24T03:58:10.794 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-24T03:58:10.802 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:10.818 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:10.824 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:10.851 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:10.854 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjson-perl. 2023-05-24T03:58:10.870 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-24T03:58:10.913 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-24T03:58:11.169 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package dump. 2023-05-24T03:58:11.197 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-24T03:58:11.232 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-24T03:58:11.235 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking dump (0.4b47-3) ... 2023-05-24T03:58:11.260 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-24T03:58:11.274 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-24T03:58:11.303 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:11.315 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:11.332 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:11.369 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package bison. 2023-05-24T03:58:11.473 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-05-24T03:58:11.479 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package indent. 2023-05-24T03:58:11.538 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:11.547 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-24T03:58:11.588 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-24T03:58:11.593 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-24T03:58:11.611 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:11.651 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:11.842 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-24T03:58:11.869 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-24T03:58:11.907 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:11.971 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-24T03:58:11.987 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-24T03:58:11.998 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-24T03:58:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql. 2023-05-24T03:58:12.015 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:12.027 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-24T03:58:12.038 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:12.055 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:12.061 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql (14+238) ... 2023-05-24T03:58:12.305 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client. 2023-05-24T03:58:12.333 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-24T03:58:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-24T03:58:12.365 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2023-05-24T03:58:12.367 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-24T03:58:12.371 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client (14+238) ... 2023-05-24T03:58:12.392 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-24T03:58:12.404 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:12.406 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-24T03:58:12.432 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b47-3) ... 2023-05-24T03:58:12.435 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-24T03:58:12.473 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:12.615 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-24T03:58:12.632 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-24T03:58:12.674 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-24T03:58:12.690 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-24T03:58:12.706 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-24T03:58:12.727 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2023-05-24T03:58:12.743 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-24T03:58:12.743 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-24T03:58:12.748 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:12.771 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:12.777 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-24T03:58:12.809 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:12.960 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-24T03:58:12.960 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl8.6. 2023-05-24T03:58:12.979 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-24T03:58:12.987 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:12.987 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:12.995 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-24T03:58:13.018 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:13.026 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:13.037 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:13.085 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-24T03:58:13.113 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:13.137 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-24T03:58:13.151 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:13.158 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:13.195 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:13.287 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-24T03:58:13.296 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl. 2023-05-24T03:58:13.304 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:13.324 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-24T03:58:13.345 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:13.366 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-24T03:58:13.367 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-24T03:58:13.393 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-24T03:58:13.404 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-24T03:58:13.421 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:13.432 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:13.462 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:13.531 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-24T03:58:13.560 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:13.597 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:13.664 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-24T03:58:13.692 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:13.698 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjson-perl. 2023-05-24T03:58:13.701 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-24T03:58:13.714 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-24T03:58:13.715 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package wpasupplicant. 2023-05-24T03:58:13.729 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-24T03:58:13.731 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:13.743 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-24T03:58:13.748 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-24T03:58:13.768 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:13.782 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:13.875 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-24T03:58:13.892 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:13.925 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:14.001 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-24T03:58:14.029 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-24T03:58:14.063 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-24T03:58:14.067 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:14.084 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-24T03:58:14.090 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:14.111 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-24T03:58:14.121 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:14.136 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-24T03:58:14.150 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:14.153 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-24T03:58:14.161 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-24T03:58:14.179 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:14.194 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:14.219 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:14.365 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-24T03:58:14.381 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-24T03:58:14.420 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-24T03:58:14.423 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:14.447 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:14.478 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:14.556 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-24T03:58:14.584 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-24T03:58:14.631 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:14.700 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjson-perl. 2023-05-24T03:58:14.728 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-24T03:58:14.731 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-24T03:58:14.759 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-24T03:58:14.775 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-24T03:58:14.797 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:14.831 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-24T03:58:14.858 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:14.897 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:14.917 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-common (238) ... 2023-05-24T03:58:15.125 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package modemmanager. 2023-05-24T03:58:15.128 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-24T03:58:15.129 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-24T03:58:15.154 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:15.156 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-24T03:58:15.184 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:15.195 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:15.242 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-24T03:58:15.255 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:15.269 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:15.308 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:15.381 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:15.490 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:15.599 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:15.603 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-24T03:58:15.618 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:15.653 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:15.725 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:15.773 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager. 2023-05-24T03:58:15.801 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:15.837 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-24T03:58:15.848 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:15.865 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:15.871 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-24T03:58:15.899 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:15.903 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:15.938 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:16.164 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-24T03:58:16.180 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:16.196 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-24T03:58:16.223 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:16.408 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-24T03:58:16.436 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-24T03:58:16.439 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:16.466 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:16.488 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ppp. 2023-05-24T03:58:16.516 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-24T03:58:16.517 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-24T03:58:16.544 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:16.574 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:16.777 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package modemmanager. 2023-05-24T03:58:16.794 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:16.794 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:16.805 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:16.807 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-24T03:58:16.810 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:16.834 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:16.852 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:16.865 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:16.911 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-24T03:58:16.939 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-24T03:58:16.979 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:17.117 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-24T03:58:17.143 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pptp-linux. 2023-05-24T03:58:17.144 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-24T03:58:17.171 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-24T03:58:17.185 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:17.209 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:17.301 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:17.376 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-24T03:58:17.404 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:17.427 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:17.428 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-24T03:58:17.445 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-24T03:58:17.478 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:17.484 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package network-manager. 2023-05-24T03:58:17.505 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-24T03:58:17.512 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:17.532 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:17.551 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:17.553 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:17.571 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:17.671 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:17.750 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:17.781 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:17.815 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-24T03:58:17.843 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-24T03:58:17.857 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-24T03:58:17.881 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-common (238) ... 2023-05-24T03:58:17.885 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-24T03:58:17.897 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:17.924 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:18.032 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:18.075 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-24T03:58:18.092 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:18.125 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:18.157 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ppp. 2023-05-24T03:58:18.168 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-24T03:58:18.185 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-24T03:58:18.196 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:18.234 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:18.252 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-24T03:58:18.279 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:18.318 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:18.447 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-24T03:58:18.475 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:18.495 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:18.513 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:18.654 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-24T03:58:18.682 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:18.704 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:18.723 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:18.748 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-common. 2023-05-24T03:58:18.776 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-24T03:58:18.824 INFO:teuthology.orchestra.run.smithi067.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-24T03:58:18.841 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-24T03:58:18.846 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up dump (0.4b47-3) ... 2023-05-24T03:58:18.854 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package pptp-linux. 2023-05-24T03:58:18.854 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-common (238) ... 2023-05-24T03:58:18.869 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:18.882 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-24T03:58:18.915 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:18.920 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:18.923 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-24T03:58:18.990 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:19.048 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-24T03:58:19.076 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:19.107 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:19.116 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:19.173 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-24T03:58:19.189 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-24T03:58:19.201 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-24T03:58:19.230 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:19.231 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:19.242 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-24T03:58:19.268 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:19.313 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-14. 2023-05-24T03:58:19.341 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:19.376 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-24T03:58:19.383 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:19.418 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-24T03:58:19.445 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:19.484 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:19.502 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:19.534 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-24T03:58:19.562 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-24T03:58:19.593 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-24T03:58:19.600 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql-client-common (238) ... 2023-05-24T03:58:19.662 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-24T03:58:19.753 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-24T03:58:19.780 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:19.781 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-24T03:58:19.820 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:19.855 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-24T03:58:19.883 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-24T03:58:19.921 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:19.929 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-24T03:58:19.957 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:19.996 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:20.266 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package modemmanager. 2023-05-24T03:58:20.282 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-24T03:58:20.294 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:20.309 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-24T03:58:20.332 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:20.348 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:20.381 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:20.507 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:20.633 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:20.633 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql-common. 2023-05-24T03:58:20.659 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package modemmanager. 2023-05-24T03:58:20.661 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-24T03:58:20.687 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-24T03:58:20.716 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql. 2023-05-24T03:58:20.718 INFO:teuthology.orchestra.run.smithi121.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-24T03:58:20.725 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:20.733 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-24T03:58:20.748 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql-common (238) ... 2023-05-24T03:58:20.765 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql (14+238) ... 2023-05-24T03:58:20.801 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client (14+238) ... 2023-05-24T03:58:20.936 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:20.955 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager. 2023-05-24T03:58:20.983 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:21.009 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client. 2023-05-24T03:58:21.026 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-24T03:58:21.030 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:21.068 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client (14+238) ... 2023-05-24T03:58:21.191 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql-14. 2023-05-24T03:58:21.219 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:21.261 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:21.307 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager. 2023-05-24T03:58:21.335 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-24T03:58:21.353 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-24T03:58:21.370 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-24T03:58:21.382 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:21.411 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-24T03:58:21.417 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:21.418 INFO:teuthology.orchestra.run.smithi162.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-24T03:58:21.418 INFO:teuthology.orchestra.run.smithi162.stdout:which means they are currently configured by ifupdown: 2023-05-24T03:58:21.419 INFO:teuthology.orchestra.run.smithi162.stdout:- enp3s0f1 2023-05-24T03:58:21.419 INFO:teuthology.orchestra.run.smithi162.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-24T03:58:21.419 INFO:teuthology.orchestra.run.smithi162.stdout:remove their configuration from /etc/network/interfaces. 2023-05-24T03:58:21.419 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:21.531 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-24T03:58:21.637 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ppp. 2023-05-24T03:58:21.665 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-24T03:58:21.731 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl8.6. 2023-05-24T03:58:21.759 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:21.822 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:21.879 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-24T03:58:21.974 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:21.989 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ppp. 2023-05-24T03:58:22.017 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-24T03:58:22.041 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl. 2023-05-24T03:58:22.058 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-24T03:58:22.105 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-24T03:58:22.219 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-24T03:58:22.283 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package pptp-linux. 2023-05-24T03:58:22.312 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-24T03:58:22.318 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:22.350 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:22.470 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package wpasupplicant. 2023-05-24T03:58:22.498 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-24T03:58:22.536 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:22.602 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-24T03:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-24T03:58:22.635 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pptp-linux. 2023-05-24T03:58:22.651 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-24T03:58:22.660 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:22.662 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql. 2023-05-24T03:58:22.679 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-24T03:58:22.693 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:22.712 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql (14+238) ... 2023-05-24T03:58:22.763 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:22.874 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-24T03:58:22.890 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-24T03:58:22.906 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:22.931 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:22.939 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql-client. 2023-05-24T03:58:22.945 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-24T03:58:22.956 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-24T03:58:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-24T03:58:22.982 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-24T03:58:22.997 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql-client (14+238) ... 2023-05-24T03:58:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:23.010 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-24T03:58:23.032 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:23.107 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-common (238) ... 2023-05-24T03:58:23.158 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-common (238) ... 2023-05-24T03:58:23.224 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-24T03:58:23.241 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-24T03:58:23.243 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-24T03:58:23.271 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-24T03:58:23.282 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-24T03:58:23.307 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-24T03:58:23.310 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:23.335 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-24T03:58:23.373 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-common (238) ... 2023-05-24T03:58:23.427 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-24T03:58:23.456 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:23.511 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:23.588 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-common (238) ... 2023-05-24T03:58:23.602 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package tcl8.6. 2023-05-24T03:58:23.630 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:23.651 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-24T03:58:23.668 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:23.669 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:23.701 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:23.757 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-24T03:58:23.883 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:23.929 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package tcl. 2023-05-24T03:58:23.946 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-24T03:58:23.987 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-24T03:58:24.008 INFO:teuthology.orchestra.run.smithi162.stdout:Adding user postgres to group ssl-cert 2023-05-24T03:58:24.009 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:24.041 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-common. 2023-05-24T03:58:24.069 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-24T03:58:24.117 INFO:teuthology.orchestra.run.smithi040.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-24T03:58:24.135 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:24.147 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-common (238) ... 2023-05-24T03:58:24.224 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:24.224 INFO:teuthology.orchestra.run.smithi162.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-24T03:58:24.261 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:24.290 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-common. 2023-05-24T03:58:24.318 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-24T03:58:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package wpasupplicant. 2023-05-24T03:58:24.360 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-24T03:58:24.375 INFO:teuthology.orchestra.run.smithi155.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-24T03:58:24.387 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:24.395 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-common (238) ... 2023-05-24T03:58:24.398 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:24.446 INFO:teuthology.orchestra.run.smithi162.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-24T03:58:24.447 INFO:teuthology.orchestra.run.smithi162.stdout:Removing obsolete dictionary files: 2023-05-24T03:58:24.640 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-14. 2023-05-24T03:58:24.668 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:24.709 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:24.786 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-24T03:58:24.814 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-24T03:58:24.853 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:24.903 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-24T03:58:24.994 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:25.017 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-14. 2023-05-24T03:58:25.046 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-24T03:58:25.047 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-24T03:58:25.079 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:25.139 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-24T03:58:25.167 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-24T03:58:25.205 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:25.386 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:25.386 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:25.453 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:25.492 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql-client-common (238) ... 2023-05-24T03:58:25.737 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-24T03:58:25.778 INFO:teuthology.orchestra.run.smithi162.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-24T03:58:25.795 INFO:teuthology.orchestra.run.smithi162.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-24T03:58:25.841 INFO:teuthology.orchestra.run.smithi162.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout:This user must also own the server process. 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout:The database cluster will be initialized with locale "en_US". 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout:The default text search configuration will be set to "english". 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:25.842 INFO:teuthology.orchestra.run.smithi162.stdout:Data page checksums are disabled. 2023-05-24T03:58:25.843 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:25.843 INFO:teuthology.orchestra.run.smithi162.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-24T03:58:25.843 INFO:teuthology.orchestra.run.smithi162.stdout:creating subdirectories ... ok 2023-05-24T03:58:25.843 INFO:teuthology.orchestra.run.smithi162.stdout:selecting dynamic shared memory implementation ... posix 2023-05-24T03:58:25.857 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default max_connections ... 100 2023-05-24T03:58:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:25.875 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default shared_buffers ... 128MB 2023-05-24T03:58:25.882 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default time zone ... Etc/UTC 2023-05-24T03:58:25.882 INFO:teuthology.orchestra.run.smithi162.stdout:creating configuration files ... ok 2023-05-24T03:58:25.962 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:25.967 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql. 2023-05-24T03:58:25.984 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-24T03:58:25.997 INFO:teuthology.orchestra.run.smithi162.stdout:running bootstrap script ... ok 2023-05-24T03:58:26.017 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql (14+238) ... 2023-05-24T03:58:26.063 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:26.088 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:26.214 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:26.231 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:26.261 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client. 2023-05-24T03:58:26.278 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-24T03:58:26.319 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client (14+238) ... 2023-05-24T03:58:26.340 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:26.349 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:26.354 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql. 2023-05-24T03:58:26.383 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-24T03:58:26.420 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql (14+238) ... 2023-05-24T03:58:26.441 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:26.450 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:26.543 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:26.572 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-24T03:58:26.600 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-24T03:58:26.638 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-24T03:58:26.647 INFO:teuthology.orchestra.run.smithi162.stdout:performing post-bootstrap initialization ... ok 2023-05-24T03:58:26.660 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:26.665 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client. 2023-05-24T03:58:26.680 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-24T03:58:26.722 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client (14+238) ... 2023-05-24T03:58:26.895 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-24T03:58:26.941 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl8.6. 2023-05-24T03:58:26.966 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-24T03:58:26.969 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:26.972 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:26.983 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-24T03:58:27.007 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:27.112 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-24T03:58:27.307 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:27.339 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:27.339 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl. 2023-05-24T03:58:27.407 INFO:teuthology.orchestra.run.smithi162.stdout:syncing data to disk ... ok 2023-05-24T03:58:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-24T03:58:27.424 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up dump (0.4b47-3) ... 2023-05-24T03:58:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-24T03:58:27.485 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl8.6. 2023-05-24T03:58:27.501 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-24T03:58:27.513 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-24T03:58:27.560 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:27.560 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:27.752 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:27.804 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl. 2023-05-24T03:58:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package wpasupplicant. 2023-05-24T03:58:27.822 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-24T03:58:27.823 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-24T03:58:27.825 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-24T03:58:27.868 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-24T03:58:27.878 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-24T03:58:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:27.926 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:28.004 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-24T03:58:28.043 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:28.130 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:28.169 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:28.216 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package wpasupplicant. 2023-05-24T03:58:28.220 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-24T03:58:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-24T03:58:28.243 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-24T03:58:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-24T03:58:28.290 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-24T03:58:28.290 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:28.295 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:28.421 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:28.432 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:28.547 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:28.586 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-24T03:58:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-24T03:58:28.645 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-24T03:58:28.661 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-24T03:58:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:28.703 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:28.712 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:28.838 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-common (238) ... 2023-05-24T03:58:29.006 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client (14+238) ... 2023-05-24T03:58:29.031 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-24T03:58:29.059 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-24T03:58:29.106 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:29.132 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:29.144 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-24T03:58:29.270 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up dump (0.4b47-3) ... 2023-05-24T03:58:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:29.388 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-24T03:58:29.400 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-common (238) ... 2023-05-24T03:58:29.455 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:29.598 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:29.611 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-24T03:58:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:29.616 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:29.616 INFO:teuthology.orchestra.run.smithi067.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-24T03:58:29.616 INFO:teuthology.orchestra.run.smithi067.stdout:which means they are currently configured by ifupdown: 2023-05-24T03:58:29.616 INFO:teuthology.orchestra.run.smithi067.stdout:- enp3s0f1 2023-05-24T03:58:29.616 INFO:teuthology.orchestra.run.smithi067.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-24T03:58:29.617 INFO:teuthology.orchestra.run.smithi067.stdout:remove their configuration from /etc/network/interfaces. 2023-05-24T03:58:29.617 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:29.724 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-24T03:58:29.738 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-24T03:58:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:29.748 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-24T03:58:29.849 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-24T03:58:29.872 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:29.951 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:29.998 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-24T03:58:30.023 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-24T03:58:30.094 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-24T03:58:30.100 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-24T03:58:30.132 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-24T03:58:30.228 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:30.258 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-24T03:58:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:30.404 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:30.453 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-24T03:58:30.530 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:30.650 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:30.656 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:30.757 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-24T03:58:30.785 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-24T03:58:30.791 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql-client (14+238) ... 2023-05-24T03:58:30.831 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-24T03:58:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:30.903 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql (14+238) ... 2023-05-24T03:58:30.992 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:31.030 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:31.135 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:31.154 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:31.209 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:31.210 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-24T03:58:31.262 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:31.388 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-common (238) ... 2023-05-24T03:58:31.390 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:31.391 INFO:teuthology.orchestra.run.smithi121.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-24T03:58:31.391 INFO:teuthology.orchestra.run.smithi121.stdout:which means they are currently configured by ifupdown: 2023-05-24T03:58:31.391 INFO:teuthology.orchestra.run.smithi121.stdout:- enp3s0f1 2023-05-24T03:58:31.391 INFO:teuthology.orchestra.run.smithi121.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-24T03:58:31.392 INFO:teuthology.orchestra.run.smithi121.stdout:remove their configuration from /etc/network/interfaces. 2023-05-24T03:58:31.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:31.408 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:31.408 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:31.517 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-24T03:58:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:31.792 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-24T03:58:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:31.853 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-24T03:58:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:31.918 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-24T03:58:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:32.040 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-24T03:58:32.043 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-24T03:58:32.153 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-24T03:58:32.192 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-24T03:58:32.271 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:32.309 INFO:teuthology.orchestra.run.smithi067.stdout:Adding user postgres to group ssl-cert 2023-05-24T03:58:32.367 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:32.388 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-24T03:58:32.514 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-24T03:58:32.519 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:32.548 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:32.548 INFO:teuthology.orchestra.run.smithi067.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-24T03:58:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:32.737 INFO:teuthology.orchestra.run.smithi067.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-24T03:58:32.737 INFO:teuthology.orchestra.run.smithi067.stdout:Removing obsolete dictionary files: 2023-05-24T03:58:32.738 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up dump (0.4b47-3) ... 2023-05-24T03:58:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-24T03:58:32.914 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:33.015 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:33.116 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql-common (238) ... 2023-05-24T03:58:33.161 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-24T03:58:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-24T03:58:33.279 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b47-3) ... 2023-05-24T03:58:33.301 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-24T03:58:33.356 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-24T03:58:33.431 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-24T03:58:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-24T03:58:33.683 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-24T03:58:33.689 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:33.808 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-24T03:58:33.829 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-24T03:58:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-24T03:58:33.929 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-24T03:58:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-24T03:58:33.934 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-24T03:58:33.975 INFO:teuthology.orchestra.run.smithi121.stdout:Adding user postgres to group ssl-cert 2023-05-24T03:58:34.025 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-24T03:58:34.029 INFO:teuthology.orchestra.run.smithi067.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-24T03:58:34.039 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-24T03:58:34.059 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:34.078 INFO:teuthology.orchestra.run.smithi067.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-24T03:58:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:This user must also own the server process. 2023-05-24T03:58:34.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:The database cluster will be initialized with locale "en_US". 2023-05-24T03:58:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-24T03:58:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:The default text search configuration will be set to "english". 2023-05-24T03:58:34.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:Data page checksums are disabled. 2023-05-24T03:58:34.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-24T03:58:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:creating subdirectories ... ok 2023-05-24T03:58:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:selecting dynamic shared memory implementation ... posix 2023-05-24T03:58:34.086 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-24T03:58:34.095 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default max_connections ... 100 2023-05-24T03:58:34.116 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default shared_buffers ... 128MB 2023-05-24T03:58:34.125 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default time zone ... Etc/UTC 2023-05-24T03:58:34.126 INFO:teuthology.orchestra.run.smithi067.stdout:creating configuration files ... ok 2023-05-24T03:58:34.193 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:34.194 INFO:teuthology.orchestra.run.smithi121.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-24T03:58:34.202 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:34.203 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-24T03:58:34.242 INFO:teuthology.orchestra.run.smithi067.stdout:running bootstrap script ... ok 2023-05-24T03:58:34.311 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:34.355 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-24T03:58:34.372 INFO:teuthology.orchestra.run.smithi121.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-24T03:58:34.372 INFO:teuthology.orchestra.run.smithi121.stdout:Removing obsolete dictionary files: 2023-05-24T03:58:34.437 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:34.481 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:34.509 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:34.512 DEBUG:teuthology.parallel:result is None 2023-05-24T03:58:34.605 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client (14+238) ... 2023-05-24T03:58:34.606 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-24T03:58:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:34.784 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client (14+238) ... 2023-05-24T03:58:34.909 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-24T03:58:34.931 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-24T03:58:34.935 INFO:teuthology.orchestra.run.smithi067.stdout:performing post-bootstrap initialization ... ok 2023-05-24T03:58:35.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:35.224 INFO:teuthology.orchestra.run.smithi040.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-24T03:58:35.225 INFO:teuthology.orchestra.run.smithi040.stdout:which means they are currently configured by ifupdown: 2023-05-24T03:58:35.225 INFO:teuthology.orchestra.run.smithi040.stdout:- ens1f0 2023-05-24T03:58:35.225 INFO:teuthology.orchestra.run.smithi040.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-24T03:58:35.225 INFO:teuthology.orchestra.run.smithi040.stdout:remove their configuration from /etc/network/interfaces. 2023-05-24T03:58:35.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:35.343 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:35.349 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-24T03:58:35.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:35.492 INFO:teuthology.orchestra.run.smithi155.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-24T03:58:35.492 INFO:teuthology.orchestra.run.smithi155.stdout:which means they are currently configured by ifupdown: 2023-05-24T03:58:35.492 INFO:teuthology.orchestra.run.smithi155.stdout:- enp3s0f1 2023-05-24T03:58:35.492 INFO:teuthology.orchestra.run.smithi155.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-24T03:58:35.493 INFO:teuthology.orchestra.run.smithi155.stdout:remove their configuration from /etc/network/interfaces. 2023-05-24T03:58:35.493 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:35.577 INFO:teuthology.orchestra.run.smithi067.stdout:syncing data to disk ... ok 2023-05-24T03:58:35.624 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-24T03:58:35.667 INFO:teuthology.orchestra.run.smithi121.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-24T03:58:35.686 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-24T03:58:35.689 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-24T03:58:35.742 INFO:teuthology.orchestra.run.smithi121.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-24T03:58:35.743 INFO:teuthology.orchestra.run.smithi121.stdout:This user must also own the server process. 2023-05-24T03:58:35.743 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:35.743 INFO:teuthology.orchestra.run.smithi121.stdout:The database cluster will be initialized with locale "en_US". 2023-05-24T03:58:35.743 INFO:teuthology.orchestra.run.smithi121.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-24T03:58:35.744 INFO:teuthology.orchestra.run.smithi121.stdout:The default text search configuration will be set to "english". 2023-05-24T03:58:35.744 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:35.744 INFO:teuthology.orchestra.run.smithi121.stdout:Data page checksums are disabled. 2023-05-24T03:58:35.744 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:35.745 INFO:teuthology.orchestra.run.smithi121.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-24T03:58:35.746 INFO:teuthology.orchestra.run.smithi121.stdout:creating subdirectories ... ok 2023-05-24T03:58:35.746 INFO:teuthology.orchestra.run.smithi121.stdout:selecting dynamic shared memory implementation ... posix 2023-05-24T03:58:35.758 INFO:teuthology.orchestra.run.smithi121.stdout:selecting default max_connections ... 100 2023-05-24T03:58:35.776 INFO:teuthology.orchestra.run.smithi121.stdout:selecting default shared_buffers ... 128MB 2023-05-24T03:58:35.784 INFO:teuthology.orchestra.run.smithi121.stdout:selecting default time zone ... Etc/UTC 2023-05-24T03:58:35.786 INFO:teuthology.orchestra.run.smithi121.stdout:creating configuration files ... ok 2023-05-24T03:58:35.894 INFO:teuthology.orchestra.run.smithi121.stdout:running bootstrap script ... ok 2023-05-24T03:58:35.977 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-24T03:58:35.997 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-24T03:58:36.035 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-24T03:58:36.326 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-24T03:58:36.511 INFO:teuthology.orchestra.run.smithi121.stdout:performing post-bootstrap initialization ... ok 2023-05-24T03:58:36.634 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:36.811 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:36.878 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-24T03:58:36.945 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:37.013 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-24T03:58:37.055 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-common (238) ... 2023-05-24T03:58:37.122 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-24T03:58:37.248 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-common (238) ... 2023-05-24T03:58:37.263 INFO:teuthology.orchestra.run.smithi121.stdout:syncing data to disk ... ok 2023-05-24T03:58:37.674 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-24T03:58:38.057 INFO:teuthology.orchestra.run.smithi040.stdout:Adding user postgres to group ssl-cert 2023-05-24T03:58:38.106 INFO:teuthology.orchestra.run.smithi155.stdout:Adding user postgres to group ssl-cert 2023-05-24T03:58:38.346 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:38.346 INFO:teuthology.orchestra.run.smithi155.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-24T03:58:38.458 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:38.458 INFO:teuthology.orchestra.run.smithi040.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-24T03:58:38.541 INFO:teuthology.orchestra.run.smithi155.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-24T03:58:38.541 INFO:teuthology.orchestra.run.smithi155.stdout:Removing obsolete dictionary files: 2023-05-24T03:58:38.812 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:38.913 INFO:teuthology.orchestra.run.smithi040.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-24T03:58:38.913 INFO:teuthology.orchestra.run.smithi040.stdout:Removing obsolete dictionary files: 2023-05-24T03:58:38.938 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-24T03:58:39.064 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql (14+238) ... 2023-05-24T03:58:39.154 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-24T03:58:39.215 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:39.341 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:39.522 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-24T03:58:39.558 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:39.603 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:39.603 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:39.876 INFO:teuthology.orchestra.run.smithi155.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-24T03:58:39.894 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-24T03:58:39.930 INFO:teuthology.orchestra.run.smithi155.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-24T03:58:39.930 INFO:teuthology.orchestra.run.smithi155.stdout:This user must also own the server process. 2023-05-24T03:58:39.930 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout:The database cluster will be initialized with locale "en_US". 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout:The default text search configuration will be set to "english". 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout:Data page checksums are disabled. 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:39.931 INFO:teuthology.orchestra.run.smithi155.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-24T03:58:39.932 INFO:teuthology.orchestra.run.smithi155.stdout:creating subdirectories ... ok 2023-05-24T03:58:39.932 INFO:teuthology.orchestra.run.smithi155.stdout:selecting dynamic shared memory implementation ... posix 2023-05-24T03:58:39.941 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-24T03:58:39.946 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default max_connections ... 100 2023-05-24T03:58:39.966 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default shared_buffers ... 128MB 2023-05-24T03:58:39.973 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default time zone ... Etc/UTC 2023-05-24T03:58:39.973 INFO:teuthology.orchestra.run.smithi155.stdout:creating configuration files ... ok 2023-05-24T03:58:40.088 INFO:teuthology.orchestra.run.smithi155.stdout:running bootstrap script ... ok 2023-05-24T03:58:40.193 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-24T03:58:40.320 INFO:teuthology.orchestra.run.smithi040.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-24T03:58:40.336 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-24T03:58:40.379 INFO:teuthology.orchestra.run.smithi040.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-24T03:58:40.379 INFO:teuthology.orchestra.run.smithi040.stdout:This user must also own the server process. 2023-05-24T03:58:40.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:40.379 INFO:teuthology.orchestra.run.smithi040.stdout:The database cluster will be initialized with locale "en_US". 2023-05-24T03:58:40.380 INFO:teuthology.orchestra.run.smithi040.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-24T03:58:40.380 INFO:teuthology.orchestra.run.smithi040.stdout:The default text search configuration will be set to "english". 2023-05-24T03:58:40.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:40.380 INFO:teuthology.orchestra.run.smithi040.stdout:Data page checksums are disabled. 2023-05-24T03:58:40.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:40.380 INFO:teuthology.orchestra.run.smithi040.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-24T03:58:40.381 INFO:teuthology.orchestra.run.smithi040.stdout:creating subdirectories ... ok 2023-05-24T03:58:40.381 INFO:teuthology.orchestra.run.smithi040.stdout:selecting dynamic shared memory implementation ... posix 2023-05-24T03:58:40.396 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default max_connections ... 100 2023-05-24T03:58:40.417 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default shared_buffers ... 128MB 2023-05-24T03:58:40.428 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default time zone ... Etc/UTC 2023-05-24T03:58:40.428 INFO:teuthology.orchestra.run.smithi040.stdout:creating configuration files ... ok 2023-05-24T03:58:40.513 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:40.516 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:40.545 INFO:teuthology.orchestra.run.smithi040.stdout:running bootstrap script ... ok 2023-05-24T03:58:40.634 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-24T03:58:40.664 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:40.700 INFO:teuthology.orchestra.run.smithi155.stdout:performing post-bootstrap initialization ... ok 2023-05-24T03:58:40.760 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up postgresql (14+238) ... 2023-05-24T03:58:40.885 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:41.020 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:41.217 INFO:teuthology.orchestra.run.smithi040.stdout:performing post-bootstrap initialization ... ok 2023-05-24T03:58:41.273 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:41.274 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:41.386 INFO:teuthology.orchestra.run.smithi155.stdout:syncing data to disk ... ok 2023-05-24T03:58:41.798 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-24T03:58:41.856 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-24T03:58:41.893 INFO:teuthology.orchestra.run.smithi040.stdout:syncing data to disk ... ok 2023-05-24T03:58:42.025 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-24T03:58:42.125 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-24T03:58:42.175 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:42.266 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-24T03:58:42.302 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:42.753 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:42.755 DEBUG:teuthology.parallel:result is None 2023-05-24T03:58:43.654 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-24T03:58:43.755 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-24T03:58:44.457 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:44.459 DEBUG:teuthology.parallel:result is None 2023-05-24T03:58:44.606 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:44.715 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-24T03:58:44.841 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql (14+238) ... 2023-05-24T03:58:44.967 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:45.081 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:45.093 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:45.190 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-24T03:58:45.333 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql (14+238) ... 2023-05-24T03:58:45.348 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:45.349 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:45.459 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-24T03:58:45.560 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-24T03:58:45.794 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:45.795 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-24T03:58:45.996 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-24T03:58:46.306 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:46.379 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-24T03:58:46.466 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:46.714 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-24T03:58:46.874 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-24T03:58:47.777 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-24T03:58:47.877 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-24T03:58:48.251 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-24T03:58:48.514 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:48.516 DEBUG:teuthology.parallel:result is None 2023-05-24T03:58:48.591 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-24T03:58:49.278 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-24T03:58:49.280 DEBUG:teuthology.parallel:result is None 2023-05-24T03:58:49.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:58:49.494 DEBUG:teuthology.orchestra.run.smithi040:> dpkg-query -W -f '${Version}' ceph 2023-05-24T03:58:49.514 INFO:teuthology.orchestra.run.smithi040.stdout:18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:49.515 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:49.515 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167-gfa0e62c4-1jammy is installed. 2023-05-24T03:58:49.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:58:49.734 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-query -W -f '${Version}' ceph 2023-05-24T03:58:49.754 INFO:teuthology.orchestra.run.smithi067.stdout:18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:49.755 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:49.755 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167-gfa0e62c4-1jammy is installed. 2023-05-24T03:58:49.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:58:49.976 DEBUG:teuthology.orchestra.run.smithi121:> dpkg-query -W -f '${Version}' ceph 2023-05-24T03:58:49.995 INFO:teuthology.orchestra.run.smithi121.stdout:18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:49.996 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:49.996 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167-gfa0e62c4-1jammy is installed. 2023-05-24T03:58:49.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:58:50.212 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2023-05-24T03:58:50.232 INFO:teuthology.orchestra.run.smithi155.stdout:18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:50.232 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:50.233 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167-gfa0e62c4-1jammy is installed. 2023-05-24T03:58:50.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:58:50.447 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2023-05-24T03:58:50.467 INFO:teuthology.orchestra.run.smithi162.stdout:18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:50.467 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167-gfa0e62c4-1jammy 2023-05-24T03:58:50.467 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167-gfa0e62c4-1jammy is installed. 2023-05-24T03:58:50.468 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-24T03:58:50.468 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:50.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:58:50.483 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:50.484 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:58:50.499 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:50.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:58:50.514 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:50.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:58:50.528 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:50.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:58:50.542 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-24T03:58:50.542 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:50.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:58:50.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:58:50.615 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:50.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:58:50.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:58:50.686 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:50.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:58:50.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:58:50.754 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:50.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:58:50.768 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:58:50.823 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:50.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:58:50.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:58:50.891 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-24T03:58:50.892 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:50.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:58:50.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:58:50.959 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:50.960 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:58:50.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:58:51.030 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:51.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:58:51.045 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:58:51.099 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:51.100 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:58:51.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:58:51.166 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:51.167 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:58:51.180 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:58:51.234 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-05-24T03:58:51.235 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:51.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:58:51.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:58:51.303 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:51.304 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:58:51.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:58:51.373 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:51.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:58:51.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:58:51.443 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:51.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:58:51.457 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:58:51.511 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:51.511 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:58:51.525 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:58:51.578 INFO:teuthology.run_tasks:Running task ceph... 2023-05-24T03:58:51.661 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-24T03:58:51.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-05-24T03:58:51.664 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2023-05-24T03:58:51.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2023-05-24T03:58:51.669 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2023-05-24T03:58:51.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2023-05-24T03:58:51.686 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-24T03:58:51.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:58:51.720 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:58:51.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:58:51.725 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:58:51.727 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:58:51.742 INFO:tasks.ceph:Creating extra log directories... 2023-05-24T03:58:51.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:58:51.777 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:58:51.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:58:51.782 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:58:51.784 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:58:51.805 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-24T03:58:51.805 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-24T03:58:51.806 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-24T03:58:51.806 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:51.806 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:58:51.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:58:51.911 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:51.911 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:58:51.917 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:58:51.991 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:51.991 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:58:51.997 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:58:52.072 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:52.072 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:58:52.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:58:52.152 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:52.152 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:58:52.158 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:58:52.236 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-24T03:58:52.236 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-24T03:58:52.237 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'branch': 'wip-pdonnell-testing-20230523.134409', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7284314', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20230523.134409'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20230523.134409', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'seed': 7650, 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28', 'sleep_before_teardown': 0, 'subset': '449/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20230523.134409', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIcYehHKRCOZMJs0TX73ZxuODablbS0ht8/p5d3kfoXgkNWbQEwMR5zD9ZZXuD/3M6tQX9gSnmALqZj70Rg4Gu0=', 'smithi067.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOUYy+0CXpAm6lgDQ8Z2zGCA0MeYOPttlj/daf5w+/xd', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2e/MzT90YFY933kSp8sC5l8DS0nZU55rxKQ/Vz2CmuGjeqiAsIbyBDnhPr6HcQpITpY05I8T7wQHaJhjhcN+4=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbdKZ0H3Wz2rH6WQwWfoMX0H1HuHJyuMHFKqhEX5Pu4YFuJ/mpBpRsdsebnGZ007+wQJexXSrhoDpUELvq4QgU=', 'smithi162.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEsJoPbYwYzoVvmxpiWNCKjuwyMacSwAK4thGPAQ4eC5'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}}, {'ceph': None}, {'ceph-fuse': None}, {'pexec': {'clients': ['cd $TESTDIR', 'wget http://download.ceph.com/qa/ior.tbz2', 'tar xvfj ior.tbz2', 'cd ior', './configure', 'make', 'make install DESTDIR=$TESTDIR/binary/', 'cd $TESTDIR/', 'rm ior.tbz2', 'rm -r ior', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt/ior.testfile', 'rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/binary']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'stdin-killer', 'teuthology_sha1': 'c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2', 'timestamp': '2023-05-23_18:20:18', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-24T03:58:52.237 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:58:52.240 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:58:52.242 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:58:52.245 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:58:52.247 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:58:52.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:58:52.288 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:58:52.290 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:58:52.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:58:52.296 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:58:52.335 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:52.336 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-05-24T03:58:52.347 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-24T03:58:52.347 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-05-24T03:58:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-24T03:58:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:52.396 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 880 Links: 1 2023-05-24T03:58:52.396 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:52.396 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-24 03:52:29.636887104 +0000 2023-05-24T03:58:52.396 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-24 03:52:29.632887139 +0000 2023-05-24T03:58:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-24 03:52:29.632887139 +0000 2023-05-24T03:58:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-24T03:58:52.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-24T03:58:52.450 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-24T03:58:52.450 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-24T03:58:52.450 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000425667 s, 1.2 MB/s 2023-05-24T03:58:52.451 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-24T03:58:52.501 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-05-24T03:58:52.550 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-24T03:58:52.550 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:52.550 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-05-24T03:58:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-24 03:52:30.612878380 +0000 2023-05-24T03:58:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-24 03:52:30.244881670 +0000 2023-05-24T03:58:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-24 03:52:30.244881670 +0000 2023-05-24T03:58:52.551 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-24T03:58:52.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-24T03:58:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-24T03:58:52.603 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-24T03:58:52.603 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000414227 s, 1.2 MB/s 2023-05-24T03:58:52.605 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-24T03:58:52.655 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-05-24T03:58:52.704 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-24T03:58:52.704 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:52.704 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-05-24T03:58:52.704 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:52.704 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-24 03:52:31.204873089 +0000 2023-05-24T03:58:52.705 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-24 03:52:30.828876450 +0000 2023-05-24T03:58:52.705 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-24 03:52:30.828876450 +0000 2023-05-24T03:58:52.705 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-24T03:58:52.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-24T03:58:52.758 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-24T03:58:52.758 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-24T03:58:52.758 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000408388 s, 1.3 MB/s 2023-05-24T03:58:52.759 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-24T03:58:52.812 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-05-24T03:58:52.860 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-24T03:58:52.860 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:52.861 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-05-24T03:58:52.861 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:52.861 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-24 03:52:31.440870979 +0000 2023-05-24T03:58:52.861 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-24 03:52:31.436871016 +0000 2023-05-24T03:58:52.861 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-24 03:52:31.436871016 +0000 2023-05-24T03:58:52.861 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-24T03:58:52.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-24T03:58:52.914 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-24T03:58:52.914 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-24T03:58:52.914 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000292711 s, 1.7 MB/s 2023-05-24T03:58:52.915 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-24T03:58:52.965 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:58:52.965 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:52.965 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2023-05-24T03:58:52.971 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-24T03:58:52.972 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2023-05-24T03:58:53.018 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-24T03:58:53.018 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:53.019 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 868 Links: 1 2023-05-24T03:58:53.019 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:53.019 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-05-24 03:52:30.115022200 +0000 2023-05-24T03:58:53.019 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-05-24 03:52:29.731025631 +0000 2023-05-24T03:58:53.019 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-05-24 03:52:29.731025631 +0000 2023-05-24T03:58:53.019 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-05-24T03:58:53.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-24T03:58:53.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-05-24T03:58:53.074 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-05-24T03:58:53.074 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.00044473 s, 1.2 MB/s 2023-05-24T03:58:53.075 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-24T03:58:53.123 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2023-05-24T03:58:53.170 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-24T03:58:53.170 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:53.170 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 885 Links: 1 2023-05-24T03:58:53.171 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:53.171 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-05-24 03:52:30.687017092 +0000 2023-05-24T03:58:53.171 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-05-24 03:52:30.335020235 +0000 2023-05-24T03:58:53.171 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-05-24 03:52:30.335020235 +0000 2023-05-24T03:58:53.171 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-05-24T03:58:53.171 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-24T03:58:53.225 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-05-24T03:58:53.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-05-24T03:58:53.226 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000351274 s, 1.5 MB/s 2023-05-24T03:58:53.227 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-24T03:58:53.276 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2023-05-24T03:58:53.322 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-24T03:58:53.322 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:53.322 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 910 Links: 1 2023-05-24T03:58:53.322 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:53.322 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-05-24 03:52:31.343011231 +0000 2023-05-24T03:58:53.323 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-05-24 03:52:30.951014734 +0000 2023-05-24T03:58:53.323 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-05-24 03:52:30.951014734 +0000 2023-05-24T03:58:53.323 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-05-24T03:58:53.323 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-24T03:58:53.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-05-24T03:58:53.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-05-24T03:58:53.377 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000406847 s, 1.3 MB/s 2023-05-24T03:58:53.378 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-24T03:58:53.427 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2023-05-24T03:58:53.474 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-24T03:58:53.475 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:58:53.475 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 922 Links: 1 2023-05-24T03:58:53.475 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:58:53.475 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-05-24 03:52:31.975005586 +0000 2023-05-24T03:58:53.475 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-05-24 03:52:31.591009016 +0000 2023-05-24T03:58:53.476 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-05-24 03:52:31.591009016 +0000 2023-05-24T03:58:53.476 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-05-24T03:58:53.476 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-24T03:58:53.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-05-24T03:58:53.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-05-24T03:58:53.529 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000382127 s, 1.3 MB/s 2023-05-24T03:58:53.530 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-24T03:58:53.584 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:58:53.584 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-24T03:58:53.585 INFO:tasks.ceph:Generating config... 2023-05-24T03:58:53.587 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-24T03:58:53.587 INFO:tasks.ceph:[client] debug client = 20 2023-05-24T03:58:53.587 INFO:tasks.ceph:[client] debug ms = 1 2023-05-24T03:58:53.588 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-24T03:58:53.588 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-24T03:58:53.589 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-24T03:58:53.589 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-24T03:58:53.589 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-24T03:58:53.590 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-24T03:58:53.590 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-24T03:58:53.591 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-24T03:58:53.591 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-24T03:58:53.591 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-24T03:58:53.592 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-24T03:58:53.592 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-24T03:58:53.593 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-24T03:58:53.593 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-24T03:58:53.593 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-24T03:58:53.594 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-24T03:58:53.594 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-24T03:58:53.595 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-24T03:58:53.595 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-24T03:58:53.595 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-24T03:58:53.596 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-24T03:58:53.596 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-24T03:58:53.597 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-24T03:58:53.597 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-24T03:58:53.597 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-24T03:58:53.598 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-24T03:58:53.598 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-24T03:58:53.598 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-24T03:58:53.599 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-24T03:58:53.599 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-24T03:58:53.600 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-24T03:58:53.600 INFO:tasks.ceph:Setting up mon.a... 2023-05-24T03:58:53.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-24T03:58:53.635 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-05-24T03:58:53.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-24T03:58:53.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:58:53.787 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.67'), ('mon.c', '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]')] 2023-05-24T03:58:53.788 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-24T03:58:53.789 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:53.789 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-24T03:58:53.835 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.67 --addv c '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2023-05-24T03:58:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-05-24T03:58:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:fsid b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:53.923 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-05-24T03:58:53.918401+0000 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-05-24T03:58:53.918401+0000 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2023-05-24T03:58:53.924 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-24T03:58:53.926 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-24T03:58:53.971 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b4b82cba-0383-492a-85bf-0de09746a380... 2023-05-24T03:58:53.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:58:54.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:58:54.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:58:54.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:58:54.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:58:54.045 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.046 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-05-24T03:58:54.047 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:58:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-05-24T03:58:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:58:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:58:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-05-24T03:58:54.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:58:54.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-05-24T03:58:54.051 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-05-24T03:58:54.052 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:54.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.052 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-05-24T03:58:54.052 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-05-24T03:58:54.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.053 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-05-24T03:58:54.053 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-05-24T03:58:54.054 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:58:54.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.054 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-05-24T03:58:54.054 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-05-24T03:58:54.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.054 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:58:54.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.056 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-05-24T03:58:54.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.056 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-05-24T03:58:54.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.057 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:58:54.057 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-05-24T03:58:54.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.057 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-05-24T03:58:54.057 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-05-24T03:58:54.058 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-05-24T03:58:54.058 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-05-24T03:58:54.058 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2023-05-24T03:58:54.058 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2023-05-24T03:58:54.058 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-24T03:58:54.058 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-05-24T03:58:54.059 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2023-05-24T03:58:54.059 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:58:54.059 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-05-24T03:58:54.060 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:58:54.060 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:58:54.060 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-05-24T03:58:54.061 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-05-24T03:58:54.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.061 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-05-24T03:58:54.061 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-24T03:58:54.062 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-05-24T03:58:54.062 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-05-24T03:58:54.062 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-05-24T03:58:54.062 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.063 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.063 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-05-24T03:58:54.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.063 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-05-24T03:58:54.063 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-24T03:58:54.064 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-05-24T03:58:54.064 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-05-24T03:58:54.064 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-05-24T03:58:54.065 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-05-24T03:58:54.065 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-05-24T03:58:54.065 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.065 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-05-24T03:58:54.066 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-05-24T03:58:54.066 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.066 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:58:54.066 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:58:54.066 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-05-24T03:58:54.067 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-05-24T03:58:54.068 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.069 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-05-24T03:58:54.070 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.071 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.074 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-05-24T03:58:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-05-24T03:58:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:58:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-05-24T03:58:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-05-24T03:58:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:58:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-05-24T03:58:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-05-24T03:58:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-05-24T03:58:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-05-24T03:58:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.40,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-05-24T03:58:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:58:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-05-24T03:58:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-05-24T03:58:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-05-24T03:58:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:58:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-05-24T03:58:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-05-24T03:58:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:58:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-05-24T03:58:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-05-24T03:58:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-05-24T03:58:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-05-24T03:58:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-05-24T03:58:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 20 2023-05-24T03:58:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 20 2023-05-24T03:58:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-05-24T03:58:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-05-24T03:58:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 10 2023-05-24T03:58:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:58:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-05-24T03:58:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:58:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:58:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-05-24T03:58:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-05-24T03:58:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.089 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-05-24T03:58:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-05-24T03:58:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-05-24T03:58:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-05-24T03:58:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-05-24T03:58:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-05-24T03:58:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.091 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-05-24T03:58:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-05-24T03:58:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-05-24T03:58:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-05-24T03:58:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-05-24T03:58:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-05-24T03:58:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-05-24T03:58:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-05-24T03:58:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-05-24T03:58:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:58:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:58:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:58:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:58:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:58:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:58:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-05-24T03:58:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:58:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:58:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-05-24T03:58:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-05-24T03:58:54.097 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-05-24T03:58:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-05-24T03:58:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-05-24T03:58:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-05-24T03:58:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-05-24T03:58:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2023-05-24T03:58:54.101 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.102 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:58:54.103 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:58:54.104 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2023-05-24T03:58:54.105 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.106 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.40,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2023-05-24T03:58:54.107 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2023-05-24T03:58:54.108 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.109 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2023-05-24T03:58:54.110 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-05-24T03:58:54.111 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2023-05-24T03:58:54.112 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.113 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-05-24T03:58:54.114 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:58:54.115 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.116 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2023-05-24T03:58:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:58:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:58:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2023-05-24T03:58:54.117 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-05-24T03:58:54.118 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2023-05-24T03:58:54.118 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2023-05-24T03:58:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2023-05-24T03:58:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2023-05-24T03:58:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:58:54.119 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:58:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2023-05-24T03:58:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-05-24T03:58:54.120 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-05-24T03:58:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.121 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.121 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2023-05-24T03:58:54.121 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2023-05-24T03:58:54.121 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2023-05-24T03:58:54.122 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-05-24T03:58:54.122 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-05-24T03:58:54.122 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2023-05-24T03:58:54.122 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2023-05-24T03:58:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2023-05-24T03:58:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-05-24T03:58:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2023-05-24T03:58:54.123 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2023-05-24T03:58:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2023-05-24T03:58:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2023-05-24T03:58:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-05-24T03:58:54.124 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.125 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.125 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2023-05-24T03:58:54.125 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2023-05-24T03:58:54.125 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:58:54.125 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2023-05-24T03:58:54.125 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.126 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:58:54.127 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:58:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:58:54.129 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.130 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2023-05-24T03:58:54.130 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.130 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2023-05-24T03:58:54.130 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.130 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2023-05-24T03:58:54.130 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.40,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.132 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.133 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2023-05-24T03:58:54.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 20 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 20 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-05-24T03:58:54.135 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 10 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2023-05-24T03:58:54.136 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-05-24T03:58:54.138 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:58:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.140 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2023-05-24T03:58:54.141 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:58:54.141 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.141 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:58:54.141 INFO:teuthology.orchestra.run.smithi121.stdout: mon op complaint time = 120 2023-05-24T03:58:54.141 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T03:58:54.141 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: client mount timeout = 600 2023-05-24T03:58:54.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2023-05-24T03:58:54.143 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds = 20 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds balancer = 20 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug frag = True 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug scatterstat = True 2023-05-24T03:58:54.144 INFO:teuthology.orchestra.run.smithi121.stdout: mds op complaint time = 180 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi121.stdout: mds verify scatter = True 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2023-05-24T03:58:54.145 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2023-05-24T03:58:54.146 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2023-05-24T03:58:54.147 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2023-05-24T03:58:54.148 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:58:54.149 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.150 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.40,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = b4b82cba-0383-492a-85bf-0de09746a380 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2023-05-24T03:58:54.151 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.152 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2023-05-24T03:58:54.152 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2023-05-24T03:58:54.152 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2023-05-24T03:58:54.153 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2023-05-24T03:58:54.154 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2023-05-24T03:58:54.155 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2023-05-24T03:58:54.156 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2023-05-24T03:58:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2023-05-24T03:58:54.158 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2023-05-24T03:58:54.159 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:58:54.160 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2023-05-24T03:58:54.161 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2023-05-24T03:58:54.162 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.163 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2023-05-24T03:58:54.164 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2023-05-24T03:58:54.165 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2023-05-24T03:58:54.166 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2023-05-24T03:58:54.166 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-24T03:58:54.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-24T03:58:54.219 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-24T03:58:54.220 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:54.220 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-24T03:58:54.226 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:54.227 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-24T03:58:54.275 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T03:58:54.276 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:54.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:58:54.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:58:54.341 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:58:54.341 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:54.392 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T03:58:54.392 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:54.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:58:54.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:58:54.418 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:58:54.419 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:54.466 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2023-05-24T03:58:54.466 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:54.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:58:54.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:58:54.489 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:58:54.489 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:54.536 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2023-05-24T03:58:54.536 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:54.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:58:54.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:58:54.559 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:58:54.560 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:54.608 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2023-05-24T03:58:54.608 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:54.608 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:58:54.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:58:54.631 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:58:54.631 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:54.679 INFO:tasks.ceph:Setting up mon nodes... 2023-05-24T03:58:54.679 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-24T03:58:54.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-24T03:58:54.726 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-24T03:58:54.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-24T03:58:54.776 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-24T03:58:54.789 INFO:tasks.ceph:Setting up mds nodes... 2023-05-24T03:58:54.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-24T03:58:54.833 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-24T03:58:54.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-24T03:58:54.891 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-24T03:58:54.937 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-24T03:58:54.939 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-24T03:58:54.993 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-24T03:58:54.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-24T03:58:55.030 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-24T03:58:55.049 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-24T03:58:55.086 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-24T03:58:55.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-24T03:58:55.148 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-24T03:58:55.185 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-24T03:58:55.185 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-24T03:58:55.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-24T03:58:55.200 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:58:55.200 INFO:tasks.ceph:role: osd.0 2023-05-24T03:58:55.201 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T03:58:55.201 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-24T03:58:55.263 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:58:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:58:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:58:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:58:55.265 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:58:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:58:55.265 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:58:55.265 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:58:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:58:55.265 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:58:55.710 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-24T03:58:55.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-24T03:58:55.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-24T03:58:55.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-24T03:58:55.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:58:55.831 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:58:55.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-24T03:58:55.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:58:55.891 INFO:tasks.ceph:role: osd.1 2023-05-24T03:58:55.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T03:58:55.891 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-24T03:58:55.956 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:58:55.957 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:58:55.957 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:58:55.957 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:58:55.957 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:58:55.958 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:58:55.958 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:58:55.958 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:58:55.958 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:58:55.958 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:58:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-24T03:58:56.429 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-24T03:58:56.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-24T03:58:56.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-24T03:58:56.603 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:58:56.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:58:56.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-24T03:58:56.660 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:58:56.661 INFO:tasks.ceph:role: osd.2 2023-05-24T03:58:56.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T03:58:56.661 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-24T03:58:56.722 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:58:56.723 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:58:56.723 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:58:56.723 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:58:56.723 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:58:56.723 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:58:56.723 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:58:56.724 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:58:56.724 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:58:56.724 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:58:57.181 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-24T03:58:57.183 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-24T03:58:57.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-24T03:58:57.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-24T03:58:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:58:57.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:58:57.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-24T03:58:57.399 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:58:57.400 INFO:tasks.ceph:role: osd.3 2023-05-24T03:58:57.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T03:58:57.400 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-24T03:58:57.467 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:58:57.467 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:58:57.468 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:58:57.469 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:58:57.888 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-24T03:58:57.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-24T03:58:57.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-24T03:58:57.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-24T03:58:58.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:58:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:58:58.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:58:58.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:58:58.153+0000 7f4529557640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-24T03:58:58.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:58:58.157+0000 7f4529557640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-24T03:58:58.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:58:58.157+0000 7f4529557640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-24T03:58:58.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:58:58.157+0000 7f4529557640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-24T03:58:58.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:58:58.157+0000 7f4529557640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-24T03:58:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:58:58.161+0000 7f4529557640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-24T03:59:01.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-24T03:59:01.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:01.281+0000 7fa2ef397640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-24T03:59:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:01.281+0000 7fa2ef397640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-24T03:59:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:01.281+0000 7fa2ef397640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-24T03:59:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:01.281+0000 7fa2ef397640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-24T03:59:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:01.281+0000 7fa2ef397640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-24T03:59:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:01.281+0000 7fa2ef397640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-24T03:59:04.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-24T03:59:04.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:04.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:04.429+0000 7fd47a33f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-24T03:59:04.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:04.429+0000 7fd47a33f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-24T03:59:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:04.429+0000 7fd47a33f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-24T03:59:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:04.429+0000 7fd47a33f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-24T03:59:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:04.429+0000 7fd47a33f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-24T03:59:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:04.429+0000 7fd47a33f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-24T03:59:07.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-24T03:59:07.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:07.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:07.597+0000 7f7eaec10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-24T03:59:07.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:07.597+0000 7f7eaec10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-24T03:59:07.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:07.597+0000 7f7eaec10640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-24T03:59:07.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:07.597+0000 7f7eaec10640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-24T03:59:07.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:07.597+0000 7f7eaec10640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-24T03:59:07.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:07.597+0000 7f7eaec10640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-24T03:59:10.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-24T03:59:10.664 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-24T03:59:10.679 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:59:10.679 INFO:tasks.ceph:role: osd.4 2023-05-24T03:59:10.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T03:59:10.679 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-24T03:59:10.742 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:59:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:59:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:59:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:59:10.742 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:59:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:59:10.743 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:59:10.743 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:59:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:59:10.743 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:59:11.202 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-05-24T03:59:11.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-05-24T03:59:11.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-24T03:59:11.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-24T03:59:11.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:59:11.305 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:59:11.305 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-24T03:59:11.366 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:59:11.366 INFO:tasks.ceph:role: osd.5 2023-05-24T03:59:11.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T03:59:11.367 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-24T03:59:11.431 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:59:11.431 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:59:11.431 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:59:11.431 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:59:11.432 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:59:11.432 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:59:11.432 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:59:11.432 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:59:11.432 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:59:11.432 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:59:11.899 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-05-24T03:59:11.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-05-24T03:59:11.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-24T03:59:12.033 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-24T03:59:12.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:59:12.045 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:59:12.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-24T03:59:12.101 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:59:12.101 INFO:tasks.ceph:role: osd.6 2023-05-24T03:59:12.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T03:59:12.102 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-24T03:59:12.165 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:59:12.165 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:59:12.166 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:59:12.166 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:59:12.166 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:59:12.166 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:59:12.166 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:59:12.167 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:59:12.167 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:59:12.167 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:59:12.639 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-05-24T03:59:12.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-05-24T03:59:12.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-24T03:59:12.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-24T03:59:12.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:59:12.804 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:59:12.804 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-24T03:59:12.859 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:59:12.859 INFO:tasks.ceph:role: osd.7 2023-05-24T03:59:12.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T03:59:12.860 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-24T03:59:12.920 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:59:12.921 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:59:12.921 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:59:12.921 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:59:12.921 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:59:12.921 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:59:12.922 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:59:12.922 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:59:12.922 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:59:12.922 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:59:13.351 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-05-24T03:59:13.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-05-24T03:59:13.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-24T03:59:13.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-24T03:59:13.511 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2023-05-24T03:59:13.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:59:13.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:13.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:13.708+0000 7ff384182640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-24T03:59:13.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:13.708+0000 7ff384182640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-24T03:59:13.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:13.708+0000 7ff384182640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-24T03:59:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:13.708+0000 7ff384182640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-24T03:59:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:13.708+0000 7ff384182640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-24T03:59:13.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:13.716+0000 7ff384182640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-24T03:59:16.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-24T03:59:16.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:16.828+0000 7f9f41b5f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-24T03:59:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:16.828+0000 7f9f41b5f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-24T03:59:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:16.828+0000 7f9f41b5f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-24T03:59:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:16.828+0000 7f9f41b5f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-24T03:59:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:16.828+0000 7f9f41b5f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-24T03:59:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:16.828+0000 7f9f41b5f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-24T03:59:19.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-24T03:59:19.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:19.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:19.980+0000 7f353da9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-24T03:59:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:19.980+0000 7f353da9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-24T03:59:19.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:19.980+0000 7f353da9d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-24T03:59:19.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:19.980+0000 7f353da9d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-24T03:59:19.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:19.980+0000 7f353da9d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-24T03:59:19.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:19.980+0000 7f353da9d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-24T03:59:22.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:22.242 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:22.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:22.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:22.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:23.025 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-24T03:59:23.040 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:23.116+0000 7f64c631f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-24T03:59:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:23.116+0000 7f64c631f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-24T03:59:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:23.116+0000 7f64c631f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-24T03:59:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:23.116+0000 7f64c631f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-24T03:59:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:23.116+0000 7f64c631f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-24T03:59:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:23.116+0000 7f64c631f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-24T03:59:26.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-24T03:59:26.195 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-24T03:59:26.195 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:26.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-24T03:59:26.210 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:26.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-24T03:59:26.266 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:26.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-24T03:59:26.323 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:26.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-24T03:59:26.379 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:26.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-24T03:59:26.438 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:26.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-24T03:59:26.493 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:26.494 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-24T03:59:26.507 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:26.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-24T03:59:26.561 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:26.562 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-24T03:59:26.617 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:26.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-24T03:59:26.673 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:26.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-24T03:59:26.729 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:26.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-24T03:59:26.786 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T03:59:26.786 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-24T03:59:26.792 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T03:59:26.792 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-24T03:59:26.799 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T03:59:26.799 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-24T03:59:26.805 INFO:tasks.ceph:Adding keys to all mons... 2023-05-24T03:59:26.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-24T03:59:26.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-24T03:59:26.832 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-05-24T03:59:26.832 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB+i21k7oYDKxAAQLXR1LGmDc7xskKpfRrw1A== 2023-05-24T03:59:26.832 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-05-24T03:59:26.832 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB+i21kHhpjMRAA/nra1jlwqdgZ1/kmZFkoCA== 2023-05-24T03:59:26.833 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-05-24T03:59:26.833 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCCi21k3DdsCRAAnzO1KV5h7pzCMyRQoCRg3w== 2023-05-24T03:59:26.833 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-05-24T03:59:26.833 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFi21k1e3fEBAAd5YZVX8GpEJ6P06wdjSaAw== 2023-05-24T03:59:26.833 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-05-24T03:59:26.833 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCIi21kP8W5GRAAe6bvKOnsZO06w08bVvluKQ== 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCLi21kHrG9IxAAMF09+ZUr0X3bYk4mn01ztQ== 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB+i21khegYLhAAvhcxgS1BEOZM783K3CMyXg== 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB+i21kyOKoNxAACBI8a9wKN5VBJZGEEQ5qcQ== 2023-05-24T03:59:26.834 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCRi21kbIFmKhAA5pg7NHM583XWW2OKK9DzvA== 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCUi21k/IKNMRAA2byTX+MVh5163dVstXuJ9Q== 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCXi21kh2epOhAAAdSaLlaUdPyMFb2X2VTH1g== 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-05-24T03:59:26.835 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCbi21ktjsWBxAANzd8TPX9zIOfz0BH8wjLvw== 2023-05-24T03:59:26.836 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-05-24T03:59:26.836 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB/i21kv3TPARAANZWlH5fyBIamxLegUi8CFg== 2023-05-24T03:59:26.836 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-05-24T03:59:26.836 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB/i21kT0kaBRAAeEmMJG2T0aL8Og8UZdH69Q== 2023-05-24T03:59:26.836 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-05-24T03:59:26.836 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB/i21kxxCkCBAAfxJxq38bIPYWKUxilhFYLQ== 2023-05-24T03:59:26.840 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2023-05-24T03:59:26.840 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB+i21k7oYDKxAAQLXR1LGmDc7xskKpfRrw1A== 2023-05-24T03:59:26.840 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2023-05-24T03:59:26.840 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB+i21kHhpjMRAA/nra1jlwqdgZ1/kmZFkoCA== 2023-05-24T03:59:26.840 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2023-05-24T03:59:26.841 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCCi21k3DdsCRAAnzO1KV5h7pzCMyRQoCRg3w== 2023-05-24T03:59:26.841 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2023-05-24T03:59:26.841 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCFi21k1e3fEBAAd5YZVX8GpEJ6P06wdjSaAw== 2023-05-24T03:59:26.841 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2023-05-24T03:59:26.841 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCIi21kP8W5GRAAe6bvKOnsZO06w08bVvluKQ== 2023-05-24T03:59:26.841 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2023-05-24T03:59:26.842 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCLi21kHrG9IxAAMF09+ZUr0X3bYk4mn01ztQ== 2023-05-24T03:59:26.842 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2023-05-24T03:59:26.842 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB+i21khegYLhAAvhcxgS1BEOZM783K3CMyXg== 2023-05-24T03:59:26.842 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2023-05-24T03:59:26.842 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB+i21kyOKoNxAACBI8a9wKN5VBJZGEEQ5qcQ== 2023-05-24T03:59:26.843 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2023-05-24T03:59:26.843 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCRi21kbIFmKhAA5pg7NHM583XWW2OKK9DzvA== 2023-05-24T03:59:26.843 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2023-05-24T03:59:26.843 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCUi21k/IKNMRAA2byTX+MVh5163dVstXuJ9Q== 2023-05-24T03:59:26.843 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCXi21kh2epOhAAAdSaLlaUdPyMFb2X2VTH1g== 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCbi21ktjsWBxAANzd8TPX9zIOfz0BH8wjLvw== 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB/i21kv3TPARAANZWlH5fyBIamxLegUi8CFg== 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2023-05-24T03:59:26.844 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB/i21kT0kaBRAAeEmMJG2T0aL8Og8UZdH69Q== 2023-05-24T03:59:26.845 INFO:teuthology.orchestra.run.smithi067.stdout:[client.2] 2023-05-24T03:59:26.845 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB/i21kxxCkCBAAfxJxq38bIPYWKUxilhFYLQ== 2023-05-24T03:59:26.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:59:26.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:59:26.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:59:26.939 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:59:26.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:26.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.071 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.244 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:59:27.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:59:27.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:59:27.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:59:27.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.475 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.644 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:59:27.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:59:27.778 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:59:27.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:59:27.867 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:59:27.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:59:27.955 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:59:28.000 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-24T03:59:28.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-24T03:59:28.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-24T03:59:28.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-24T03:59:28.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-24T03:59:28.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-24T03:59:28.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-24T03:59:28.246 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-24T03:59:28.299 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-24T03:59:28.397 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-24T03:59:28.409 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:28.412 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:59:28.458 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-24T03:59:28.458 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-24T03:59:28.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-24T03:59:28.465 INFO:tasks.ceph.mon.a:Started 2023-05-24T03:59:28.465 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-24T03:59:28.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-24T03:59:28.503 INFO:tasks.ceph.mon.b:Started 2023-05-24T03:59:28.503 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-24T03:59:28.504 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-24T03:59:28.506 INFO:tasks.ceph.mon.c:Started 2023-05-24T03:59:28.506 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-24T03:59:28.507 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-24T03:59:28.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-24T03:59:28.509 INFO:tasks.ceph.mgr.y:Started 2023-05-24T03:59:28.510 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-24T03:59:28.510 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-24T03:59:28.513 INFO:tasks.ceph.mgr.x:Started 2023-05-24T03:59:28.513 INFO:tasks.ceph:Setting crush tunables to default 2023-05-24T03:59:28.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-05-24T03:59:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.621+0000 7fd640533640 1 Processor -- start 2023-05-24T03:59:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.621+0000 7fd640533640 1 -- start start 2023-05-24T03:59:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd640533640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd640533640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd640533640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380b7e80 con 0x7fd6380bf010 2023-05-24T03:59:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd640533640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380a3890 con 0x7fd6380a3df0 2023-05-24T03:59:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd640533640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380bb560 con 0x7fd6380c3f60 2023-05-24T03:59:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37746/0 (socket says 172.21.15.40:37746) 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63e2cf640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6380bf010 0x7fd6380c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54382/0 (socket says 172.21.15.40:54382) 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 learned_addr learned my addr 172.21.15.40:0/540319408 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-24T03:59:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:28.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-24T03:59:28.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:28.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:28.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.625+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-24T03:59:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-24T03:59:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-24T03:59:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:28.825+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-24T03:59:29.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:29.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:29.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:29.225+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-24T03:59:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-24T03:59:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:30.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:30.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:30.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:30.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-24T03:59:30.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:30.029+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-24T03:59:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 msgr2=0x7fd638152340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:59:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6380c3f60 0x7fd638152340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 msgr2=0x7fd6380c2660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.40:3300/0 conn(0x7fd6380a3df0 0x7fd6380c2660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 -- 172.21.15.40:0/540319408 >> v1:172.21.15.40:6789/0 conn(0x7fd6380bf010 legacy=0x7fd6380c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 -- 172.21.15.40:0/540319408 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380c34c0 con 0x7fd61c0036d0 2023-05-24T03:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd62ffff640 1 -- 172.21.15.40:0/540319408 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380a3890 con 0x7fd61c007370 2023-05-24T03:59:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.625+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-24T03:59:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.825+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.825+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.825+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.825+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:31.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:31.825+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-24T03:59:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:32.229+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:32.229+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:32.229+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:32.229+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:32.229+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-24T03:59:33.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.029+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.029+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:59:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.029+0000 7fd63dace640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:59:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.029+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:59:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.029+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-24T03:59:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.905+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508909038 0 0) 0x7fd6380c34c0 con 0x7fd61c0036d0 2023-05-24T03:59:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.905+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd624003530 con 0x7fd61c0036d0 2023-05-24T03:59:33.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537025162 0 0) 0x7fd624003530 con 0x7fd61c0036d0 2023-05-24T03:59:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 msgr2=0x7fd61c009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:59:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 --2- 172.21.15.40:0/540319408 >> v2:172.21.15.67:3300/0 conn(0x7fd61c007370 0x7fd61c009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c00af10 con 0x7fd61c0036d0 2023-05-24T03:59:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fd634001700 con 0x7fd61c0036d0 2023-05-24T03:59:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 >> v1:172.21.15.67:6789/0 conn(0x7fd61c0036d0 legacy=0x7fd61c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 reap_dead start 2023-05-24T03:59:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd624003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd624004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd62400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380a3890 con 0x7fd624005380 2023-05-24T03:59:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62400c220 con 0x7fd6240047d0 2023-05-24T03:59:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62400c3e0 con 0x7fd6240039d0 2023-05-24T03:59:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63e2cf640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd624003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd62400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.913+0000 7fd63dace640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd624004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.917+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 msgr2=0x7fd624003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.917+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd624003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.917+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 msgr2=0x7fd624004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.917+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd624004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.917+0000 7fd63ead0640 1 -- 172.21.15.40:0/540319408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624003530 con 0x7fd624005380 2023-05-24T03:59:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.921+0000 7fd63ead0640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd62400b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6380c4330 tx=0x7fd63001d0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9916a38056386d38 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.921+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300a5820 con 0x7fd624005380 2023-05-24T03:59:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.921+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6300a9070 con 0x7fd624005380 2023-05-24T03:59:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.921+0000 7fd63d2cd640 1 -- 172.21.15.40:0/540319408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300a5be0 con 0x7fd624005380 2023-05-24T03:59:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- 172.21.15.40:0/540319408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 msgr2=0x7fd62400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd62400b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6380c4330 tx=0x7fd63001d0f0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- 172.21.15.40:0/540319408 shutdown_connections 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd62400b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd624004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- 172.21.15.40:0/540319408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd624003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- 172.21.15.40:0/540319408 >> 172.21.15.40:0/540319408 conn(0x7fd6380a62d0 msgr2=0x7fd6380a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- 172.21.15.40:0/540319408 shutdown_connections 2023-05-24T03:59:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- 172.21.15.40:0/540319408 wait complete. 2023-05-24T03:59:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 Processor -- start 2023-05-24T03:59:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- start start 2023-05-24T03:59:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd6381da510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd6380bda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd6381e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380be540 con 0x7fd624005380 2023-05-24T03:59:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd638147f50 con 0x7fd6240047d0 2023-05-24T03:59:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd640533640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381daa50 con 0x7fd6240039d0 2023-05-24T03:59:33.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63e2cf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd6381da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:33.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd6380bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:33.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd6380bda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:33656/0 (socket says 172.21.15.40:33656) 2023-05-24T03:59:33.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63e2cf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd6381da510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58984/0 (socket says 172.21.15.40:58984) 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 -- 172.21.15.40:0/1844385605 learned_addr learned my addr 172.21.15.40:0/1844385605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 -- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 msgr2=0x7fd6381da510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd6381da510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 -- 172.21.15.40:0/1844385605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 msgr2=0x7fd6381e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd6381e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.925+0000 7fd63dace640 1 -- 172.21.15.40:0/1844385605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380bf570 con 0x7fd6240047d0 2023-05-24T03:59:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd63dace640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd6380bda00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd628016a20 tx=0x7fd628016e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:33.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62801e050 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62801f040 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6380bf3e0 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628023400 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6380c2d40 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd628005ca0 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd628023560 con 0x7fd6240047d0 2023-05-24T03:59:33.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.929+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd638066d70 con 0x7fd6240047d0 2023-05-24T03:59:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:33.945+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd628027020 con 0x7fd6240047d0 2023-05-24T03:59:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.009+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd638148260 con 0x7fd6240047d0 2023-05-24T03:59:34.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd62effd640 1 -- 172.21.15.40:0/1844385605 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd628039090 con 0x7fd6240047d0 2023-05-24T03:59:34.027 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-05-24T03:59:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 msgr2=0x7fd6380bda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd6380bda00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd628016a20 tx=0x7fd628016e20 comp rx=0 tx=0).stop 2023-05-24T03:59:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 shutdown_connections 2023-05-24T03:59:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624005380 0x7fd6381e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6240047d0 0x7fd6380bda00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 --2- 172.21.15.40:0/1844385605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6240039d0 0x7fd6381da510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 >> 172.21.15.40:0/1844385605 conn(0x7fd6380a62d0 msgr2=0x7fd63806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 shutdown_connections 2023-05-24T03:59:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:34.021+0000 7fd640533640 1 -- 172.21.15.40:0/1844385605 wait complete. 2023-05-24T03:59:34.047 INFO:tasks.ceph:check_enable_crimson: False 2023-05-24T03:59:34.048 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-24T03:59:34.048 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:34.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-24T03:59:34.061 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:34.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-24T03:59:34.113 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:34.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-24T03:59:34.118 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:34.109+0000 7f7d52a25180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-24T03:59:34.132 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-24T03:59:34.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-24T03:59:34.184 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:34.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-24T03:59:34.199 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:34.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-24T03:59:34.201 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:34.191+0000 7ff565390180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-24T03:59:34.214 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:34.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-24T03:59:34.270 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-05-24T03:59:34.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-24T03:59:34.324 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 07f79ba9-4652-40ca-9fb6-e5c3594a9a86 0 2023-05-24T03:59:34.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.479+0000 7fb390e98640 1 Processor -- start 2023-05-24T03:59:34.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.479+0000 7fb390e98640 1 -- start start 2023-05-24T03:59:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb390e98640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb38c14fa50 0x7fb38c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb390e98640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb38c0b5ad0 0x7fb38c14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb390e98640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c0a65c0 con 0x7fb38c0a5e70 2023-05-24T03:59:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb390e98640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c150200 con 0x7fb38c14fa50 2023-05-24T03:59:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb390e98640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c150690 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb389d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb38c0a5e70 0x7fb38c06d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32872/0 (socket says 172.21.15.67:32872) 2023-05-24T03:59:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb389d9b640 1 -- 172.21.15.67:0/3106954795 learned_addr learned my addr 172.21.15.67:0/3106954795 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-05-24T03:59:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb38c0b5ad0 0x7fb38c14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38a59c640 1 --2- 172.21.15.67:0/3106954795 >> v2:172.21.15.40:3300/0 conn(0x7fb38c14fa50 0x7fb38c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38ad9d640 1 -- 172.21.15.67:0/3106954795 >> v2:172.21.15.40:3300/0 conn(0x7fb38c14fa50 msgr2=0x7fb38c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38ad9d640 1 --2- 172.21.15.67:0/3106954795 >> v2:172.21.15.40:3300/0 conn(0x7fb38c14fa50 0x7fb38c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38ad9d640 1 -- 172.21.15.67:0/3106954795 >> v1:172.21.15.67:6789/0 conn(0x7fb38c0a5e70 legacy=0x7fb38c06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38ad9d640 1 -- 172.21.15.67:0/3106954795 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c0a6810 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38ad9d640 1 --2- 172.21.15.67:0/3106954795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14c7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0725a0 tx=0x7fb38401c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89d588629c862ce6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38959a640 1 -- 172.21.15.67:0/3106954795 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a58a0 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38959a640 1 -- 172.21.15.67:0/3106954795 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840a5a00 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.483+0000 7fb38959a640 1 -- 172.21.15.67:0/3106954795 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a5d90 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/3106954795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 msgr2=0x7fb38c14c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 --2- 172.21.15.67:0/3106954795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14c7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0725a0 tx=0x7fb38401c7c0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/3106954795 shutdown_connections 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 --2- 172.21.15.67:0/3106954795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14c7e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 --2- 172.21.15.67:0/3106954795 >> v2:172.21.15.40:3300/0 conn(0x7fb38c14fa50 0x7fb38c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/3106954795 >> 172.21.15.67:0/3106954795 conn(0x7fb38c0c0ba0 msgr2=0x7fb38c0c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/3106954795 shutdown_connections 2023-05-24T03:59:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/3106954795 wait complete. 2023-05-24T03:59:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 Processor -- start 2023-05-24T03:59:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- start start 2023-05-24T03:59:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38c0a5e70 0x7fb38c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 0x7fb38c14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c14df30 con 0x7fb38c0a5e70 2023-05-24T03:59:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c14e890 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c143720 con 0x7fb38c14fa50 2023-05-24T03:59:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 0x7fb38c14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 0x7fb38c14f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:47192/0 (socket says 172.21.15.67:47192) 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb38ad9d640 1 -- 172.21.15.67:0/1261214094 learned_addr learned my addr 172.21.15.67:0/1261214094 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb38a59c640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38c0a5e70 0x7fb38c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 -- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 msgr2=0x7fb38c14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 0x7fb38c14f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 -- 172.21.15.67:0/1261214094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38c0a5e70 msgr2=0x7fb38c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38c0a5e70 0x7fb38c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 -- 172.21.15.67:0/1261214094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009a70 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb38ad9d640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 0x7fb38c14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb389d9b640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14ed50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00c430 tx=0x7fb37c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c005cf0 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c005e50 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c158d20 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0072d0 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c158b90 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb37c01c440 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.487+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb37c012740 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.491+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c158eb0 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.491+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb37c021060 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.559+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07f79ba9-4652-40ca-9fb6-e5c3594a9a86", "id": 0} v 0) v1 -- 0x7fb38c066d70 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb37affd640 1 -- 172.21.15.67:0/1261214094 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07f79ba9-4652-40ca-9fb6-e5c3594a9a86", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb37c017070 con 0x7fb38c0b5ad0 2023-05-24T03:59:34.577 INFO:teuthology.orchestra.run.smithi067.stdout:0 2023-05-24T03:59:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 msgr2=0x7fb38c14ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14ed50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00c430 tx=0x7fb37c00c8f0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 shutdown_connections 2023-05-24T03:59:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb38c14fa50 0x7fb38c14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb38c0b5ad0 0x7fb38c14ed50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 --2- 172.21.15.67:0/1261214094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38c0a5e70 0x7fb38c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 >> 172.21.15.67:0/1261214094 conn(0x7fb38c0c0ba0 msgr2=0x7fb38c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:34.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 shutdown_connections 2023-05-24T03:59:34.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.567+0000 7fb390e98640 1 -- 172.21.15.67:0/1261214094 wait complete. 2023-05-24T03:59:34.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 88b786d3-420d-4f2a-a401-6ec91808f9c0 1 2023-05-24T03:59:34.621 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:34.613+0000 7f7d52a25180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-24T03:59:34.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f16ac7640 1 Processor -- start 2023-05-24T03:59:34.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f16ac7640 1 -- start start 2023-05-24T03:59:34.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f16ac7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7f10071900 0x7f7f1014f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f16ac7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1006a570 con 0x7f7f100a6a20 2023-05-24T03:59:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f16ac7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1006a830 con 0x7f7f10069c40 2023-05-24T03:59:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f16ac7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1014fdb0 con 0x7f7f10071900 2023-05-24T03:59:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f14863640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7f10069c40 0x7f7f10070bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32886/0 (socket says 172.21.15.67:32886) 2023-05-24T03:59:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f0ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7f10071900 0x7f7f1014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f14863640 1 -- 172.21.15.67:0/3506482640 learned_addr learned my addr 172.21.15.67:0/3506482640 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-05-24T03:59:34.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f0ffff640 1 -- 172.21.15.67:0/3506482640 >> v1:172.21.15.67:6789/0 conn(0x7f7f10069c40 legacy=0x7f7f10070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f0ffff640 1 -- 172.21.15.67:0/3506482640 >> v1:172.21.15.40:6789/0 conn(0x7f7f100a6a20 legacy=0x7f7f1014b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.715+0000 7f7f0ffff640 1 -- 172.21.15.67:0/3506482640 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100a7130 con 0x7f7f10071900 2023-05-24T03:59:34.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f0ffff640 1 --2- 172.21.15.67:0/3506482640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f10071900 0x7f7f1014f870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097c0 tx=0x7f7f0801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d6f4b5435b9ccd6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:34.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f0f7fe640 1 -- 172.21.15.67:0/3506482640 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f080a8050 con 0x7f7f10071900 2023-05-24T03:59:34.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f0f7fe640 1 -- 172.21.15.67:0/3506482640 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f080ac5f0 con 0x7f7f10071900 2023-05-24T03:59:34.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f0f7fe640 1 -- 172.21.15.67:0/3506482640 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f080ac980 con 0x7f7f10071900 2023-05-24T03:59:34.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 -- 172.21.15.67:0/3506482640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f10071900 msgr2=0x7f7f1014f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 --2- 172.21.15.67:0/3506482640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f10071900 0x7f7f1014f870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097c0 tx=0x7f7f0801c480 comp rx=0 tx=0).stop 2023-05-24T03:59:34.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 -- 172.21.15.67:0/3506482640 shutdown_connections 2023-05-24T03:59:34.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 --2- 172.21.15.67:0/3506482640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f10071900 0x7f7f1014f870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 -- 172.21.15.67:0/3506482640 >> 172.21.15.67:0/3506482640 conn(0x7f7f100c1420 msgr2=0x7f7f100c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:34.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 -- 172.21.15.67:0/3506482640 shutdown_connections 2023-05-24T03:59:34.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.719+0000 7f7f16ac7640 1 -- 172.21.15.67:0/3506482640 wait complete. 2023-05-24T03:59:34.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 Processor -- start 2023-05-24T03:59:34.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- start start 2023-05-24T03:59:34.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f10069c40 0x7f7f100c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7f10071900 0x7f7f1014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 0x7f7f1014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101409b0 con 0x7f7f10069c40 2023-05-24T03:59:34.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101e8390 con 0x7f7f100a6a20 2023-05-24T03:59:34.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101e8820 con 0x7f7f10071900 2023-05-24T03:59:34.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 0x7f7f1014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 0x7f7f1014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50668/0 (socket says 172.21.15.67:50668) 2023-05-24T03:59:34.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 -- 172.21.15.67:0/1935369906 learned_addr learned my addr 172.21.15.67:0/1935369906 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:34.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f0ffff640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7f10071900 0x7f7f1014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f14863640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f10069c40 0x7f7f100c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 -- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7f10071900 msgr2=0x7f7f1014d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7f10071900 0x7f7f1014d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 -- 172.21.15.67:0/1935369906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f10069c40 msgr2=0x7f7f100c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f10069c40 0x7f7f100c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 -- 172.21.15.67:0/1935369906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009420 con 0x7f7f100a6a20 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f15064640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 0x7f7f1014dbb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800c430 tx=0x7f7ef800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8005220 con 0x7f7f100a6a20 2023-05-24T03:59:34.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8005380 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8007270 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1006a1a0 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1006a010 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ef80067e0 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7ef80039a0 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.723+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f100bb6a0 con 0x7f7f100a6a20 2023-05-24T03:59:34.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.727+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f7ef8006cc0 con 0x7f7f100a6a20 2023-05-24T03:59:34.744 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:34.735+0000 7ff565390180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-24T03:59:34.795 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:34.789+0000 7f7d52a25180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-24T03:59:34.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.795+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88b786d3-420d-4f2a-a401-6ec91808f9c0", "id": 1} v 0) v1 -- 0x7f7f100a49e0 con 0x7f7f100a6a20 2023-05-24T03:59:34.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f0d7fa640 1 -- 172.21.15.67:0/1935369906 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88b786d3-420d-4f2a-a401-6ec91808f9c0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ef8006e60 con 0x7f7f100a6a20 2023-05-24T03:59:34.812 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-05-24T03:59:34.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 msgr2=0x7f7f1014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 0x7f7f1014dbb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800c430 tx=0x7f7ef800c8f0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 shutdown_connections 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f100a6a20 0x7f7f1014dbb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7f10071900 0x7f7f1014d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 --2- 172.21.15.67:0/1935369906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f10069c40 0x7f7f100c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 >> 172.21.15.67:0/1935369906 conn(0x7f7f100c1420 msgr2=0x7f7f10144840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.803+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 shutdown_connections 2023-05-24T03:59:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.807+0000 7f7f16ac7640 1 -- 172.21.15.67:0/1935369906 wait complete. 2023-05-24T03:59:34.830 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new d456057f-180d-405d-a43d-d38f2db0a0fb 2 2023-05-24T03:59:34.935 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:34.927+0000 7ff565390180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-24T03:59:34.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.947+0000 7fe2ab147640 1 Processor -- start 2023-05-24T03:59:34.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.947+0000 7fe2ab147640 1 -- start start 2023-05-24T03:59:34.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2ab147640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe2a40a3d30 0x7fe2a40bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2ab147640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2a40a6bb0 0x7fe2a414a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2ab147640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a4070f60 con 0x7fe2a406cf40 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2ab147640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a40bbfc0 con 0x7fe2a40a6bb0 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2ab147640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a40a73e0 con 0x7fe2a40a3d30 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe2a40a3d30 0x7fe2a40bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe2a40a3d30 0x7fe2a40bba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50684/0 (socket says 172.21.15.67:50684) 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 -- 172.21.15.67:0/1775065320 learned_addr learned my addr 172.21.15.67:0/1775065320 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a96e4640 1 --2- 172.21.15.67:0/1775065320 >> v2:172.21.15.40:3300/0 conn(0x7fe2a40a6bb0 0x7fe2a414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 -- 172.21.15.67:0/1775065320 >> v2:172.21.15.40:3300/0 conn(0x7fe2a40a6bb0 msgr2=0x7fe2a414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:34.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 --2- 172.21.15.67:0/1775065320 >> v2:172.21.15.40:3300/0 conn(0x7fe2a40a6bb0 0x7fe2a414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 -- 172.21.15.67:0/1775065320 >> v1:172.21.15.40:6789/0 conn(0x7fe2a406cf40 legacy=0x7fe2a40bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 -- 172.21.15.67:0/1775065320 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40a7100 con 0x7fe2a40a3d30 2023-05-24T03:59:34.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a96e4640 1 --2- 172.21.15.67:0/1775065320 >> v2:172.21.15.40:3300/0 conn(0x7fe2a40a6bb0 0x7fe2a414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:34.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a3fff640 1 --2- 172.21.15.67:0/1775065320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a40a3d30 0x7fe2a40bba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406f470 tx=0x7fe29001ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a242c7cd138e5be3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a37fe640 1 -- 172.21.15.67:0/1775065320 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a7960 con 0x7fe2a40a3d30 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a37fe640 1 -- 172.21.15.67:0/1775065320 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2900a7ac0 con 0x7fe2a40a3d30 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.951+0000 7fe2a37fe640 1 -- 172.21.15.67:0/1775065320 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a7e50 con 0x7fe2a40a3d30 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/1775065320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a40a3d30 msgr2=0x7fe2a40bba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 --2- 172.21.15.67:0/1775065320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a40a3d30 0x7fe2a40bba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406f470 tx=0x7fe29001ea80 comp rx=0 tx=0).stop 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/1775065320 shutdown_connections 2023-05-24T03:59:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 --2- 172.21.15.67:0/1775065320 >> v2:172.21.15.40:3300/0 conn(0x7fe2a40a6bb0 0x7fe2a414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 --2- 172.21.15.67:0/1775065320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a40a3d30 0x7fe2a40bba80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/1775065320 >> 172.21.15.67:0/1775065320 conn(0x7fe2a406b780 msgr2=0x7fe2a40c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/1775065320 shutdown_connections 2023-05-24T03:59:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/1775065320 wait complete. 2023-05-24T03:59:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 Processor -- start 2023-05-24T03:59:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- start start 2023-05-24T03:59:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 0x7fe2a4149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2a40a3d30 0x7fe2a4142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40a6bb0 0x7fe2a41e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a414eab0 con 0x7fe2a40a6bb0 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a414cbf0 con 0x7fe2a406cf40 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a40c0ec0 con 0x7fe2a40a3d30 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 0x7fe2a4149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a3fff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2a40a3d30 0x7fe2a4142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 0x7fe2a4149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50686/0 (socket says 172.21.15.67:50686) 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 -- 172.21.15.67:0/669247091 learned_addr learned my addr 172.21.15.67:0/669247091 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a96e4640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40a6bb0 0x7fe2a41e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 -- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2a40a3d30 msgr2=0x7fe2a4142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2a40a3d30 0x7fe2a4142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 -- 172.21.15.67:0/669247091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40a6bb0 msgr2=0x7fe2a41e9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40a6bb0 0x7fe2a41e9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 -- 172.21.15.67:0/669247091 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29000b770 con 0x7fe2a406cf40 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a96e4640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40a6bb0 0x7fe2a41e9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a8ee3640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 0x7fe2a4149650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c3c0 tx=0x7fe29800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980052d0 con 0x7fe2a406cf40 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298005430 con 0x7fe2a406cf40 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a406d4a0 con 0x7fe2a406cf40 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298003840 con 0x7fe2a406cf40 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a406d310 con 0x7fe2a406cf40 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe298003ca0 con 0x7fe2a406cf40 2023-05-24T03:59:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.955+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe298012840 con 0x7fe2a406cf40 2023-05-24T03:59:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.959+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a414f730 con 0x7fe2a406cf40 2023-05-24T03:59:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:34.959+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe298017070 con 0x7fe2a406cf40 2023-05-24T03:59:35.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.027+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d456057f-180d-405d-a43d-d38f2db0a0fb", "id": 2} v 0) v1 -- 0x7fe2a4066d70 con 0x7fe2a406cf40 2023-05-24T03:59:35.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2a17fa640 1 -- 172.21.15.67:0/669247091 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d456057f-180d-405d-a43d-d38f2db0a0fb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe298012420 con 0x7fe2a406cf40 2023-05-24T03:59:35.044 INFO:teuthology.orchestra.run.smithi067.stdout:2 2023-05-24T03:59:35.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 msgr2=0x7fe2a4149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 0x7fe2a4149650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c3c0 tx=0x7fe29800c880 comp rx=0 tx=0).stop 2023-05-24T03:59:35.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 shutdown_connections 2023-05-24T03:59:35.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40a6bb0 0x7fe2a41e9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2a40a3d30 0x7fe2a4142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 --2- 172.21.15.67:0/669247091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a406cf40 0x7fe2a4149650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 >> 172.21.15.67:0/669247091 conn(0x7fe2a406b780 msgr2=0x7fe2a40a63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 shutdown_connections 2023-05-24T03:59:35.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.035+0000 7fe2ab147640 1 -- 172.21.15.67:0/669247091 wait complete. 2023-05-24T03:59:35.060 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 0fd91af4-47a7-49b0-88cf-a41728c7ecfe 3 2023-05-24T03:59:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.167+0000 7fdefabda640 1 Processor -- start 2023-05-24T03:59:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.167+0000 7fdefabda640 1 -- start start 2023-05-24T03:59:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdefabda640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdef40bce80 0x7fdef40bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdefabda640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef40bc110 con 0x7fdef40bd3d0 2023-05-24T03:59:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdefabda640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef40bd8f0 con 0x7fdef4152790 2023-05-24T03:59:35.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdefabda640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef40a3e60 con 0x7fdef40bce80 2023-05-24T03:59:35.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdef40bce80 0x7fdef40bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdef40bce80 0x7fdef40bc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50694/0 (socket says 172.21.15.67:50694) 2023-05-24T03:59:35.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 -- 172.21.15.67:0/912093138 learned_addr learned my addr 172.21.15.67:0/912093138 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef8976640 1 --1- 172.21.15.67:0/912093138 >> v1:172.21.15.67:6789/0 conn(0x7fdef4152790 0x7fdef40699e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32892/0 (socket says 172.21.15.67:32892) 2023-05-24T03:59:35.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 -- 172.21.15.67:0/912093138 >> v1:172.21.15.67:6789/0 conn(0x7fdef4152790 legacy=0x7fdef40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 -- 172.21.15.67:0/912093138 >> v1:172.21.15.40:6789/0 conn(0x7fdef40bd3d0 legacy=0x7fdef4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 -- 172.21.15.67:0/912093138 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40bc3b0 con 0x7fdef40bce80 2023-05-24T03:59:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef9177640 1 --2- 172.21.15.67:0/912093138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef40bce80 0x7fdef40bc8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afa73c255a457d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef37fe640 1 -- 172.21.15.67:0/912093138 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80ab5f0 con 0x7fdef40bce80 2023-05-24T03:59:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef37fe640 1 -- 172.21.15.67:0/912093138 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80ab750 con 0x7fdef40bce80 2023-05-24T03:59:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdef37fe640 1 -- 172.21.15.67:0/912093138 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80abae0 con 0x7fdef40bce80 2023-05-24T03:59:35.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdefabda640 1 -- 172.21.15.67:0/912093138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef40bce80 msgr2=0x7fdef40bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.171+0000 7fdefabda640 1 --2- 172.21.15.67:0/912093138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef40bce80 0x7fdef40bc8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee801c4e0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/912093138 shutdown_connections 2023-05-24T03:59:35.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 --2- 172.21.15.67:0/912093138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef40bce80 0x7fdef40bc8d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/912093138 >> 172.21.15.67:0/912093138 conn(0x7fdef406b780 msgr2=0x7fdef40c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/912093138 shutdown_connections 2023-05-24T03:59:35.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/912093138 wait complete. 2023-05-24T03:59:35.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 Processor -- start 2023-05-24T03:59:35.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- start start 2023-05-24T03:59:35.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 0x7fdef41ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef40bd3d0 0x7fdef40be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef4152790 0x7fdef414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40a4420 con 0x7fdef40bd3d0 2023-05-24T03:59:35.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40a4c30 con 0x7fdef4152790 2023-05-24T03:59:35.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef41efc20 con 0x7fdef40bce80 2023-05-24T03:59:35.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef8976640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 0x7fdef41ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef4152790 0x7fdef414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef8976640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 0x7fdef41ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:47220/0 (socket says 172.21.15.67:47220) 2023-05-24T03:59:35.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef8976640 1 -- 172.21.15.67:0/3982112618 learned_addr learned my addr 172.21.15.67:0/3982112618 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef3fff640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef40bd3d0 0x7fdef40be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 -- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 msgr2=0x7fdef41ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 0x7fdef41ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 -- 172.21.15.67:0/3982112618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef40bd3d0 msgr2=0x7fdef40be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef40bd3d0 0x7fdef40be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 -- 172.21.15.67:0/3982112618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80094d0 con 0x7fdef4152790 2023-05-24T03:59:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef8976640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 0x7fdef41ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:59:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef3fff640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef40bd3d0 0x7fdef40be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef9177640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef4152790 0x7fdef414c5f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdee80ac000 tx=0x7fdee801ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80b4800 con 0x7fdef4152790 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80b49a0 con 0x7fdef4152790 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef4160e20 con 0x7fdef4152790 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80b4d50 con 0x7fdef4152790 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef4160c90 con 0x7fdef4152790 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdee80be730 con 0x7fdef4152790 2023-05-24T03:59:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdee80a8050 con 0x7fdef4152790 2023-05-24T03:59:35.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.175+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef4160fb0 con 0x7fdef4152790 2023-05-24T03:59:35.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.179+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fdee80c73f0 con 0x7fdef4152790 2023-05-24T03:59:35.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.247+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fd91af4-47a7-49b0-88cf-a41728c7ecfe", "id": 3} v 0) v1 -- 0x7fdef414f760 con 0x7fdef4152790 2023-05-24T03:59:35.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdef17fa640 1 -- 172.21.15.67:0/3982112618 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fd91af4-47a7-49b0-88cf-a41728c7ecfe", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdee80c7650 con 0x7fdef4152790 2023-05-24T03:59:35.264 INFO:teuthology.orchestra.run.smithi067.stdout:3 2023-05-24T03:59:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef4152790 msgr2=0x7fdef414c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef4152790 0x7fdef414c5f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdee80ac000 tx=0x7fdee801ad80 comp rx=0 tx=0).stop 2023-05-24T03:59:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 shutdown_connections 2023-05-24T03:59:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdef4152790 0x7fdef414c5f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef40bd3d0 0x7fdef40be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 --2- 172.21.15.67:0/3982112618 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdef40bce80 0x7fdef41ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 >> 172.21.15.67:0/3982112618 conn(0x7fdef406b780 msgr2=0x7fdef40699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 shutdown_connections 2023-05-24T03:59:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.255+0000 7fdefabda640 1 -- 172.21.15.67:0/3982112618 wait complete. 2023-05-24T03:59:35.280 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 56383a5a-4fea-40d0-9db1-1e4e2eff987b 4 2023-05-24T03:59:35.380 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.373+0000 7f7d52a25180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-24T03:59:35.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.387+0000 7f390eeaf640 1 Processor -- start 2023-05-24T03:59:35.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.387+0000 7f390eeaf640 1 -- start start 2023-05-24T03:59:35.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.387+0000 7f390eeaf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39080a6bb0 0x7f390814af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.387+0000 7f390eeaf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3908070f60 con 0x7f39080a3d30 2023-05-24T03:59:35.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390eeaf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080a73e0 con 0x7f390806cf40 2023-05-24T03:59:35.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390eeaf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39080a7100 con 0x7f39080a6bb0 2023-05-24T03:59:35.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390cc4b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f390806cf40 0x7f39080bce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32896/0 (socket says 172.21.15.67:32896) 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390cc4b640 1 -- 172.21.15.67:0/2972121233 learned_addr learned my addr 172.21.15.67:0/2972121233 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390d44c640 1 --2- 172.21.15.67:0/2972121233 >> v2:172.21.15.40:3300/0 conn(0x7f39080a6bb0 0x7f390814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f39077fe640 1 -- 172.21.15.67:0/2972121233 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476808252 0 0) 0x7f39080a73e0 con 0x7f390806cf40 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f39077fe640 1 -- 172.21.15.67:0/2972121233 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f0003530 con 0x7f390806cf40 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f39077fe640 1 -- 172.21.15.67:0/2972121233 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1813393662 0 0) 0x7f38f0003530 con 0x7f390806cf40 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390d44c640 1 -- 172.21.15.67:0/2972121233 >> v1:172.21.15.67:6789/0 conn(0x7f390806cf40 legacy=0x7f39080bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390d44c640 1 -- 172.21.15.67:0/2972121233 >> v1:172.21.15.40:6789/0 conn(0x7f39080a3d30 legacy=0x7f390814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390d44c640 1 -- 172.21.15.67:0/2972121233 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3908070c80 con 0x7f39080a6bb0 2023-05-24T03:59:35.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390d44c640 1 --2- 172.21.15.67:0/2972121233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39080a6bb0 0x7f390814af10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3900009d90 tx=0x7f390001c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0ffe9057e7497f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f39077fe640 1 -- 172.21.15.67:0/2972121233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8001680 con 0x7f39080a6bb0 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f39077fe640 1 -- 172.21.15.67:0/2972121233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000a55d0 con 0x7f39080a6bb0 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f39077fe640 1 -- 172.21.15.67:0/2972121233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000a5960 con 0x7f39080a6bb0 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390eeaf640 1 -- 172.21.15.67:0/2972121233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39080a6bb0 msgr2=0x7f390814af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.391+0000 7f390eeaf640 1 --2- 172.21.15.67:0/2972121233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39080a6bb0 0x7f390814af10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3900009d90 tx=0x7f390001c770 comp rx=0 tx=0).stop 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- 172.21.15.67:0/2972121233 shutdown_connections 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 --2- 172.21.15.67:0/2972121233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39080a6bb0 0x7f390814af10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- 172.21.15.67:0/2972121233 >> 172.21.15.67:0/2972121233 conn(0x7f390806b780 msgr2=0x7f39080c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- 172.21.15.67:0/2972121233 shutdown_connections 2023-05-24T03:59:35.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- 172.21.15.67:0/2972121233 wait complete. 2023-05-24T03:59:35.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 Processor -- start 2023-05-24T03:59:35.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- start start 2023-05-24T03:59:35.405 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390806cf40 0x7f39081386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.405 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39080a3d30 0x7f39080c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.405 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 0x7f390813f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.405 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39081e7530 con 0x7f390806cf40 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39080bf620 con 0x7f39080a3d30 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3908138c30 con 0x7f39080a6bb0 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 0x7f390813f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f3907fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39080a3d30 0x7f39080c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 0x7f390813f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:47226/0 (socket says 172.21.15.67:47226) 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 -- 172.21.15.67:0/3284757898 learned_addr learned my addr 172.21.15.67:0/3284757898 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390cc4b640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390806cf40 0x7f39081386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 -- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39080a3d30 msgr2=0x7f39080c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39080a3d30 0x7f39080c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 -- 172.21.15.67:0/3284757898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390806cf40 msgr2=0x7f39081386f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390806cf40 0x7f39081386f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 -- 172.21.15.67:0/3284757898 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900009a70 con 0x7f39080a6bb0 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390d44c640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 0x7f390813f270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39000b0040 tx=0x7f3900019510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900003ba0 con 0x7f39080a6bb0 2023-05-24T03:59:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900003d20 con 0x7f39080a6bb0 2023-05-24T03:59:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390814f8c0 con 0x7f39080a6bb0 2023-05-24T03:59:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000ad890 con 0x7f39080a6bb0 2023-05-24T03:59:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.395+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390814f730 con 0x7f39080a6bb0 2023-05-24T03:59:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.399+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f39000b4050 con 0x7f39080a6bb0 2023-05-24T03:59:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.399+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f39000b7410 con 0x7f39080a6bb0 2023-05-24T03:59:35.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.399+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3908159570 con 0x7f39080a6bb0 2023-05-24T03:59:35.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.403+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f39000e0b10 con 0x7f39080a6bb0 2023-05-24T03:59:35.438 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.429+0000 7f7d52a25180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-24T03:59:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.471+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56383a5a-4fea-40d0-9db1-1e4e2eff987b", "id": 4} v 0) v1 -- 0x7f39081e76a0 con 0x7f39080a6bb0 2023-05-24T03:59:35.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f39057fa640 1 -- 172.21.15.67:0/3284757898 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56383a5a-4fea-40d0-9db1-1e4e2eff987b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39000cf030 con 0x7f39080a6bb0 2023-05-24T03:59:35.486 INFO:teuthology.orchestra.run.smithi067.stdout:4 2023-05-24T03:59:35.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 msgr2=0x7f390813f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 0x7f390813f270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39000b0040 tx=0x7f3900019510 comp rx=0 tx=0).stop 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 shutdown_connections 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39080a6bb0 0x7f390813f270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39080a3d30 0x7f39080c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 --2- 172.21.15.67:0/3284757898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390806cf40 0x7f39081386f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 >> 172.21.15.67:0/3284757898 conn(0x7f390806b780 msgr2=0x7f390814a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 shutdown_connections 2023-05-24T03:59:35.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.479+0000 7f390eeaf640 1 -- 172.21.15.67:0/3284757898 wait complete. 2023-05-24T03:59:35.493 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.485+0000 7f7d52a25180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-24T03:59:35.503 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 1e1eb7a6-f682-4a7d-8806-dd6d7e004154 5 2023-05-24T03:59:35.538 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.531+0000 7ff565390180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-24T03:59:35.574 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.569+0000 7f7d52a25180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-24T03:59:35.596 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.587+0000 7ff565390180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-24T03:59:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.611+0000 7efeac174640 1 Processor -- start 2023-05-24T03:59:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.611+0000 7efeac174640 1 -- start start 2023-05-24T03:59:35.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efea406d5e0 0x7efea414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414edf0 0x7efea414f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea4071a50 con 0x7efea414e0e0 2023-05-24T03:59:35.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea4152b60 con 0x7efea406d5e0 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4152780 con 0x7efea414edf0 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efea406d5e0 0x7efea414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeaa711640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414edf0 0x7efea414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efea406d5e0 0x7efea414e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50726/0 (socket says 172.21.15.67:50726) 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 -- 172.21.15.67:0/3623725779 learned_addr learned my addr 172.21.15.67:0/3623725779 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 -- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414edf0 msgr2=0x7efea414f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 --2- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414edf0 0x7efea414f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 -- 172.21.15.67:0/3623725779 >> v1:172.21.15.67:6789/0 conn(0x7efea414e0e0 legacy=0x7efea40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 -- 172.21.15.67:0/3623725779 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea406a0f0 con 0x7efea406d5e0 2023-05-24T03:59:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeaa711640 1 --2- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414edf0 0x7efea414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:59:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea970f640 1 --2- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea406d5e0 0x7efea414e8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efe94009870 tx=0x7efe9401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3f283d11db3302 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea8f0e640 1 -- 172.21.15.67:0/3623725779 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940a9620 con 0x7efea406d5e0 2023-05-24T03:59:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea8f0e640 1 -- 172.21.15.67:0/3623725779 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe940a9780 con 0x7efea406d5e0 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efea8f0e640 1 -- 172.21.15.67:0/3623725779 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940a9b10 con 0x7efea406d5e0 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea406d5e0 msgr2=0x7efea414e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 --2- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea406d5e0 0x7efea414e8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efe94009870 tx=0x7efe9401c540 comp rx=0 tx=0).stop 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- 172.21.15.67:0/3623725779 shutdown_connections 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 --2- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414edf0 0x7efea414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 --2- 172.21.15.67:0/3623725779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea406d5e0 0x7efea414e8b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- 172.21.15.67:0/3623725779 >> 172.21.15.67:0/3623725779 conn(0x7efea406b780 msgr2=0x7efea40c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- 172.21.15.67:0/3623725779 shutdown_connections 2023-05-24T03:59:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.615+0000 7efeac174640 1 -- 172.21.15.67:0/3623725779 wait complete. 2023-05-24T03:59:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 Processor -- start 2023-05-24T03:59:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 -- start start 2023-05-24T03:59:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efea406d5e0 0x7efea4139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414e0e0 0x7efea4141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 0x7efea41e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea41525d0 con 0x7efea406d5e0 2023-05-24T03:59:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea41449f0 con 0x7efea414edf0 2023-05-24T03:59:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4144f20 con 0x7efea414e0e0 2023-05-24T03:59:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 0x7efea41e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efea970f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414e0e0 0x7efea4141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 0x7efea41e9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50730/0 (socket says 172.21.15.67:50730) 2023-05-24T03:59:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 -- 172.21.15.67:0/974233754 learned_addr learned my addr 172.21.15.67:0/974233754 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efea9f10640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efea406d5e0 0x7efea4139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 -- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414e0e0 msgr2=0x7efea4141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414e0e0 0x7efea4141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 -- 172.21.15.67:0/974233754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efea406d5e0 msgr2=0x7efea4139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efea406d5e0 0x7efea4139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 -- 172.21.15.67:0/974233754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009a70 con 0x7efea414edf0 2023-05-24T03:59:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efea9f10640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efea406d5e0 0x7efea4139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efea970f640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414e0e0 0x7efea4141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:59:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeaa711640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 0x7efea41e9f50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00efc0 tx=0x7efe9c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c009cd0 con 0x7efea414edf0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00f040 con 0x7efea414edf0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0039a0 con 0x7efea414edf0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940094d0 con 0x7efea414edf0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea414e640 con 0x7efea414edf0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efe9c014780 con 0x7efea414edf0 2023-05-24T03:59:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.619+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7efe9c01d410 con 0x7efea414edf0 2023-05-24T03:59:35.635 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.621+0000 7f7d52a25180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-24T03:59:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.623+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea414e4b0 con 0x7efea414edf0 2023-05-24T03:59:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.623+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7efe9c018030 con 0x7efea414edf0 2023-05-24T03:59:35.652 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.643+0000 7ff565390180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-24T03:59:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.691+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e1eb7a6-f682-4a7d-8806-dd6d7e004154", "id": 5} v 0) v1 -- 0x7efea414f750 con 0x7efea414edf0 2023-05-24T03:59:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efe9a7fc640 1 -- 172.21.15.67:0/974233754 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e1eb7a6-f682-4a7d-8806-dd6d7e004154", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe9c01db20 con 0x7efea414edf0 2023-05-24T03:59:35.707 INFO:teuthology.orchestra.run.smithi067.stdout:5 2023-05-24T03:59:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 msgr2=0x7efea41e9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 0x7efea41e9f50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00efc0 tx=0x7efe9c00c490 comp rx=0 tx=0).stop 2023-05-24T03:59:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 shutdown_connections 2023-05-24T03:59:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea414edf0 0x7efea41e9f50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea414e0e0 0x7efea4141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 --2- 172.21.15.67:0/974233754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efea406d5e0 0x7efea4139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 >> 172.21.15.67:0/974233754 conn(0x7efea406b780 msgr2=0x7efea40bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 shutdown_connections 2023-05-24T03:59:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.699+0000 7efeac174640 1 -- 172.21.15.67:0/974233754 wait complete. 2023-05-24T03:59:35.711 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.705+0000 7f7d52a25180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-24T03:59:35.724 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 37eb089e-b7dc-4d84-99e2-4ad8bb6980b5 6 2023-05-24T03:59:35.734 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.727+0000 7ff565390180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-24T03:59:35.765 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.757+0000 7f7d52a25180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-24T03:59:35.790 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.783+0000 7ff565390180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-24T03:59:35.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.847+0000 7f582aff8640 1 Processor -- start 2023-05-24T03:59:35.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.847+0000 7f582aff8640 1 -- start start 2023-05-24T03:59:35.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f582406d5d0 0x7f582406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 0x7f582414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f582414bbf0 0x7f582414e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5824070850 con 0x7f582414bbf0 2023-05-24T03:59:35.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582414b220 con 0x7f582406d5d0 2023-05-24T03:59:35.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582406f580 con 0x7f582406f130 2023-05-24T03:59:35.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f582406d5d0 0x7f582406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5823fff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 0x7f582414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f582406d5d0 0x7f582406d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50732/0 (socket says 172.21.15.67:50732) 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5823fff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 0x7f582414b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:47250/0 (socket says 172.21.15.67:47250) 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 -- 172.21.15.67:0/3984825875 learned_addr learned my addr 172.21.15.67:0/3984825875 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5829595640 1 --2- 172.21.15.67:0/3984825875 >> v2:172.21.15.40:3300/0 conn(0x7f582414bbf0 0x7f582414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 -- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 msgr2=0x7f582414b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 --2- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 0x7f582414b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 -- 172.21.15.67:0/3984825875 >> v2:172.21.15.40:3300/0 conn(0x7f582414bbf0 msgr2=0x7f582414e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 --2- 172.21.15.67:0/3984825875 >> v2:172.21.15.40:3300/0 conn(0x7f582414bbf0 0x7f582414e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 -- 172.21.15.67:0/3984825875 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240bd350 con 0x7f582406d5d0 2023-05-24T03:59:35.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5823fff640 1 --2- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 0x7f582414b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:59:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f5828d94640 1 --2- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582406d9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58240be830 tx=0x7f581801c240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cadae358a5b1137 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f58237fe640 1 -- 172.21.15.67:0/3984825875 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180ab600 con 0x7f582406d5d0 2023-05-24T03:59:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f58237fe640 1 -- 172.21.15.67:0/3984825875 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58180a7050 con 0x7f582406d5d0 2023-05-24T03:59:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f58237fe640 1 -- 172.21.15.67:0/3984825875 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180ab980 con 0x7f582406d5d0 2023-05-24T03:59:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 msgr2=0x7f582406d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582406d9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58240be830 tx=0x7f581801c240 comp rx=0 tx=0).stop 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- 172.21.15.67:0/3984825875 shutdown_connections 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- 172.21.15.67:0/3984825875 >> v2:172.21.15.40:3300/0 conn(0x7f582414bbf0 0x7f582414e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582406f130 0x7f582414b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 --2- 172.21.15.67:0/3984825875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582406d9a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- 172.21.15.67:0/3984825875 >> 172.21.15.67:0/3984825875 conn(0x7f58240c0ba0 msgr2=0x7f58240c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- 172.21.15.67:0/3984825875 shutdown_connections 2023-05-24T03:59:35.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.851+0000 7f582aff8640 1 -- 172.21.15.67:0/3984825875 wait complete. 2023-05-24T03:59:35.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 Processor -- start 2023-05-24T03:59:35.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- start start 2023-05-24T03:59:35.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582414c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f582406f130 0x7f58241481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582414bbf0 0x7f5824146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582413f8c0 con 0x7f582406f130 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582413f090 con 0x7f582406d5d0 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582414cc10 con 0x7f582414bbf0 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582414c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5829595640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582414bbf0 0x7f5824146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582414c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50738/0 (socket says 172.21.15.67:50738) 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 -- 172.21.15.67:0/3991789117 learned_addr learned my addr 172.21.15.67:0/3991789117 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5823fff640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f582406f130 0x7f58241481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 -- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582414bbf0 msgr2=0x7f5824146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582414bbf0 0x7f5824146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 -- 172.21.15.67:0/3991789117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f582406f130 msgr2=0x7f58241481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f582406f130 0x7f58241481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 -- 172.21.15.67:0/3991789117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581000b6c0 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f5828d94640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582414c6d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f58180ae040 tx=0x7f5818018fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180b4440 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58180b45c0 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58180094d0 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180b4970 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58240b6670 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58180b2070 con 0x7f582406d5d0 2023-05-24T03:59:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f58180bda40 con 0x7f582406d5d0 2023-05-24T03:59:35.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.855+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58240b64e0 con 0x7f582406d5d0 2023-05-24T03:59:35.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.859+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f58180b8020 con 0x7f582406d5d0 2023-05-24T03:59:35.879 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.871+0000 7ff565390180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-24T03:59:35.911 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.905+0000 7f7d52a25180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-24T03:59:35.947 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:35.939+0000 7ff565390180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-24T03:59:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.947+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37eb089e-b7dc-4d84-99e2-4ad8bb6980b5", "id": 6} v 0) v1 -- 0x7f58240a6790 con 0x7f582406d5d0 2023-05-24T03:59:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f58217fa640 1 -- 172.21.15.67:0/3991789117 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37eb089e-b7dc-4d84-99e2-4ad8bb6980b5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58180b0070 con 0x7f582406d5d0 2023-05-24T03:59:35.962 INFO:teuthology.orchestra.run.smithi067.stdout:6 2023-05-24T03:59:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 msgr2=0x7f582414c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582414c6d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f58180ae040 tx=0x7f5818018fe0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 shutdown_connections 2023-05-24T03:59:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f582414bbf0 0x7f5824146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f582406f130 0x7f58241481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 --2- 172.21.15.67:0/3991789117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f582406d5d0 0x7f582414c6d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 >> 172.21.15.67:0/3991789117 conn(0x7f58240c0ba0 msgr2=0x7f58240c0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 shutdown_connections 2023-05-24T03:59:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:35.955+0000 7f582aff8640 1 -- 172.21.15.67:0/3991789117 wait complete. 2023-05-24T03:59:35.974 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:35.969+0000 7f7d52a25180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-24T03:59:35.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 0050469b-fc36-4d96-a325-b961d01ebbe4 7 2023-05-24T03:59:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f29512bd640 1 Processor -- start 2023-05-24T03:59:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f29512bd640 1 -- start start 2023-05-24T03:59:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f29512bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f294c0c2830 0x7f294c0a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f29512bd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c0c00c0 con 0x7f294c0befd0 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f29512bd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c0aa5c0 con 0x7f294c152290 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f29512bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c0a3830 con 0x7f294c0c2830 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f294a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f294c0c2830 0x7f294c0a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f294b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f294c152290 0x7f294c152710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32904/0 (socket says 172.21.15.67:32904) 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.083+0000 7f294b7fe640 1 -- 172.21.15.67:0/1178860792 learned_addr learned my addr 172.21.15.67:0/1178860792 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-05-24T03:59:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f294a7fc640 1 -- 172.21.15.67:0/1178860792 >> v1:172.21.15.67:6789/0 conn(0x7f294c152290 legacy=0x7f294c152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f2949ffb640 1 -- 172.21.15.67:0/1178860792 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147851227 0 0) 0x7f294c0aa5c0 con 0x7f294c152290 2023-05-24T03:59:36.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f294a7fc640 1 -- 172.21.15.67:0/1178860792 >> v1:172.21.15.40:6789/0 conn(0x7f294c0befd0 legacy=0x7f294c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f294a7fc640 1 -- 172.21.15.67:0/1178860792 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0c03a0 con 0x7f294c0c2830 2023-05-24T03:59:36.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f294a7fc640 1 --2- 172.21.15.67:0/1178860792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0a3cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29400097c0 tx=0x7f294001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3142feb988498c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:36.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f2949ffb640 1 -- 172.21.15.67:0/1178860792 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400a8050 con 0x7f294c0c2830 2023-05-24T03:59:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f2949ffb640 1 -- 172.21.15.67:0/1178860792 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29400ac5f0 con 0x7f294c0c2830 2023-05-24T03:59:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f2949ffb640 1 -- 172.21.15.67:0/1178860792 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400ac980 con 0x7f294c0c2830 2023-05-24T03:59:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f29512bd640 1 -- 172.21.15.67:0/1178860792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 msgr2=0x7f294c0a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f29512bd640 1 --2- 172.21.15.67:0/1178860792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0a3cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29400097c0 tx=0x7f294001c480 comp rx=0 tx=0).stop 2023-05-24T03:59:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f29512bd640 1 -- 172.21.15.67:0/1178860792 shutdown_connections 2023-05-24T03:59:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f29512bd640 1 --2- 172.21.15.67:0/1178860792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0a3cd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.087+0000 7f29512bd640 1 -- 172.21.15.67:0/1178860792 >> 172.21.15.67:0/1178860792 conn(0x7f294c0a62f0 msgr2=0x7f294c0a66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- 172.21.15.67:0/1178860792 shutdown_connections 2023-05-24T03:59:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- 172.21.15.67:0/1178860792 wait complete. 2023-05-24T03:59:36.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 Processor -- start 2023-05-24T03:59:36.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- start start 2023-05-24T03:59:36.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f294c0befd0 0x7f294c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0ba040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f294c152290 0x7f294c0bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0bebf0 con 0x7f294c152290 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0ba580 con 0x7f294c0c2830 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0baf30 con 0x7f294c0befd0 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0ba040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50756/0 (socket says 172.21.15.67:50756) 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 -- 172.21.15.67:0/538145458 learned_addr learned my addr 172.21.15.67:0/538145458 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294affd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f294c0befd0 0x7f294c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294b7fe640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f294c152290 0x7f294c0bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 -- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f294c0befd0 msgr2=0x7f294c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f294c0befd0 0x7f294c145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 -- 172.21.15.67:0/538145458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f294c152290 msgr2=0x7f294c0bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f294c152290 0x7f294c0bd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 -- 172.21.15.67:0/538145458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940009420 con 0x7f294c0c2830 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294b7fe640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f294c152290 0x7f294c0bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f294a7fc640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0ba040 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29400af040 tx=0x7f294001acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400b8660 con 0x7f294c0c2830 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29400b87c0 con 0x7f294c0c2830 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400b8b70 con 0x7f294c0c2830 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c0c4170 con 0x7f294c0c2830 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0c3fe0 con 0x7f294c0c2830 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29400c1410 con 0x7f294c0c2830 2023-05-24T03:59:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.091+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f29400b6ab0 con 0x7f294c0c2830 2023-05-24T03:59:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.095+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c0bf3a0 con 0x7f294c0c2830 2023-05-24T03:59:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.095+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f29400bc020 con 0x7f294c0c2830 2023-05-24T03:59:36.106 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:36.095+0000 7ff565390180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-24T03:59:36.169 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:36.163+0000 7ff565390180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-24T03:59:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.163+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0050469b-fc36-4d96-a325-b961d01ebbe4", "id": 7} v 0) v1 -- 0x7f294c066d70 con 0x7f294c0c2830 2023-05-24T03:59:36.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.171+0000 7f29337fe640 1 -- 172.21.15.67:0/538145458 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0050469b-fc36-4d96-a325-b961d01ebbe4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29400b1070 con 0x7f294c0c2830 2023-05-24T03:59:36.180 INFO:teuthology.orchestra.run.smithi067.stdout:7 2023-05-24T03:59:36.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 msgr2=0x7f294c0ba040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0ba040 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29400af040 tx=0x7f294001acc0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 shutdown_connections 2023-05-24T03:59:36.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f294c152290 0x7f294c0bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f294c0c2830 0x7f294c0ba040 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 --2- 172.21.15.67:0/538145458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f294c0befd0 0x7f294c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 >> 172.21.15.67:0/538145458 conn(0x7f294c0a62f0 msgr2=0x7f294c0a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:36.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 shutdown_connections 2023-05-24T03:59:36.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-05-24T03:59:36.175+0000 7f29512bd640 1 -- 172.21.15.67:0/538145458 wait complete. 2023-05-24T03:59:36.203 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-24T03:59:36.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-24T03:59:36.206 INFO:tasks.ceph.osd.0:Started 2023-05-24T03:59:36.206 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-24T03:59:36.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-24T03:59:36.208 INFO:tasks.ceph.osd.1:Started 2023-05-24T03:59:36.209 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-24T03:59:36.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-24T03:59:36.211 INFO:tasks.ceph.osd.2:Started 2023-05-24T03:59:36.211 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-24T03:59:36.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-24T03:59:36.214 INFO:tasks.ceph.osd.3:Started 2023-05-24T03:59:36.214 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-24T03:59:36.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-24T03:59:36.217 INFO:tasks.ceph.osd.4:Started 2023-05-24T03:59:36.217 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-24T03:59:36.217 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-24T03:59:36.219 INFO:tasks.ceph.osd.5:Started 2023-05-24T03:59:36.219 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-24T03:59:36.220 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-24T03:59:36.222 INFO:tasks.ceph.osd.6:Started 2023-05-24T03:59:36.222 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-24T03:59:36.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-24T03:59:36.224 INFO:tasks.ceph.osd.7:Started 2023-05-24T03:59:36.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:59:36.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.365+0000 7fceb95c8640 1 Processor -- start 2023-05-24T03:59:36.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.365+0000 7fceb95c8640 1 -- start start 2023-05-24T03:59:36.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40c2690 0x7fceb406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fceb40bc150 0x7fceb41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fceb40bb890 0x7fceb414dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb40bcb20 con 0x7fceb40bb890 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb4152c10 con 0x7fceb40bc150 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40bc840 con 0x7fceb40c2690 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fceb40bb890 0x7fceb414dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fceb40bb890 0x7fceb414dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44800/0 (socket says 172.21.15.40:44800) 2023-05-24T03:59:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 -- 172.21.15.40:0/1486149015 learned_addr learned my addr 172.21.15.40:0/1486149015 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb2ffd640 1 --2- 172.21.15.40:0/1486149015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40c2690 0x7fceb406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb27fc640 1 --2- 172.21.15.40:0/1486149015 >> v2:172.21.15.67:3300/0 conn(0x7fceb40bc150 0x7fceb41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 -- 172.21.15.40:0/1486149015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40c2690 msgr2=0x7fceb406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 --2- 172.21.15.40:0/1486149015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40c2690 0x7fceb406dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 -- 172.21.15.40:0/1486149015 >> v2:172.21.15.67:3300/0 conn(0x7fceb40bc150 msgr2=0x7fceb41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 --2- 172.21.15.40:0/1486149015 >> v2:172.21.15.67:3300/0 conn(0x7fceb40bc150 0x7fceb41526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 -- 172.21.15.40:0/1486149015 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40bfd60 con 0x7fceb40bb890 2023-05-24T03:59:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb27fc640 1 --2- 172.21.15.40:0/1486149015 >> v2:172.21.15.67:3300/0 conn(0x7fceb40bc150 0x7fceb41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb37fe640 1 --2- 172.21.15.40:0/1486149015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40bb890 0x7fceb414dbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fceb4071ab0 tx=0x7fceac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5113f384256249eb server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb1ffb640 1 -- 172.21.15.40:0/1486149015 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb414e920 con 0x7fceb40bb890 2023-05-24T03:59:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb1ffb640 1 -- 172.21.15.40:0/1486149015 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0a56d0 con 0x7fceb40bb890 2023-05-24T03:59:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb1ffb640 1 -- 172.21.15.40:0/1486149015 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0a5a60 con 0x7fceb40bb890 2023-05-24T03:59:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- 172.21.15.40:0/1486149015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40bb890 msgr2=0x7fceb414dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1486149015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40bb890 0x7fceb414dbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fceb4071ab0 tx=0x7fceac01c940 comp rx=0 tx=0).stop 2023-05-24T03:59:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- 172.21.15.40:0/1486149015 shutdown_connections 2023-05-24T03:59:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1486149015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40bb890 0x7fceb414dbd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1486149015 >> v2:172.21.15.67:3300/0 conn(0x7fceb40bc150 0x7fceb41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1486149015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40c2690 0x7fceb406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- 172.21.15.40:0/1486149015 >> 172.21.15.40:0/1486149015 conn(0x7fceb40726e0 msgr2=0x7fceb40655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:36.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- 172.21.15.40:0/1486149015 shutdown_connections 2023-05-24T03:59:36.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.369+0000 7fceb95c8640 1 -- 172.21.15.40:0/1486149015 wait complete. 2023-05-24T03:59:36.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 Processor -- start 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- start start 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40bb890 0x7fceb414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fceb40bc150 0x7fceb414a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 0x7fceb41e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4150880 con 0x7fceb40c2690 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4149070 con 0x7fceb40bc150 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb414d590 con 0x7fceb40bb890 2023-05-24T03:59:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 0x7fceb41e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 0x7fceb41e9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44808/0 (socket says 172.21.15.40:44808) 2023-05-24T03:59:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 -- 172.21.15.40:0/1568590262 learned_addr learned my addr 172.21.15.40:0/1568590262 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb27fc640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fceb40bc150 0x7fceb414a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb2ffd640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40bb890 0x7fceb414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 -- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40bb890 msgr2=0x7fceb414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40bb890 0x7fceb414d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 -- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fceb40bc150 msgr2=0x7fceb414a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fceb40bc150 0x7fceb414a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 -- 172.21.15.40:0/1568590262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009b30 con 0x7fceb40c2690 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb27fc640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fceb40bc150 0x7fceb414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb37fe640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 0x7fceb41e9660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fceac01aff0 tx=0x7fceac0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0b8670 con 0x7fceb40c2690 2023-05-24T03:59:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0b87f0 con 0x7fceb40c2690 2023-05-24T03:59:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0b8ba0 con 0x7fceb40c2690 2023-05-24T03:59:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb4070aa0 con 0x7fceb40c2690 2023-05-24T03:59:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb40bbee0 con 0x7fceb40c2690 2023-05-24T03:59:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fceac0c1400 con 0x7fceb40c2690 2023-05-24T03:59:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fceac0c1d80 con 0x7fceb40c2690 2023-05-24T03:59:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.373+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4070c30 con 0x7fceb40c2690 2023-05-24T03:59:36.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.385+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fceac0dfb10 con 0x7fceb40c2690 2023-05-24T03:59:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.441+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceb41491b0 con 0x7fceb40c2690 2023-05-24T03:59:36.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fce9b7fe640 1 -- 172.21.15.40:0/1568590262 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fceac0ce030 con 0x7fceb40c2690 2023-05-24T03:59:36.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:59:36.451 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T03:59:36.170396+0000","last_up_change":"0.000000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:59:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 msgr2=0x7fceb41e9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 0x7fceb41e9660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fceac01aff0 tx=0x7fceac0196e0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 shutdown_connections 2023-05-24T03:59:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceb40c2690 0x7fceb41e9660 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fceb40bc150 0x7fceb414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 --2- 172.21.15.40:0/1568590262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fceb40bb890 0x7fceb414d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 >> 172.21.15.40:0/1568590262 conn(0x7fceb40726e0 msgr2=0x7fceb414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 shutdown_connections 2023-05-24T03:59:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:36.445+0000 7fceb95c8640 1 -- 172.21.15.40:0/1568590262 wait complete. 2023-05-24T03:59:36.467 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-24T03:59:36.467 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-24T03:59:36.609 INFO:tasks.ceph.mgr.y.smithi040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-24T03:59:36.609 INFO:tasks.ceph.mgr.y.smithi040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-24T03:59:36.609 INFO:tasks.ceph.mgr.y.smithi040.stderr: from numpy import show_config as show_numpy_config 2023-05-24T03:59:36.614 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-24T03:59:36.609+0000 7fbcff220640 -1 Falling back to public interface 2023-05-24T03:59:36.615 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-24T03:59:36.609+0000 7f0cb09fd640 -1 Falling back to public interface 2023-05-24T03:59:36.667 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:36.661+0000 7f7d52a25180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-24T03:59:36.779 INFO:tasks.ceph.mgr.x.smithi067.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-24T03:59:36.780 INFO:tasks.ceph.mgr.x.smithi067.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-24T03:59:36.780 INFO:tasks.ceph.mgr.x.smithi067.stderr: from numpy import show_config as show_numpy_config 2023-05-24T03:59:36.801 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:36.793+0000 7f7d52a25180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:59:36.839 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-05-24T03:59:36.831+0000 7fef956a1640 -1 Falling back to public interface 2023-05-24T03:59:36.847 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-05-24T03:59:36.839+0000 7f23819c9640 -1 Falling back to public interface 2023-05-24T03:59:36.847 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-05-24T03:59:36.839+0000 7f6639096640 -1 Falling back to public interface 2023-05-24T03:59:36.858 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-05-24T03:59:36.851+0000 7f89378c3640 -1 Falling back to public interface 2023-05-24T03:59:36.875 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-24T03:59:36.869+0000 7f7a039e2640 -1 Falling back to public interface 2023-05-24T03:59:36.876 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:36.867+0000 7ff565390180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-24T03:59:36.907 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-24T03:59:36.901+0000 7fa6b914a640 -1 Falling back to public interface 2023-05-24T03:59:36.974 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:36.969+0000 7f7d52a25180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-24T03:59:37.004 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:36.995+0000 7ff565390180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:59:37.041 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:37.033+0000 7f7d52a25180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-24T03:59:37.168 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:37.161+0000 7f7d52a25180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:59:37.179 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:37.171+0000 7ff565390180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-24T03:59:37.245 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:37.239+0000 7ff565390180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-24T03:59:37.274 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-24T03:59:37.373 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:37.363+0000 7ff565390180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:59:37.386 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.377+0000 7f686ad47640 1 Processor -- start 2023-05-24T03:59:37.386 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.377+0000 7f686ad47640 1 -- start start 2023-05-24T03:59:37.388 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f686ad47640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68640a4370 0x7f6864070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:37.388 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f686ad47640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f686406ef30 0x7f6864071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:37.388 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f686ad47640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f686406e0f0 0x7f68640b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:37.388 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f686ad47640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68641504a0 con 0x7f686406e0f0 2023-05-24T03:59:37.388 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f686ad47640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68641506f0 con 0x7f686406ef30 2023-05-24T03:59:37.389 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f686ad47640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686406e9f0 con 0x7f68640a4370 2023-05-24T03:59:37.389 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f686406e0f0 0x7f68640b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:37.389 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f686406e0f0 0x7f68640b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44820/0 (socket says 172.21.15.40:44820) 2023-05-24T03:59:37.389 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 -- 172.21.15.40:0/632664004 learned_addr learned my addr 172.21.15.40:0/632664004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:37.389 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f6868ae3640 1 --2- 172.21.15.40:0/632664004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68640a4370 0x7f6864070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:37.390 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f6863fff640 1 --2- 172.21.15.40:0/632664004 >> v2:172.21.15.67:3300/0 conn(0x7f686406ef30 0x7f6864071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:37.390 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 -- 172.21.15.40:0/632664004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68640a4370 msgr2=0x7f6864070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:37.390 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 --2- 172.21.15.40:0/632664004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68640a4370 0x7f6864070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.390 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 -- 172.21.15.40:0/632664004 >> v2:172.21.15.67:3300/0 conn(0x7f686406ef30 msgr2=0x7f6864071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:37.390 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 --2- 172.21.15.40:0/632664004 >> v2:172.21.15.67:3300/0 conn(0x7f686406ef30 0x7f6864071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.390 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 -- 172.21.15.40:0/632664004 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686406eb60 con 0x7f686406e0f0 2023-05-24T03:59:37.394 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68692e4640 1 --2- 172.21.15.40:0/632664004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686406e0f0 0x7f68640b7480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6864070770 tx=0x7f685c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03ed174b75a7edc server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:37.394 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68637fe640 1 -- 172.21.15.40:0/632664004 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0a64b0 con 0x7f686406e0f0 2023-05-24T03:59:37.394 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68637fe640 1 -- 172.21.15.40:0/632664004 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0a6610 con 0x7f686406e0f0 2023-05-24T03:59:37.394 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.381+0000 7f68637fe640 1 -- 172.21.15.40:0/632664004 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0a69a0 con 0x7f686406e0f0 2023-05-24T03:59:37.394 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/632664004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686406e0f0 msgr2=0x7f68640b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:37.394 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- 172.21.15.40:0/632664004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686406e0f0 0x7f68640b7480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6864070770 tx=0x7f685c01c710 comp rx=0 tx=0).stop 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/632664004 shutdown_connections 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- 172.21.15.40:0/632664004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686406e0f0 0x7f68640b7480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- 172.21.15.40:0/632664004 >> v2:172.21.15.67:3300/0 conn(0x7f686406ef30 0x7f6864071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- 172.21.15.40:0/632664004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68640a4370 0x7f6864070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/632664004 >> 172.21.15.40:0/632664004 conn(0x7f68640659e0 msgr2=0x7f6864065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/632664004 shutdown_connections 2023-05-24T03:59:37.395 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/632664004 wait complete. 2023-05-24T03:59:37.396 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 Processor -- start 2023-05-24T03:59:37.396 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- start start 2023-05-24T03:59:37.396 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686406e0f0 0x7f68641e6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:37.396 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686406ef30 0x7f6864143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:37.396 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 0x7f68640bbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:37.397 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6864069b00 con 0x7f68640a4370 2023-05-24T03:59:37.397 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641e9840 con 0x7f686406ef30 2023-05-24T03:59:37.397 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68641443f0 con 0x7f686406e0f0 2023-05-24T03:59:37.397 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 0x7f68640bbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:37.398 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 0x7f68640bbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44828/0 (socket says 172.21.15.40:44828) 2023-05-24T03:59:37.398 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 -- 172.21.15.40:0/3340769678 learned_addr learned my addr 172.21.15.40:0/3340769678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:37.398 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f6868ae3640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686406e0f0 0x7f68641e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:37.398 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f6863fff640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686406ef30 0x7f6864143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 -- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686406e0f0 msgr2=0x7f68641e6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686406e0f0 0x7f68641e6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 -- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686406ef30 msgr2=0x7f6864143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686406ef30 0x7f6864143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 -- 172.21.15.40:0/3340769678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009b30 con 0x7f68640a4370 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f6868ae3640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686406e0f0 0x7f68641e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68692e4640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 0x7f68640bbb70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f685c01adc0 tx=0x7f685c0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:37.399 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b4070 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0091d0 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686414baf0 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0a69c0 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686414b960 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f685c0b8070 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.385+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f685c0aa070 con 0x7f68640a4370 2023-05-24T03:59:37.400 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.389+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686414bc80 con 0x7f68640a4370 2023-05-24T03:59:37.401 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.389+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f685c0bf070 con 0x7f68640a4370 2023-05-24T03:59:37.453 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.445+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f686406a880 con 0x7f68640a4370 2023-05-24T03:59:37.453 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.445+0000 7f68617fa640 1 -- 172.21.15.40:0/3340769678 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f686406a880 con 0x7f68640a4370 2023-05-24T03:59:37.454 INFO:teuthology.misc.health.smithi040.stdout: 2023-05-24T03:59:37.454 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T03:59:36.170396+0000","last_up_change":"0.000000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:59:37.455 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 msgr2=0x7f68640bbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:37.456 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 0x7f68640bbb70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f685c01adc0 tx=0x7f685c0194b0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.456 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 shutdown_connections 2023-05-24T03:59:37.456 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68640a4370 0x7f68640bbb70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.456 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686406ef30 0x7f6864143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.456 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 --2- 172.21.15.40:0/3340769678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686406e0f0 0x7f68641e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:37.457 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 >> 172.21.15.40:0/3340769678 conn(0x7f68640659e0 msgr2=0x7f686414ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:37.457 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 shutdown_connections 2023-05-24T03:59:37.457 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:37.449+0000 7f686ad47640 1 -- 172.21.15.40:0/3340769678 wait complete. 2023-05-24T03:59:37.470 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-24T03:59:37.825 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:37.817+0000 7f7d52a25180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-24T03:59:37.904 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:37.897+0000 7f7d52a25180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-24T03:59:37.987 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:37.979+0000 7ff565390180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-24T03:59:38.066 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:38.059+0000 7ff565390180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-24T03:59:38.083 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:38.077+0000 7f7d52a25180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-24T03:59:38.160 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:38.153+0000 7f7d52a25180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-24T03:59:38.243 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:38.235+0000 7ff565390180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-24T03:59:38.319 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:38.311+0000 7ff565390180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-24T03:59:38.419 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:38.413+0000 7f7d52a25180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-24T03:59:38.482 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:38.473+0000 7f7d52a25180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-24T03:59:38.582 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:38.575+0000 7ff565390180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-24T03:59:38.645 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-05-24T03:59:38.635+0000 7ff565390180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-24T03:59:39.530 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:39.525+0000 7f7cfa4e2640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-24T03:59:39.537 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-24T03:59:39.529+0000 7f7cfa4e2640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-24T03:59:40.566 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-24T03:59:40.561+0000 7fbcff220640 -1 osd.1 0 log_to_monitors true 2023-05-24T03:59:40.590 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-24T03:59:40.585+0000 7f0cb09fd640 -1 osd.0 0 log_to_monitors true 2023-05-24T03:59:40.675 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-24T03:59:40.669+0000 7f7a039e2640 -1 osd.2 0 log_to_monitors true 2023-05-24T03:59:40.678 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-05-24T03:59:40.671+0000 7fef956a1640 -1 osd.4 0 log_to_monitors true 2023-05-24T03:59:40.754 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-05-24T03:59:40.747+0000 7f23819c9640 -1 osd.7 0 log_to_monitors true 2023-05-24T03:59:40.785 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-05-24T03:59:40.775+0000 7f6639096640 -1 osd.6 0 log_to_monitors true 2023-05-24T03:59:40.789 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-05-24T03:59:40.779+0000 7f89378c3640 -1 osd.5 0 log_to_monitors true 2023-05-24T03:59:40.855 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-24T03:59:40.849+0000 7fa6b914a640 -1 osd.3 0 log_to_monitors true 2023-05-24T03:59:44.275 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-24T03:59:44.447 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 Processor -- start 2023-05-24T03:59:44.448 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 -- start start 2023-05-24T03:59:44.449 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135220 0x7fa04c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:44.449 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa04c135920 0x7fa04c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:44.449 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0be6b0 con 0x7fa04c14d3a0 2023-05-24T03:59:44.449 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c072580 con 0x7fa04c135920 2023-05-24T03:59:44.450 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa0520df640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0be020 con 0x7fa04c135220 2023-05-24T03:59:44.450 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa04bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa04c14d3a0 0x7fa04c0bd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47964/0 (socket says 172.21.15.40:47964) 2023-05-24T03:59:44.450 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa04bfff640 1 -- 172.21.15.40:0/852713414 learned_addr learned my addr 172.21.15.40:0/852713414 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:44.451 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.442+0000 7fa04b7fe640 1 --2- 172.21.15.40:0/852713414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135220 0x7fa04c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:44.451 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.446+0000 7fa04affd640 1 --2- 172.21.15.40:0/852713414 >> v2:172.21.15.67:3300/0 conn(0x7fa04c135920 0x7fa04c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:44.451 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.446+0000 7fa04b7fe640 1 -- 172.21.15.40:0/852713414 >> v2:172.21.15.67:3300/0 conn(0x7fa04c135920 msgr2=0x7fa04c14ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:44.452 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.446+0000 7fa04b7fe640 1 --2- 172.21.15.40:0/852713414 >> v2:172.21.15.67:3300/0 conn(0x7fa04c135920 0x7fa04c14ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.452 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.446+0000 7fa04b7fe640 1 -- 172.21.15.40:0/852713414 >> v1:172.21.15.40:6789/0 conn(0x7fa04c14d3a0 legacy=0x7fa04c0bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:44.452 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.446+0000 7fa04b7fe640 1 -- 172.21.15.40:0/852713414 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0b8170 con 0x7fa04c135220 2023-05-24T03:59:44.456 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.450+0000 7fa04b7fe640 1 --2- 172.21.15.40:0/852713414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135220 0x7fa04c0b5f40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa044009d90 tx=0x7fa04401c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2158f6e4aa0ef10e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:44.457 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.450+0000 7fa04a7fc640 1 -- 172.21.15.40:0/852713414 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440a5770 con 0x7fa04c135220 2023-05-24T03:59:44.457 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.450+0000 7fa04a7fc640 1 -- 172.21.15.40:0/852713414 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0440a58d0 con 0x7fa04c135220 2023-05-24T03:59:44.457 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.450+0000 7fa04a7fc640 1 -- 172.21.15.40:0/852713414 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440a5c60 con 0x7fa04c135220 2023-05-24T03:59:44.458 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 -- 172.21.15.40:0/852713414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135220 msgr2=0x7fa04c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:44.458 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 --2- 172.21.15.40:0/852713414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135220 0x7fa04c0b5f40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa044009d90 tx=0x7fa04401c750 comp rx=0 tx=0).stop 2023-05-24T03:59:44.459 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 -- 172.21.15.40:0/852713414 shutdown_connections 2023-05-24T03:59:44.459 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 --2- 172.21.15.40:0/852713414 >> v2:172.21.15.67:3300/0 conn(0x7fa04c135920 0x7fa04c14ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.459 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 --2- 172.21.15.40:0/852713414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135220 0x7fa04c0b5f40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.459 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 -- 172.21.15.40:0/852713414 >> 172.21.15.40:0/852713414 conn(0x7fa04c0c0b90 msgr2=0x7fa04c0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:44.460 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 -- 172.21.15.40:0/852713414 shutdown_connections 2023-05-24T03:59:44.460 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 -- 172.21.15.40:0/852713414 wait complete. 2023-05-24T03:59:44.464 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 Processor -- start 2023-05-24T03:59:44.465 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.454+0000 7fa0520df640 1 -- start start 2023-05-24T03:59:44.465 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c135220 0x7fa04c0b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:44.465 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135920 0x7fa04c130d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:44.465 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 0x7fa04c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:44.465 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1e2a10 con 0x7fa04c14bbd0 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1e35f0 con 0x7fa04c135220 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1df0a0 con 0x7fa04c135920 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 0x7fa04c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 0x7fa04c14b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53432/0 (socket says 172.21.15.40:53432) 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 -- 172.21.15.40:0/745224604 learned_addr learned my addr 172.21.15.40:0/745224604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04b7fe640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c135220 0x7fa04c0b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:44.466 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 -- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135920 msgr2=0x7fa04c130d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-24T03:59:44.467 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135920 0x7fa04c130d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.467 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 -- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c135220 msgr2=0x7fa04c0b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:44.467 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c135220 0x7fa04c0b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.467 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 -- 172.21.15.40:0/745224604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009a70 con 0x7fa04c14bbd0 2023-05-24T03:59:44.467 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa04bfff640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 0x7fa04c14b1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009e00 tx=0x7fa03c02e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:44.467 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c02ed00 con 0x7fa04c14bbd0 2023-05-24T03:59:44.468 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c02ee60 con 0x7fa04c14bbd0 2023-05-24T03:59:44.468 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c0b6480 con 0x7fa04c14bbd0 2023-05-24T03:59:44.468 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.458+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c1355f0 con 0x7fa04c14bbd0 2023-05-24T03:59:44.468 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.462+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c0b6610 con 0x7fa04c14bbd0 2023-05-24T03:59:44.469 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.462+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c007b30 con 0x7fa04c14bbd0 2023-05-24T03:59:44.476 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.470+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fa03c007cd0 con 0x7fa04c14bbd0 2023-05-24T03:59:44.477 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.470+0000 7fa033fff640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa0380662f0 0x7fa0380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:44.477 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.470+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fa03c0a6cf0 con 0x7fa04c14bbd0 2023-05-24T03:59:44.477 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.470+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa03c0ab290 con 0x7fa04c14bbd0 2023-05-24T03:59:44.477 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.470+0000 7fa04b7fe640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa0380662f0 0x7fa0380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:44.477 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.470+0000 7fa04b7fe640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa0380662f0 0x7fa0380687a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0440af000 tx=0x7fa0440a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:44.711 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-24T03:59:44.702+0000 7fa6b50ef640 -1 osd.3 0 waiting for initial osdmap 2023-05-24T03:59:44.738 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-24T03:59:44.734+0000 7fa6acf22640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:44.764 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.758+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa04c066d70 con 0x7fa04c14bbd0 2023-05-24T03:59:44.766 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa033fff640 1 -- 172.21.15.40:0/745224604 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa03c0751b0 con 0x7fa04c14bbd0 2023-05-24T03:59:44.766 INFO:teuthology.misc.health.smithi040.stdout: 2023-05-24T03:59:44.767 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":12,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T03:59:42.529322+0000","last_up_change":"0.000000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:59:44.768 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa0380662f0 msgr2=0x7fa0380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:44.768 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa0380662f0 0x7fa0380687a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0440af000 tx=0x7fa0440a7070 comp rx=0 tx=0).stop 2023-05-24T03:59:44.769 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 msgr2=0x7fa04c14b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:44.769 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 0x7fa04c14b1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009e00 tx=0x7fa03c02e440 comp rx=0 tx=0).stop 2023-05-24T03:59:44.769 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 shutdown_connections 2023-05-24T03:59:44.769 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa0380662f0 0x7fa0380687a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.769 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04c14bbd0 0x7fa04c14b1d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.769 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa04c135920 0x7fa04c130d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.770 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 --2- 172.21.15.40:0/745224604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c135220 0x7fa04c0b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:44.770 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 >> 172.21.15.40:0/745224604 conn(0x7fa04c0c0b90 msgr2=0x7fa04c134370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:44.770 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 shutdown_connections 2023-05-24T03:59:44.770 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:44.762+0000 7fa0520df640 1 -- 172.21.15.40:0/745224604 wait complete. 2023-05-24T03:59:44.790 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-24T03:59:44.846 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-24T03:59:44.842+0000 7f0cac9a2640 -1 osd.0 0 waiting for initial osdmap 2023-05-24T03:59:44.874 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-24T03:59:44.870+0000 7f0ca47d5640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:44.923 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-24T03:59:44.918+0000 7fbcfb1c5640 -1 osd.1 0 waiting for initial osdmap 2023-05-24T03:59:44.924 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-24T03:59:44.918+0000 7f79ff987640 -1 osd.2 0 waiting for initial osdmap 2023-05-24T03:59:44.945 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-05-24T03:59:44.939+0000 7f663503b640 -1 osd.6 0 waiting for initial osdmap 2023-05-24T03:59:44.950 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-24T03:59:44.946+0000 7fbcf2ff8640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:44.954 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-24T03:59:44.950+0000 7f79f77ba640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:44.958 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-05-24T03:59:44.951+0000 7f8933868640 -1 osd.5 0 waiting for initial osdmap 2023-05-24T03:59:44.977 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-05-24T03:59:44.971+0000 7f662ce6e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:44.980 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-05-24T03:59:44.971+0000 7f237d96e640 -1 osd.7 0 waiting for initial osdmap 2023-05-24T03:59:44.999 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-05-24T03:59:44.991+0000 7fef91646640 -1 osd.4 0 waiting for initial osdmap 2023-05-24T03:59:45.006 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-05-24T03:59:44.999+0000 7f892b69b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:45.022 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-05-24T03:59:45.015+0000 7f23757a1640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:45.030 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-05-24T03:59:45.023+0000 7fef89479640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:59:51.597 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-24T03:59:51.725 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.718+0000 7f92c5445640 1 Processor -- start 2023-05-24T03:59:51.725 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.718+0000 7f92c5445640 1 -- start start 2023-05-24T03:59:51.727 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92c014af80 0x7f92c00bba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:51.727 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:51.727 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c006eb30 con 0x7f92c0071a90 2023-05-24T03:59:51.727 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c014c7c0 con 0x7f92c014af80 2023-05-24T03:59:51.727 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c014f3a0 con 0x7f92c00bbfa0 2023-05-24T03:59:51.727 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92c014af80 0x7f92c00bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92c014af80 0x7f92c00bba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44712/0 (socket says 172.21.15.40:44712) 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92bf7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92c0071a90 0x7f92c006c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46418/0 (socket says 172.21.15.40:46418) 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 -- 172.21.15.40:0/3448291915 learned_addr learned my addr 172.21.15.40:0/3448291915 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92be7fc640 1 --2- 172.21.15.40:0/3448291915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 -- 172.21.15.40:0/3448291915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 msgr2=0x7f92c006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 --2- 172.21.15.40:0/3448291915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c006bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 -- 172.21.15.40:0/3448291915 >> v1:172.21.15.40:6789/0 conn(0x7f92c0071a90 legacy=0x7f92c006c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:51.728 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 -- 172.21.15.40:0/3448291915 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00a3290 con 0x7f92c014af80 2023-05-24T03:59:51.729 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92beffd640 1 --2- 172.21.15.40:0/3448291915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c00bba60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92b00098a0 tx=0x7f92b001e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648e64766e935d25 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92bdffb640 1 -- 172.21.15.40:0/3448291915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00a8620 con 0x7f92c014af80 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92bdffb640 1 -- 172.21.15.40:0/3448291915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b00a8780 con 0x7f92c014af80 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92bdffb640 1 -- 172.21.15.40:0/3448291915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00a8b10 con 0x7f92c014af80 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 -- 172.21.15.40:0/3448291915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 msgr2=0x7f92c00bba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.722+0000 7f92c5445640 1 --2- 172.21.15.40:0/3448291915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c00bba60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92b00098a0 tx=0x7f92b001e730 comp rx=0 tx=0).stop 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- 172.21.15.40:0/3448291915 shutdown_connections 2023-05-24T03:59:51.730 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 --2- 172.21.15.40:0/3448291915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.731 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 --2- 172.21.15.40:0/3448291915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c00bba60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.731 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- 172.21.15.40:0/3448291915 >> 172.21.15.40:0/3448291915 conn(0x7f92c00c0300 msgr2=0x7f92c00c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:51.731 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- 172.21.15.40:0/3448291915 shutdown_connections 2023-05-24T03:59:51.732 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- 172.21.15.40:0/3448291915 wait complete. 2023-05-24T03:59:51.734 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 Processor -- start 2023-05-24T03:59:51.734 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- start start 2023-05-24T03:59:51.734 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92c0071a90 0x7f92c00b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:51.734 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:51.735 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:51.735 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0150600 con 0x7f92c014af80 2023-05-24T03:59:51.735 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c014ff40 con 0x7f92c0071a90 2023-05-24T03:59:51.735 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0150220 con 0x7f92c00bbfa0 2023-05-24T03:59:51.735 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:51.735 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c014a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44718/0 (socket says 172.21.15.40:44718) 2023-05-24T03:59:51.736 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 -- 172.21.15.40:0/3188646084 learned_addr learned my addr 172.21.15.40:0/3188646084 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:51.736 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92be7fc640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:51.736 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92beffd640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92c0071a90 0x7f92c00b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:51.736 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 -- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 msgr2=0x7f92c014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:51.736 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.736 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 -- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92c0071a90 msgr2=0x7f92c00b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:51.737 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92c0071a90 0x7f92c00b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.737 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 -- 172.21.15.40:0/3188646084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00094d0 con 0x7f92c014af80 2023-05-24T03:59:51.737 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92beffd640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92c0071a90 0x7f92c00b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:51.737 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92bf7fe640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c014a630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c7a0 tx=0x7f92b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:51.737 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800a640 con 0x7f92c014af80 2023-05-24T03:59:51.737 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800a7a0 con 0x7f92c014af80 2023-05-24T03:59:51.738 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c00a3570 con 0x7f92c014af80 2023-05-24T03:59:51.738 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800ab10 con 0x7f92c014af80 2023-05-24T03:59:51.738 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.726+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c00b7090 con 0x7f92c014af80 2023-05-24T03:59:51.738 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.730+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c006c7a0 con 0x7f92c014af80 2023-05-24T03:59:51.739 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.730+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92b800ac70 con 0x7f92c014af80 2023-05-24T03:59:51.739 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.730+0000 7f92a77fe640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92ac066280 0x7f92ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:51.739 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.730+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92b8082f90 con 0x7f92c014af80 2023-05-24T03:59:51.739 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.730+0000 7f92beffd640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92ac066280 0x7f92ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:51.739 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.730+0000 7f92beffd640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92ac066280 0x7f92ac068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92b00b0000 tx=0x7f92b00a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:51.740 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.734+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f92b8050960 con 0x7f92c014af80 2023-05-24T03:59:51.891 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.886+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92c004ddd0 con 0x7f92c014af80 2023-05-24T03:59:51.893 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.886+0000 7f92a77fe640 1 -- 172.21.15.40:0/3188646084 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f92b8017090 con 0x7f92c014af80 2023-05-24T03:59:51.894 INFO:teuthology.misc.health.smithi040.stdout: 2023-05-24T03:59:51.894 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":16,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T03:59:48.749536+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:59:51.895 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92ac066280 msgr2=0x7f92ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:51.895 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92ac066280 0x7f92ac068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92b00b0000 tx=0x7f92b00a9000 comp rx=0 tx=0).stop 2023-05-24T03:59:51.896 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 msgr2=0x7f92c014a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:51.896 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c014a630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c7a0 tx=0x7f92b800cc60 comp rx=0 tx=0).stop 2023-05-24T03:59:51.896 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 shutdown_connections 2023-05-24T03:59:51.896 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92ac066280 0x7f92ac068730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.896 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c014af80 0x7f92c014a630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.897 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92c00bbfa0 0x7f92c014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.897 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 --2- 172.21.15.40:0/3188646084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92c0071a90 0x7f92c00b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:51.897 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 >> 172.21.15.40:0/3188646084 conn(0x7f92c00c0300 msgr2=0x7f92c00c06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:51.897 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 shutdown_connections 2023-05-24T03:59:51.898 INFO:teuthology.misc.health.smithi040.stderr:2023-05-24T03:59:51.890+0000 7f92c5445640 1 -- 172.21.15.40:0/3188646084 wait complete. 2023-05-24T03:59:51.910 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-24T03:59:51.910 INFO:tasks.ceph:Creating RBD pool 2023-05-24T03:59:51.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-24T03:59:52.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 Processor -- start 2023-05-24T03:59:52.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 -- start start 2023-05-24T03:59:52.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0d414bc80 0x7fb0d40a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0d4071220 0x7fb0d4071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d4070ab0 con 0x7fb0d40bcd20 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40a5040 con 0x7fb0d4071220 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0db604640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d414d0f0 con 0x7fb0d414bc80 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0d4071220 0x7fb0d4071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0d4071220 0x7fb0d4071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44728/0 (socket says 172.21.15.40:44728) 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 -- 172.21.15.40:0/1761596056 learned_addr learned my addr 172.21.15.40:0/1761596056 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d93a0640 1 --2- 172.21.15.40:0/1761596056 >> v2:172.21.15.67:3300/0 conn(0x7fb0d414bc80 0x7fb0d40a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 -- 172.21.15.40:0/1761596056 >> v2:172.21.15.67:3300/0 conn(0x7fb0d414bc80 msgr2=0x7fb0d40a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:52.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 --2- 172.21.15.40:0/1761596056 >> v2:172.21.15.67:3300/0 conn(0x7fb0d414bc80 0x7fb0d40a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 -- 172.21.15.40:0/1761596056 >> v1:172.21.15.67:6789/0 conn(0x7fb0d40bcd20 legacy=0x7fb0d40bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:52.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 -- 172.21.15.40:0/1761596056 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4070d00 con 0x7fb0d4071220 2023-05-24T03:59:52.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d93a0640 1 --2- 172.21.15.40:0/1761596056 >> v2:172.21.15.67:3300/0 conn(0x7fb0d414bc80 0x7fb0d40a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:52.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.018+0000 7fb0d8b9f640 1 --2- 172.21.15.40:0/1761596056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d4071220 0x7fb0d4071670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0d406e350 tx=0x7fb0d001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d453c3f43da03a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:52.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0c7fff640 1 -- 172.21.15.40:0/1761596056 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00a5750 con 0x7fb0d4071220 2023-05-24T03:59:52.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0c7fff640 1 -- 172.21.15.40:0/1761596056 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d00a58b0 con 0x7fb0d4071220 2023-05-24T03:59:52.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0c7fff640 1 -- 172.21.15.40:0/1761596056 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00a5c40 con 0x7fb0d4071220 2023-05-24T03:59:52.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/1761596056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d4071220 msgr2=0x7fb0d4071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 --2- 172.21.15.40:0/1761596056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d4071220 0x7fb0d4071670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0d406e350 tx=0x7fb0d001c870 comp rx=0 tx=0).stop 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/1761596056 shutdown_connections 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 --2- 172.21.15.40:0/1761596056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d4071220 0x7fb0d4071670 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 --2- 172.21.15.40:0/1761596056 >> v2:172.21.15.67:3300/0 conn(0x7fb0d414bc80 0x7fb0d40a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/1761596056 >> 172.21.15.40:0/1761596056 conn(0x7fb0d40c0310 msgr2=0x7fb0d40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/1761596056 shutdown_connections 2023-05-24T03:59:52.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/1761596056 wait complete. 2023-05-24T03:59:52.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 Processor -- start 2023-05-24T03:59:52.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- start start 2023-05-24T03:59:52.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4071220 0x7fb0d41e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d40bcd20 0x7fb0d41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 0x7fb0d4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d413e240 con 0x7fb0d414bc80 2023-05-24T03:59:52.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d41ea770 con 0x7fb0d4071220 2023-05-24T03:59:52.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40c00a0 con 0x7fb0d40bcd20 2023-05-24T03:59:52.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 0x7fb0d4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 0x7fb0d4155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44730/0 (socket says 172.21.15.40:44730) 2023-05-24T03:59:52.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 -- 172.21.15.40:0/2490482431 learned_addr learned my addr 172.21.15.40:0/2490482431 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:52.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d93a0640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4071220 0x7fb0d41e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d8b9f640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d40bcd20 0x7fb0d41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 -- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d40bcd20 msgr2=0x7fb0d41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d40bcd20 0x7fb0d41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 -- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4071220 msgr2=0x7fb0d41e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4071220 0x7fb0d41e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 -- 172.21.15.40:0/2490482431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0009b30 con 0x7fb0d414bc80 2023-05-24T03:59:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d8b9f640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d40bcd20 0x7fb0d41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0d9ba1640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 0x7fb0d4155de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c3f0 tx=0x7fb0cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc011790 con 0x7fb0d414bc80 2023-05-24T03:59:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0118f0 con 0x7fb0d414bc80 2023-05-24T03:59:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d414cd50 con 0x7fb0d414bc80 2023-05-24T03:59:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc011ca0 con 0x7fb0d414bc80 2023-05-24T03:59:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.022+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d414c050 con 0x7fb0d414bc80 2023-05-24T03:59:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.026+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40bd850 con 0x7fb0d414bc80 2023-05-24T03:59:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.026+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0cc01c460 con 0x7fb0d414bc80 2023-05-24T03:59:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.026+0000 7fb0c5ffb640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb0b8066280 0x7fb0b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.026+0000 7fb0d93a0640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb0b8066280 0x7fb0b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.026+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0cc0837a0 con 0x7fb0d414bc80 2023-05-24T03:59:52.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.026+0000 7fb0d93a0640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb0b8066280 0x7fb0b8068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8006fd0 tx=0x7fb0c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:52.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.030+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb0cc054b60 con 0x7fb0d414bc80 2023-05-24T03:59:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.182+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb0d40bcb90 con 0x7fb0d414bc80 2023-05-24T03:59:52.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:52.323 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:52.325 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:52.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:52.331 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:59:52.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.446+0000 7fb0c5ffb640 1 -- 172.21.15.40:0/2490482431 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb0cc003810 con 0x7fb0d414bc80 2023-05-24T03:59:52.452 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'rbd' created 2023-05-24T03:59:52.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb0b8066280 msgr2=0x7fb0b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb0b8066280 0x7fb0b8068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8006fd0 tx=0x7fb0c8008040 comp rx=0 tx=0).stop 2023-05-24T03:59:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 msgr2=0x7fb0d4155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 0x7fb0d4155de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c3f0 tx=0x7fb0cc00c8b0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 shutdown_connections 2023-05-24T03:59:52.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb0b8066280 0x7fb0b8068730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d414bc80 0x7fb0d4155de0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d40bcd20 0x7fb0d41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 --2- 172.21.15.40:0/2490482431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4071220 0x7fb0d41e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 >> 172.21.15.40:0/2490482431 conn(0x7fb0d40c0310 msgr2=0x7fb0d40c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:52.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 shutdown_connections 2023-05-24T03:59:52.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.450+0000 7fb0db604640 1 -- 172.21.15.40:0/2490482431 wait complete. 2023-05-24T03:59:52.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-24T03:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 Processor -- start 2023-05-24T03:59:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 -- start start 2023-05-24T03:59:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefd0142c40 0x7fefd00c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefd00c2050 0x7fefd014c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00a73f0 con 0x7fefd00a4590 2023-05-24T03:59:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd014d180 con 0x7fefd0142c40 2023-05-24T03:59:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefd61c9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd014f7d0 con 0x7fefd00c2050 2023-05-24T03:59:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefd0142c40 0x7fefd00c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefd0142c40 0x7fefd00c1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44746/0 (socket says 172.21.15.40:44746) 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 -- 172.21.15.40:0/3216046244 learned_addr learned my addr 172.21.15.40:0/3216046244 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefc6ffd640 1 --2- 172.21.15.40:0/3216046244 >> v2:172.21.15.67:3300/0 conn(0x7fefd00c2050 0x7fefd014c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 -- 172.21.15.40:0/3216046244 >> v2:172.21.15.67:3300/0 conn(0x7fefd00c2050 msgr2=0x7fefd014c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 --2- 172.21.15.40:0/3216046244 >> v2:172.21.15.67:3300/0 conn(0x7fefd00c2050 0x7fefd014c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 -- 172.21.15.40:0/3216046244 >> v1:172.21.15.40:6789/0 conn(0x7fefd00a4590 legacy=0x7fefd014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefcf7fe640 1 -- 172.21.15.40:0/3216046244 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00a3f60 con 0x7fefd0142c40 2023-05-24T03:59:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.606+0000 7fefceffd640 1 -- 172.21.15.40:0/3216046244 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150335332 0 0) 0x7fefd00a73f0 con 0x7fefd00a4590 2023-05-24T03:59:52.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 --2- 172.21.15.40:0/3216046244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0142c40 0x7fefd00c1b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fefd006db90 tx=0x7fefc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e48fce21aa5cbd server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefceffd640 1 -- 172.21.15.40:0/3216046244 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00aa650 con 0x7fefd0142c40 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefceffd640 1 -- 172.21.15.40:0/3216046244 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc00aa7b0 con 0x7fefd0142c40 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefceffd640 1 -- 172.21.15.40:0/3216046244 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00aab40 con 0x7fefd0142c40 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- 172.21.15.40:0/3216046244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0142c40 msgr2=0x7fefd00c1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 --2- 172.21.15.40:0/3216046244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0142c40 0x7fefd00c1b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fefd006db90 tx=0x7fefc001c4d0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- 172.21.15.40:0/3216046244 shutdown_connections 2023-05-24T03:59:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 --2- 172.21.15.40:0/3216046244 >> v2:172.21.15.67:3300/0 conn(0x7fefd00c2050 0x7fefd014c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 --2- 172.21.15.40:0/3216046244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0142c40 0x7fefd00c1b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- 172.21.15.40:0/3216046244 >> 172.21.15.40:0/3216046244 conn(0x7fefd0065be0 msgr2=0x7fefd00c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- 172.21.15.40:0/3216046244 shutdown_connections 2023-05-24T03:59:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- 172.21.15.40:0/3216046244 wait complete. 2023-05-24T03:59:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 Processor -- start 2023-05-24T03:59:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- start start 2023-05-24T03:59:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 0x7fefd01455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefd00c2050 0x7fefd014b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefd0142c40 0x7fefd013c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0145b10 con 0x7fefd00a4590 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01e7040 con 0x7fefd0142c40 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01e7320 con 0x7fefd00c2050 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 0x7fefd01455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 0x7fefd01455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44762/0 (socket says 172.21.15.40:44762) 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 -- 172.21.15.40:0/2892454042 learned_addr learned my addr 172.21.15.40:0/2892454042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcffff640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefd0142c40 0x7fefd013c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefc6ffd640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefd00c2050 0x7fefd014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 -- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefd00c2050 msgr2=0x7fefd014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefd00c2050 0x7fefd014b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 -- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefd0142c40 msgr2=0x7fefd013c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefd0142c40 0x7fefd013c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 -- 172.21.15.40:0/2892454042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00094d0 con 0x7fefd00a4590 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcffff640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefd0142c40 0x7fefd013c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefcf7fe640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 0x7fefd01455d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefc00190e0 tx=0x7fefc001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00b3800 con 0x7fefd00a4590 2023-05-24T03:59:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc00b3960 con 0x7fefd00a4590 2023-05-24T03:59:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd0143010 con 0x7fefd00a4590 2023-05-24T03:59:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.610+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00b3d10 con 0x7fefd00a4590 2023-05-24T03:59:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd006dc20 con 0x7fefd00a4590 2023-05-24T03:59:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd00a4e00 con 0x7fefd00a4590 2023-05-24T03:59:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefc00b2380 con 0x7fefd00a4590 2023-05-24T03:59:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefccff9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fefb4066280 0x7fefb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fefc011e150 con 0x7fefd00a4590 2023-05-24T03:59:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefc6ffd640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fefb4066280 0x7fefb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.614+0000 7fefc6ffd640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fefb4066280 0x7fefb4068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fefd00c12e0 tx=0x7fefb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.618+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fefc00eb9e0 con 0x7fefd00a4590 2023-05-24T03:59:52.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:52.770+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fefd0066d70 con 0x7fefd00a4590 2023-05-24T03:59:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.462+0000 7fefccff9640 1 -- 172.21.15.40:0/2892454042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fefc00ef000 con 0x7fefd00a4590 2023-05-24T03:59:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-24T03:59:53.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fefb4066280 msgr2=0x7fefb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fefb4066280 0x7fefb4068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fefd00c12e0 tx=0x7fefb8008040 comp rx=0 tx=0).stop 2023-05-24T03:59:53.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 msgr2=0x7fefd01455d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 0x7fefd01455d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefc00190e0 tx=0x7fefc001ad10 comp rx=0 tx=0).stop 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 shutdown_connections 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fefb4066280 0x7fefb4068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefd0142c40 0x7fefd013c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefd00c2050 0x7fefd014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 --2- 172.21.15.40:0/2892454042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd00a4590 0x7fefd01455d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 >> 172.21.15.40:0/2892454042 conn(0x7fefd0065be0 msgr2=0x7fefd00c0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 shutdown_connections 2023-05-24T03:59:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.466+0000 7fefd61c9640 1 -- 172.21.15.40:0/2892454042 wait complete. 2023-05-24T03:59:53.492 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-24T03:59:53.493 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-24T03:59:53.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-24T03:59:53.496 INFO:tasks.ceph.mds.a:Started 2023-05-24T03:59:53.497 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-24T03:59:53.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-24T03:59:53.500 INFO:tasks.ceph.mds.b:Started 2023-05-24T03:59:53.500 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-24T03:59:53.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:59:53.577 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-05-24T03:59:53.595 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-05-24T03:59:53.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.610+0000 7f36b2942640 1 Processor -- start 2023-05-24T03:59:53.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.610+0000 7f36b2942640 1 -- start start 2023-05-24T03:59:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b2942640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36ac06f970 0x7f36ac1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b2942640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac06fe80 con 0x7f36ac071160 2023-05-24T03:59:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b2942640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0c2050 con 0x7f36ac14e030 2023-05-24T03:59:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b2942640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac14e400 con 0x7f36ac06f970 2023-05-24T03:59:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36ab7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f36ac071160 0x7f36ac151ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46444/0 (socket says 172.21.15.40:46444) 2023-05-24T03:59:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36ab7fe640 1 -- 172.21.15.40:0/2803481280 learned_addr learned my addr 172.21.15.40:0/2803481280 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b0edf640 1 --2- 172.21.15.40:0/2803481280 >> v2:172.21.15.67:3300/0 conn(0x7f36ac06f970 0x7f36ac1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36aaffd640 1 -- 172.21.15.40:0/2803481280 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226742145 0 0) 0x7f36ac06fe80 con 0x7f36ac071160 2023-05-24T03:59:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36aaffd640 1 -- 172.21.15.40:0/2803481280 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3698003530 con 0x7f36ac071160 2023-05-24T03:59:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b0edf640 1 -- 172.21.15.40:0/2803481280 >> v1:172.21.15.67:6789/0 conn(0x7f36ac14e030 legacy=0x7f36ac0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b0edf640 1 -- 172.21.15.40:0/2803481280 >> v1:172.21.15.40:6789/0 conn(0x7f36ac071160 legacy=0x7f36ac151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36aaffd640 1 -- 172.21.15.40:0/2803481280 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162507613 0 0) 0x7f36ac0c2050 con 0x7f36ac14e030 2023-05-24T03:59:53.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b0edf640 1 -- 172.21.15.40:0/2803481280 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac070160 con 0x7f36ac06f970 2023-05-24T03:59:53.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36b0edf640 1 --2- 172.21.15.40:0/2803481280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac06f970 0x7f36ac1521f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009d90 tx=0x7f36a401c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b6aaf5ca4d1c50 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:53.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36aaffd640 1 -- 172.21.15.40:0/2803481280 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694001680 con 0x7f36ac06f970 2023-05-24T03:59:53.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36aaffd640 1 -- 172.21.15.40:0/2803481280 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a40a5600 con 0x7f36ac06f970 2023-05-24T03:59:53.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.614+0000 7f36aaffd640 1 -- 172.21.15.40:0/2803481280 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40a5990 con 0x7f36ac06f970 2023-05-24T03:59:53.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- 172.21.15.40:0/2803481280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac06f970 msgr2=0x7f36ac1521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 --2- 172.21.15.40:0/2803481280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac06f970 0x7f36ac1521f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009d90 tx=0x7f36a401c760 comp rx=0 tx=0).stop 2023-05-24T03:59:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- 172.21.15.40:0/2803481280 shutdown_connections 2023-05-24T03:59:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 --2- 172.21.15.40:0/2803481280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac06f970 0x7f36ac1521f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- 172.21.15.40:0/2803481280 >> 172.21.15.40:0/2803481280 conn(0x7f36ac0c13f0 msgr2=0x7f36ac0c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:53.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- 172.21.15.40:0/2803481280 shutdown_connections 2023-05-24T03:59:53.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- 172.21.15.40:0/2803481280 wait complete. 2023-05-24T03:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 Processor -- start 2023-05-24T03:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- start start 2023-05-24T03:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36ac06f970 0x7f36ac14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac071160 0x7f36ac0bb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac14e030 0x7f36ac0bb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac13d300 con 0x7f36ac071160 2023-05-24T03:59:53.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac14ed00 con 0x7f36ac14e030 2023-05-24T03:59:53.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b2942640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac14cd30 con 0x7f36ac06f970 2023-05-24T03:59:53.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac071160 0x7f36ac0bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac071160 0x7f36ac0bb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44802/0 (socket says 172.21.15.40:44802) 2023-05-24T03:59:53.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36ab7fe640 1 -- 172.21.15.40:0/3190577951 learned_addr learned my addr 172.21.15.40:0/3190577951 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:53.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36abfff640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36ac06f970 0x7f36ac14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac14e030 0x7f36ac0bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 -- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36ac06f970 msgr2=0x7f36ac14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36ac06f970 0x7f36ac14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 -- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac071160 msgr2=0x7f36ac0bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac071160 0x7f36ac0bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 -- 172.21.15.40:0/3190577951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009a70 con 0x7f36ac14e030 2023-05-24T03:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36abfff640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36ac06f970 0x7f36ac14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36b0edf640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac14e030 0x7f36ac0bb670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f36a40ac000 tx=0x7f36a4019500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.618+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40b9860 con 0x7f36ac14e030 2023-05-24T03:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a40b99c0 con 0x7f36ac14e030 2023-05-24T03:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40b9d70 con 0x7f36ac14e030 2023-05-24T03:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac15c830 con 0x7f36ac14e030 2023-05-24T03:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac15c6a0 con 0x7f36ac14e030 2023-05-24T03:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac15c9c0 con 0x7f36ac14e030 2023-05-24T03:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36a40ad440 con 0x7f36ac14e030 2023-05-24T03:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36a8ff9640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f368c066280 0x7f368c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f36a411e060 con 0x7f36ac14e030 2023-05-24T03:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36abfff640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f368c066280 0x7f368c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.622+0000 7f36abfff640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f368c066280 0x7f368c068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f369c000f70 tx=0x7f369c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.626+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f36a40eb950 con 0x7f36ac14e030 2023-05-24T03:59:53.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.782+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36ac1e9cd0 con 0x7f36ac14e030 2023-05-24T03:59:53.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.782+0000 7f36a8ff9640 1 -- 172.21.15.40:0/3190577951 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14601 (secure 0 0 0) 0x7f36ac1e9cd0 con 0x7f36ac14e030 2023-05-24T03:59:53.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:59:53.789 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T03:59:53.445964+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:59:53.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f368c066280 msgr2=0x7f368c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f368c066280 0x7f368c068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f369c000f70 tx=0x7f369c009040 comp rx=0 tx=0).stop 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac14e030 msgr2=0x7f36ac0bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac14e030 0x7f36ac0bb670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f36a40ac000 tx=0x7f36a4019500 comp rx=0 tx=0).stop 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 shutdown_connections 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f368c066280 0x7f368c068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ac14e030 0x7f36ac0bb670 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac071160 0x7f36ac0bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 --2- 172.21.15.40:0/3190577951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36ac06f970 0x7f36ac14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 >> 172.21.15.40:0/3190577951 conn(0x7f36ac0c13f0 msgr2=0x7f36ac06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:53.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 shutdown_connections 2023-05-24T03:59:53.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.786+0000 7f36b2942640 1 -- 172.21.15.40:0/3190577951 wait complete. 2023-05-24T03:59:53.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-24T03:59:53.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:59:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 Processor -- start 2023-05-24T03:59:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 -- start start 2023-05-24T03:59:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad8c070ce0 0x7fad8c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c06c2f0 0x7fad8c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c0a7a30 con 0x7fad8c156670 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c0a77c0 con 0x7fad8c070ce0 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad923b7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0a73c0 con 0x7fad8c06c2f0 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad8c070ce0 0x7fad8c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad8c070ce0 0x7fad8c06d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44804/0 (socket says 172.21.15.40:44804) 2023-05-24T03:59:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 -- 172.21.15.40:0/697491599 learned_addr learned my addr 172.21.15.40:0/697491599 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 -- 172.21.15.40:0/697491599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c06c2f0 msgr2=0x7fad8c06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/697491599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c06c2f0 0x7fad8c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 --2- 172.21.15.40:0/697491599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c06c2f0 0x7fad8c06c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 -- 172.21.15.40:0/697491599 >> v1:172.21.15.67:6789/0 conn(0x7fad8c156670 legacy=0x7fad8c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.926+0000 7fad8bfff640 1 -- 172.21.15.40:0/697491599 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c06ae90 con 0x7fad8c070ce0 2023-05-24T03:59:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad8bfff640 1 --2- 172.21.15.40:0/697491599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c070ce0 0x7fad8c06d350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e50 tx=0x7fad8401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa2af7be4d59d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad8affd640 1 -- 172.21.15.40:0/697491599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c06f3e0 con 0x7fad8c070ce0 2023-05-24T03:59:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad8affd640 1 -- 172.21.15.40:0/697491599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad840a57e0 con 0x7fad8c070ce0 2023-05-24T03:59:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad8affd640 1 -- 172.21.15.40:0/697491599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840a5b70 con 0x7fad8c070ce0 2023-05-24T03:59:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- 172.21.15.40:0/697491599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c070ce0 msgr2=0x7fad8c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 --2- 172.21.15.40:0/697491599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c070ce0 0x7fad8c06d350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e50 tx=0x7fad8401c940 comp rx=0 tx=0).stop 2023-05-24T03:59:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- 172.21.15.40:0/697491599 shutdown_connections 2023-05-24T03:59:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 --2- 172.21.15.40:0/697491599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c06c2f0 0x7fad8c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 --2- 172.21.15.40:0/697491599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c070ce0 0x7fad8c06d350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- 172.21.15.40:0/697491599 >> 172.21.15.40:0/697491599 conn(0x7fad8c0a4210 msgr2=0x7fad8c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:53.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- 172.21.15.40:0/697491599 shutdown_connections 2023-05-24T03:59:53.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- 172.21.15.40:0/697491599 wait complete. 2023-05-24T03:59:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 Processor -- start 2023-05-24T03:59:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- start start 2023-05-24T03:59:53.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 0x7fad8c13f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c070ce0 0x7fad8c13d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad8c156670 0x7fad8c13d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c14ad20 con 0x7fad8c06c2f0 2023-05-24T03:59:53.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c13fe90 con 0x7fad8c156670 2023-05-24T03:59:53.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad923b7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0a25f0 con 0x7fad8c070ce0 2023-05-24T03:59:53.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.930+0000 7fad8bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 0x7fad8c13f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 0x7fad8c13f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44822/0 (socket says 172.21.15.40:44822) 2023-05-24T03:59:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 -- 172.21.15.40:0/3891775964 learned_addr learned my addr 172.21.15.40:0/3891775964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad90954640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad8c156670 0x7fad8c13d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c070ce0 0x7fad8c13d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 -- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c070ce0 msgr2=0x7fad8c13d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c070ce0 0x7fad8c13d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 -- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad8c156670 msgr2=0x7fad8c13d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad8c156670 0x7fad8c13d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 -- 172.21.15.40:0/3891775964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009b30 con 0x7fad8c06c2f0 2023-05-24T03:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8bfff640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 0x7fad8c13f950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad840af040 tx=0x7fad840196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840b8880 con 0x7fad8c06c2f0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad840b89e0 con 0x7fad8c06c2f0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840b8d90 con 0x7fad8c06c2f0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c0a3550 con 0x7fad8c06c2f0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c0a33c0 con 0x7fad8c06c2f0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c160150 con 0x7fad8c06c2f0 2023-05-24T03:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad840b6440 con 0x7fad8c06c2f0 2023-05-24T03:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad88ff9640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fad6c0662b0 0x7fad6c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fad6c0662b0 0x7fad6c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fad8411f0f0 con 0x7fad8c06c2f0 2023-05-24T03:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.934+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fad6c0662b0 0x7fad6c068760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0a3390 tx=0x7fad74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:53.938+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fad840ec970 con 0x7fad8c06c2f0 2023-05-24T03:59:54.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.094+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad8c066d70 con 0x7fad8c06c2f0 2023-05-24T03:59:54.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.094+0000 7fad88ff9640 1 -- 172.21.15.40:0/3891775964 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad840eff90 con 0x7fad8c06c2f0 2023-05-24T03:59:54.101 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T03:59:54.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fad6c0662b0 msgr2=0x7fad6c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fad6c0662b0 0x7fad6c068760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0a3390 tx=0x7fad74008040 comp rx=0 tx=0).stop 2023-05-24T03:59:54.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 msgr2=0x7fad8c13f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 0x7fad8c13f950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad840af040 tx=0x7fad840196e0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 shutdown_connections 2023-05-24T03:59:54.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fad6c0662b0 0x7fad6c068760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad8c156670 0x7fad8c13d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad8c070ce0 0x7fad8c13d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 --2- 172.21.15.40:0/3891775964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c06c2f0 0x7fad8c13f950 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 >> 172.21.15.40:0/3891775964 conn(0x7fad8c0a4210 msgr2=0x7fad8c155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:54.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 shutdown_connections 2023-05-24T03:59:54.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.098+0000 7fad923b7640 1 -- 172.21.15.40:0/3891775964 wait complete. 2023-05-24T03:59:54.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:59:54.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 Processor -- start 2023-05-24T03:59:54.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 -- start start 2023-05-24T03:59:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb50c06d350 0x7fb50c0bef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c150310 0x7fb50c14c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0a6200 con 0x7fb50c070ce0 2023-05-24T03:59:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0a5ef0 con 0x7fb50c06d350 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb510fee640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0a5930 con 0x7fb50c150310 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb50a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb50c070ce0 0x7fb50c14fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46448/0 (socket says 172.21.15.40:46448) 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb50a59c640 1 -- 172.21.15.40:0/2255213084 learned_addr learned my addr 172.21.15.40:0/2255213084 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.230+0000 7fb509d9b640 1 --2- 172.21.15.40:0/2255213084 >> v2:172.21.15.40:3300/0 conn(0x7fb50c06d350 0x7fb50c0bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb50ad9d640 1 --2- 172.21.15.40:0/2255213084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c150310 0x7fb50c14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb50959a640 1 -- 172.21.15.40:0/2255213084 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960767720 0 0) 0x7fb4fc001120 con 0x7fb50c070ce0 2023-05-24T03:59:54.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb50959a640 1 -- 172.21.15.40:0/2255213084 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f4003530 con 0x7fb50c070ce0 2023-05-24T03:59:54.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb509d9b640 1 -- 172.21.15.40:0/2255213084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c150310 msgr2=0x7fb50c14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:54.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb509d9b640 1 --2- 172.21.15.40:0/2255213084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c150310 0x7fb50c14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb509d9b640 1 -- 172.21.15.40:0/2255213084 >> v1:172.21.15.40:6789/0 conn(0x7fb50c070ce0 legacy=0x7fb50c14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb509d9b640 1 -- 172.21.15.40:0/2255213084 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0a5c10 con 0x7fb50c06d350 2023-05-24T03:59:54.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb509d9b640 1 --2- 172.21.15.40:0/2255213084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c0bef10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097c0 tx=0x7fb50001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcdd9e8e0049d1e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb50959a640 1 -- 172.21.15.40:0/2255213084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000ad640 con 0x7fb50c06d350 2023-05-24T03:59:54.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb50959a640 1 -- 172.21.15.40:0/2255213084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5000ad7a0 con 0x7fb50c06d350 2023-05-24T03:59:54.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb50959a640 1 -- 172.21.15.40:0/2255213084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000adb30 con 0x7fb50c06d350 2023-05-24T03:59:54.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 -- 172.21.15.40:0/2255213084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 msgr2=0x7fb50c0bef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 --2- 172.21.15.40:0/2255213084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c0bef10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097c0 tx=0x7fb50001c480 comp rx=0 tx=0).stop 2023-05-24T03:59:54.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 -- 172.21.15.40:0/2255213084 shutdown_connections 2023-05-24T03:59:54.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 --2- 172.21.15.40:0/2255213084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c0bef10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 --2- 172.21.15.40:0/2255213084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c150310 0x7fb50c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 -- 172.21.15.40:0/2255213084 >> 172.21.15.40:0/2255213084 conn(0x7fb50c0a4210 msgr2=0x7fb50c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:54.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 -- 172.21.15.40:0/2255213084 shutdown_connections 2023-05-24T03:59:54.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.234+0000 7fb510fee640 1 -- 172.21.15.40:0/2255213084 wait complete. 2023-05-24T03:59:54.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 Processor -- start 2023-05-24T03:59:54.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- start start 2023-05-24T03:59:54.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c1ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c070ce0 0x7fb50c1e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb50c150310 0x7fb50c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c1c60 con 0x7fb50c06d350 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c1e9b70 con 0x7fb50c150310 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c143b50 con 0x7fb50c070ce0 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c1ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c1ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44832/0 (socket says 172.21.15.40:44832) 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 -- 172.21.15.40:0/3575640337 learned_addr learned my addr 172.21.15.40:0/3575640337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:54.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb509d9b640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c070ce0 0x7fb50c1e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50ad9d640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb50c150310 0x7fb50c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 -- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c070ce0 msgr2=0x7fb50c1e65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c070ce0 0x7fb50c1e65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 -- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb50c150310 msgr2=0x7fb50c0c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb50c150310 0x7fb50c0c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 -- 172.21.15.40:0/3575640337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500009420 con 0x7fb50c06d350 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50ad9d640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb50c150310 0x7fb50c0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb50a59c640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c1ea2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c4d0 tx=0x7fb4fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc005cf0 con 0x7fb50c06d350 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc005e50 con 0x7fb50c06d350 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0a79b0 con 0x7fb50c06d350 2023-05-24T03:59:54.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc007290 con 0x7fb50c06d350 2023-05-24T03:59:54.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0a7820 con 0x7fb50c06d350 2023-05-24T03:59:54.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c1593d0 con 0x7fb50c06d350 2023-05-24T03:59:54.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb4fc0073f0 con 0x7fb50c06d350 2023-05-24T03:59:54.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb4faffd640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb4ec0662b0 0x7fb4ec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb4fc082e20 con 0x7fb50c06d350 2023-05-24T03:59:54.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.238+0000 7fb509d9b640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb4ec0662b0 0x7fb4ec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.242+0000 7fb509d9b640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb4ec0662b0 0x7fb4ec068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5000af000 tx=0x7fb500008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.246+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb4fc0505f0 con 0x7fb50c06d350 2023-05-24T03:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.398+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb50c1e9fc0 con 0x7fb50c06d350 2023-05-24T03:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.398+0000 7fb4faffd640 1 -- 172.21.15.40:0/3575640337 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb50c1e9fc0 con 0x7fb50c06d350 2023-05-24T03:59:54.405 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T03:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb4ec0662b0 msgr2=0x7fb4ec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb4ec0662b0 0x7fb4ec068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5000af000 tx=0x7fb500008040 comp rx=0 tx=0).stop 2023-05-24T03:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 msgr2=0x7fb50c1ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c1ea2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c4d0 tx=0x7fb4fc00c990 comp rx=0 tx=0).stop 2023-05-24T03:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 shutdown_connections 2023-05-24T03:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb4ec0662b0 0x7fb4ec068760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb50c150310 0x7fb50c0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb50c070ce0 0x7fb50c1e65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 --2- 172.21.15.40:0/3575640337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50c06d350 0x7fb50c1ea2a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 >> 172.21.15.40:0/3575640337 conn(0x7fb50c0a4210 msgr2=0x7fb50c06e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 shutdown_connections 2023-05-24T03:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.402+0000 7fb510fee640 1 -- 172.21.15.40:0/3575640337 wait complete. 2023-05-24T03:59:54.423 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:59:54.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.542+0000 7f3eb1589640 1 Processor -- start 2023-05-24T03:59:54.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.542+0000 7f3eb1589640 1 -- start start 2023-05-24T03:59:54.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3eac0a3290 0x7f3eac071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac14b240 con 0x7f3eac14bfe0 2023-05-24T03:59:54.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac06e810 con 0x7f3eac0a3290 2023-05-24T03:59:54.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac06ea20 con 0x7f3eac14aa30 2023-05-24T03:59:54.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3eac0a3290 0x7f3eac071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3eac0a3290 0x7f3eac071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44836/0 (socket says 172.21.15.40:44836) 2023-05-24T03:59:54.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 -- 172.21.15.40:0/3127372838 learned_addr learned my addr 172.21.15.40:0/3127372838 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:54.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaaffd640 1 --2- 172.21.15.40:0/3127372838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 -- 172.21.15.40:0/3127372838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 msgr2=0x7f3eac071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:54.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 --2- 172.21.15.40:0/3127372838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 -- 172.21.15.40:0/3127372838 >> v1:172.21.15.67:6789/0 conn(0x7f3eac14bfe0 legacy=0x7f3eac06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:54.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 -- 172.21.15.40:0/3127372838 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac06bfa0 con 0x7f3eac0a3290 2023-05-24T03:59:54.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eaa7fc640 1 --2- 172.21.15.40:0/3127372838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac0a3290 0x7f3eac071640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00098d0 tx=0x7f3ea001e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39309048e1dfce10 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3ea9ffb640 1 -- 172.21.15.40:0/3127372838 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00ac650 con 0x7f3eac0a3290 2023-05-24T03:59:54.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3ea9ffb640 1 -- 172.21.15.40:0/3127372838 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00ac7b0 con 0x7f3eac0a3290 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3ea9ffb640 1 -- 172.21.15.40:0/3127372838 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00acb40 con 0x7f3eac0a3290 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- 172.21.15.40:0/3127372838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac0a3290 msgr2=0x7f3eac071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 --2- 172.21.15.40:0/3127372838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac0a3290 0x7f3eac071640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00098d0 tx=0x7f3ea001e710 comp rx=0 tx=0).stop 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- 172.21.15.40:0/3127372838 shutdown_connections 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 --2- 172.21.15.40:0/3127372838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac0a3290 0x7f3eac071640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 --2- 172.21.15.40:0/3127372838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- 172.21.15.40:0/3127372838 >> 172.21.15.40:0/3127372838 conn(0x7f3eac0c0280 msgr2=0x7f3eac0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:54.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- 172.21.15.40:0/3127372838 shutdown_connections 2023-05-24T03:59:54.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.546+0000 7f3eb1589640 1 -- 172.21.15.40:0/3127372838 wait complete. 2023-05-24T03:59:54.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 Processor -- start 2023-05-24T03:59:54.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- start start 2023-05-24T03:59:54.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3eac14bfe0 0x7f3eac13ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 0x7f3eac13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac14db80 con 0x7f3eac13bd20 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac13df30 con 0x7f3eac14bfe0 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac1e2750 con 0x7f3eac14aa30 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 0x7f3eac13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 0x7f3eac13fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44838/0 (socket says 172.21.15.40:44838) 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 -- 172.21.15.40:0/1318918931 learned_addr learned my addr 172.21.15.40:0/1318918931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eaaffd640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eaa7fc640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3eac14bfe0 0x7f3eac13ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 -- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 msgr2=0x7f3eac14c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac14c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 -- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3eac14bfe0 msgr2=0x7f3eac13ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3eac14bfe0 0x7f3eac13ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 -- 172.21.15.40:0/1318918931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00094d0 con 0x7f3eac13bd20 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eab7fe640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 0x7f3eac13fda0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400b9e0 tx=0x7f3ea400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4003b80 con 0x7f3eac13bd20 2023-05-24T03:59:54.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4003ce0 con 0x7f3eac13bd20 2023-05-24T03:59:54.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac14af90 con 0x7f3eac13bd20 2023-05-24T03:59:54.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400cb60 con 0x7f3eac13bd20 2023-05-24T03:59:54.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac14ae00 con 0x7f3eac13bd20 2023-05-24T03:59:54.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac06cb60 con 0x7f3eac13bd20 2023-05-24T03:59:54.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.550+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ea400ccc0 con 0x7f3eac13bd20 2023-05-24T03:59:54.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.554+0000 7f3e937fe640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3e98066280 0x7f3e98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.554+0000 7f3eaaffd640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3e98066280 0x7f3e98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.554+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3ea4083690 con 0x7f3eac13bd20 2023-05-24T03:59:54.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.554+0000 7f3eaaffd640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3e98066280 0x7f3e98068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b9d0 tx=0x7f3e9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.558+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3ea4050ef0 con 0x7f3eac13bd20 2023-05-24T03:59:54.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.738+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3eac14f3f0 con 0x7f3eac13bd20 2023-05-24T03:59:54.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.738+0000 7f3e937fe640 1 -- 172.21.15.40:0/1318918931 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2114 (secure 0 0 0) 0x7f3ea4054510 con 0x7f3eac13bd20 2023-05-24T03:59:54.744 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:59:54.745 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-05-24T03:59:54.745 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2023-05-24T03:59:54.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3e98066280 msgr2=0x7f3e98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3e98066280 0x7f3e98068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b9d0 tx=0x7f3e9c008040 comp rx=0 tx=0).stop 2023-05-24T03:59:54.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 msgr2=0x7f3eac13fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 0x7f3eac13fda0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400b9e0 tx=0x7f3ea400bea0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 shutdown_connections 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3e98066280 0x7f3e98068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3eac13bd20 0x7f3eac13fda0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3eac14bfe0 0x7f3eac13ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 --2- 172.21.15.40:0/1318918931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3eac14aa30 0x7f3eac14c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 >> 172.21.15.40:0/1318918931 conn(0x7f3eac0c0280 msgr2=0x7f3eac071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 shutdown_connections 2023-05-24T03:59:54.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.742+0000 7f3eb1589640 1 -- 172.21.15.40:0/1318918931 wait complete. 2023-05-24T03:59:54.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:59:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.866+0000 7ffa0edb0640 1 Processor -- start 2023-05-24T03:59:54.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.866+0000 7ffa0edb0640 1 -- start start 2023-05-24T03:59:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa0edb0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa080c2690 0x7ffa081505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa0edb0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa080be9b0 0x7ffa080bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa0edb0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa080bd630 con 0x7ffa0806e6d0 2023-05-24T03:59:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa0edb0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa080bd070 con 0x7ffa080be9b0 2023-05-24T03:59:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa0edb0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa080bcb50 con 0x7ffa080c2690 2023-05-24T03:59:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa080be9b0 0x7ffa080bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa080be9b0 0x7ffa080bf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44858/0 (socket says 172.21.15.40:44858) 2023-05-24T03:59:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 -- 172.21.15.40:0/1495764733 learned_addr learned my addr 172.21.15.40:0/1495764733 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 -- 172.21.15.40:0/1495764733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa080c2690 msgr2=0x7ffa081505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 --2- 172.21.15.40:0/1495764733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa080c2690 0x7ffa081505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 -- 172.21.15.40:0/1495764733 >> v1:172.21.15.67:6789/0 conn(0x7ffa0806e6d0 legacy=0x7ffa0806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 -- 172.21.15.40:0/1495764733 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa080bd2c0 con 0x7ffa080be9b0 2023-05-24T03:59:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa07fff640 1 --2- 172.21.15.40:0/1495764733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080be9b0 0x7ffa080bf9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80098a0 tx=0x7ff9f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947aadceb2698eaf server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa077fe640 1 -- 172.21.15.40:0/1495764733 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80a7070 con 0x7ffa080be9b0 2023-05-24T03:59:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa077fe640 1 -- 172.21.15.40:0/1495764733 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f80ab430 con 0x7ffa080be9b0 2023-05-24T03:59:54.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.870+0000 7ffa077fe640 1 -- 172.21.15.40:0/1495764733 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80ab7c0 con 0x7ffa080be9b0 2023-05-24T03:59:54.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1495764733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080be9b0 msgr2=0x7ffa080bf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1495764733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080be9b0 0x7ffa080bf9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80098a0 tx=0x7ff9f801c450 comp rx=0 tx=0).stop 2023-05-24T03:59:54.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1495764733 shutdown_connections 2023-05-24T03:59:54.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1495764733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080be9b0 0x7ffa080bf9e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1495764733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa080c2690 0x7ffa081505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1495764733 >> 172.21.15.40:0/1495764733 conn(0x7ffa080726e0 msgr2=0x7ffa080655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1495764733 shutdown_connections 2023-05-24T03:59:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1495764733 wait complete. 2023-05-24T03:59:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 Processor -- start 2023-05-24T03:59:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- start start 2023-05-24T03:59:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa0806e6d0 0x7ffa0814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa080be9b0 0x7ffa081e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 0x7ffa0814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0813f490 con 0x7ffa080c2690 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0814ef90 con 0x7ffa080be9b0 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa080a5020 con 0x7ffa0806e6d0 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 0x7ffa0814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 0x7ffa0814ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44860/0 (socket says 172.21.15.40:44860) 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 -- 172.21.15.40:0/1135762475 learned_addr learned my addr 172.21.15.40:0/1135762475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa07fff640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa080be9b0 0x7ffa081e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0cb4c640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa0806e6d0 0x7ffa0814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 -- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa0806e6d0 msgr2=0x7ffa0814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa0806e6d0 0x7ffa0814ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 -- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa080be9b0 msgr2=0x7ffa081e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa080be9b0 0x7ffa081e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 -- 172.21.15.40:0/1135762475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80094d0 con 0x7ffa080c2690 2023-05-24T03:59:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa07fff640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa080be9b0 0x7ffa081e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0d34d640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 0x7ffa0814ac10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c780 tx=0x7ffa0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00003d90 con 0x7ffa080c2690 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0000ce90 con 0x7ffa080c2690 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa000052b0 con 0x7ffa080c2690 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa081598a0 con 0x7ffa080c2690 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.874+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa08159710 con 0x7ffa080c2690 2023-05-24T03:59:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.878+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa08159a30 con 0x7ffa080c2690 2023-05-24T03:59:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.878+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa00005410 con 0x7ffa080c2690 2023-05-24T03:59:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.878+0000 7ffa057fa640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff9f4066280 0x7ff9f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.878+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa00082ee0 con 0x7ffa080c2690 2023-05-24T03:59:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.878+0000 7ffa0cb4c640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff9f4066280 0x7ff9f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.878+0000 7ffa0cb4c640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff9f4066280 0x7ff9f4068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00a790 tx=0x7ff9fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:54.882+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffa000506b0 con 0x7ffa080c2690 2023-05-24T03:59:55.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.034+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa08143120 con 0x7ffa080c2690 2023-05-24T03:59:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.034+0000 7ffa057fa640 1 -- 172.21.15.40:0/1135762475 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14588 (secure 0 0 0) 0x7ffa00017090 con 0x7ffa080c2690 2023-05-24T03:59:55.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:59:55.041 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T03:59:54.455709+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:59:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff9f4066280 msgr2=0x7ff9f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff9f4066280 0x7ff9f4068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00a790 tx=0x7ff9fc008040 comp rx=0 tx=0).stop 2023-05-24T03:59:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 msgr2=0x7ffa0814ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 0x7ffa0814ac10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c780 tx=0x7ffa0000cc40 comp rx=0 tx=0).stop 2023-05-24T03:59:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 shutdown_connections 2023-05-24T03:59:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff9f4066280 0x7ff9f4068730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa080c2690 0x7ffa0814ac10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa080be9b0 0x7ffa081e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 --2- 172.21.15.40:0/1135762475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa0806e6d0 0x7ffa0814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 >> 172.21.15.40:0/1135762475 conn(0x7ffa080726e0 msgr2=0x7ffa08146c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 shutdown_connections 2023-05-24T03:59:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.038+0000 7ffa0edb0640 1 -- 172.21.15.40:0/1135762475 wait complete. 2023-05-24T03:59:55.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-24T03:59:55.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:59:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.166+0000 7f8a6a8db640 1 Processor -- start 2023-05-24T03:59:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.166+0000 7f8a6a8db640 1 -- start start 2023-05-24T03:59:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a6406d580 0x7f8a640699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6414f880 con 0x7f8a641526e0 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6414e970 con 0x7f8a640bcc80 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a64152bc0 con 0x7f8a6406d580 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a637fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a641526e0 0x7f8a6414f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46462/0 (socket says 172.21.15.40:46462) 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a637fe640 1 -- 172.21.15.40:0/618189622 learned_addr learned my addr 172.21.15.40:0/618189622 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a68e78640 1 --2- 172.21.15.40:0/618189622 >> v2:172.21.15.40:3300/0 conn(0x7f8a6406d580 0x7f8a640699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a62ffd640 1 -- 172.21.15.40:0/618189622 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566935489 0 0) 0x7f8a6414f880 con 0x7f8a641526e0 2023-05-24T03:59:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a62ffd640 1 -- 172.21.15.40:0/618189622 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a4c003530 con 0x7f8a641526e0 2023-05-24T03:59:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a68e78640 1 -- 172.21.15.40:0/618189622 >> v1:172.21.15.67:6789/0 conn(0x7f8a640bcc80 legacy=0x7f8a640bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a68e78640 1 -- 172.21.15.40:0/618189622 >> v1:172.21.15.40:6789/0 conn(0x7f8a641526e0 legacy=0x7f8a6414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a68e78640 1 -- 172.21.15.40:0/618189622 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6414ec50 con 0x7f8a6406d580 2023-05-24T03:59:55.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a68e78640 1 --2- 172.21.15.40:0/618189622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6406d580 0x7f8a640699e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0097c0 tx=0x7f8a5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641f03214f92797b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a62ffd640 1 -- 172.21.15.40:0/618189622 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0ab600 con 0x7f8a6406d580 2023-05-24T03:59:55.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a62ffd640 1 -- 172.21.15.40:0/618189622 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0a7050 con 0x7f8a6406d580 2023-05-24T03:59:55.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a62ffd640 1 -- 172.21.15.40:0/618189622 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0ab980 con 0x7f8a6406d580 2023-05-24T03:59:55.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 -- 172.21.15.40:0/618189622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6406d580 msgr2=0x7f8a640699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/618189622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6406d580 0x7f8a640699e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0097c0 tx=0x7f8a5c01c480 comp rx=0 tx=0).stop 2023-05-24T03:59:55.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 -- 172.21.15.40:0/618189622 shutdown_connections 2023-05-24T03:59:55.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/618189622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6406d580 0x7f8a640699e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.170+0000 7f8a6a8db640 1 -- 172.21.15.40:0/618189622 >> 172.21.15.40:0/618189622 conn(0x7f8a6406b780 msgr2=0x7f8a640c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- 172.21.15.40:0/618189622 shutdown_connections 2023-05-24T03:59:55.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- 172.21.15.40:0/618189622 wait complete. 2023-05-24T03:59:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 Processor -- start 2023-05-24T03:59:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- start start 2023-05-24T03:59:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a6406d580 0x7f8a640a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a640bcc80 0x7f8a6414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 0x7f8a641e7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a641e70e0 con 0x7f8a641526e0 2023-05-24T03:59:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a640a58a0 con 0x7f8a640bcc80 2023-05-24T03:59:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a64150370 con 0x7f8a6406d580 2023-05-24T03:59:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 0x7f8a641e7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 0x7f8a641e7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44888/0 (socket says 172.21.15.40:44888) 2023-05-24T03:59:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 -- 172.21.15.40:0/1679634537 learned_addr learned my addr 172.21.15.40:0/1679634537 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a637fe640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a640bcc80 0x7f8a6414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 -- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a6406d580 msgr2=0x7f8a640a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a6406d580 0x7f8a640a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 -- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a640bcc80 msgr2=0x7f8a6414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a640bcc80 0x7f8a6414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 -- 172.21.15.40:0/1679634537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c009420 con 0x7f8a641526e0 2023-05-24T03:59:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a68e78640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 0x7f8a641e7570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0ae040 tx=0x7f8a5c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0b4410 con 0x7f8a641526e0 2023-05-24T03:59:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0b4570 con 0x7f8a641526e0 2023-05-24T03:59:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0b4900 con 0x7f8a641526e0 2023-05-24T03:59:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6415c870 con 0x7f8a641526e0 2023-05-24T03:59:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a640bd050 con 0x7f8a641526e0 2023-05-24T03:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.174+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6415ca00 con 0x7f8a641526e0 2023-05-24T03:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.178+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a5c0b2040 con 0x7f8a641526e0 2023-05-24T03:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.178+0000 7f8a60ff9640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8a50066280 0x7f8a50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.178+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8a5c11da70 con 0x7f8a641526e0 2023-05-24T03:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.178+0000 7f8a63fff640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8a50066280 0x7f8a50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.178+0000 7f8a63fff640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8a50066280 0x7f8a50068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f70 tx=0x7f8a580079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.182+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8a5c0eb230 con 0x7f8a641526e0 2023-05-24T03:59:55.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.326+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a64066d70 con 0x7f8a641526e0 2023-05-24T03:59:55.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.326+0000 7f8a60ff9640 1 -- 172.21.15.40:0/1679634537 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a5c0b0070 con 0x7f8a641526e0 2023-05-24T03:59:55.333 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T03:59:55.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8a50066280 msgr2=0x7f8a50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8a50066280 0x7f8a50068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f70 tx=0x7f8a580079c0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 msgr2=0x7f8a641e7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 0x7f8a641e7570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0ae040 tx=0x7f8a5c019220 comp rx=0 tx=0).stop 2023-05-24T03:59:55.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 shutdown_connections 2023-05-24T03:59:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8a50066280 0x7f8a50068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a641526e0 0x7f8a641e7570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a640bcc80 0x7f8a6414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 --2- 172.21.15.40:0/1679634537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a6406d580 0x7f8a640a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 >> 172.21.15.40:0/1679634537 conn(0x7f8a6406b780 msgr2=0x7f8a640bfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 shutdown_connections 2023-05-24T03:59:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.330+0000 7f8a6a8db640 1 -- 172.21.15.40:0/1679634537 wait complete. 2023-05-24T03:59:55.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:59:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.470+0000 7f4828f8e640 1 Processor -- start 2023-05-24T03:59:55.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.470+0000 7f4828f8e640 1 -- start start 2023-05-24T03:59:55.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4828f8e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4824151be0 0x7f4824070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4828f8e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48241526e0 0x7f4824070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4828f8e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240714a0 0x7f482414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4828f8e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240a6110 con 0x7f4824151be0 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4828f8e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240a6360 con 0x7f48241526e0 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4828f8e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482406f1d0 con 0x7f48240714a0 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4824151be0 0x7f4824070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4824151be0 0x7f4824070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44898/0 (socket says 172.21.15.40:44898) 2023-05-24T03:59:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 -- 172.21.15.40:0/533849582 learned_addr learned my addr 172.21.15.40:0/533849582 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4821d9b640 1 --2- 172.21.15.40:0/533849582 >> v2:172.21.15.67:3300/0 conn(0x7f48241526e0 0x7f4824070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f4822d9d640 1 --2- 172.21.15.40:0/533849582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240714a0 0x7f482414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 -- 172.21.15.40:0/533849582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240714a0 msgr2=0x7f482414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 --2- 172.21.15.40:0/533849582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240714a0 0x7f482414d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 -- 172.21.15.40:0/533849582 >> v2:172.21.15.67:3300/0 conn(0x7f48241526e0 msgr2=0x7f4824070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 --2- 172.21.15.40:0/533849582 >> v2:172.21.15.67:3300/0 conn(0x7f48241526e0 0x7f4824070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 -- 172.21.15.40:0/533849582 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48240a6860 con 0x7f4824151be0 2023-05-24T03:59:55.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.474+0000 7f482259c640 1 --2- 172.21.15.40:0/533849582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4824151be0 0x7f4824070350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f482406a8d0 tx=0x7f481c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63faf4a051ba450c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f482159a640 1 -- 172.21.15.40:0/533849582 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824070fe0 con 0x7f4824151be0 2023-05-24T03:59:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f482159a640 1 -- 172.21.15.40:0/533849582 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c0ac620 con 0x7f4824151be0 2023-05-24T03:59:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f482159a640 1 -- 172.21.15.40:0/533849582 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0ac9b0 con 0x7f4824151be0 2023-05-24T03:59:55.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- 172.21.15.40:0/533849582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4824151be0 msgr2=0x7f4824070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- 172.21.15.40:0/533849582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4824151be0 0x7f4824070350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f482406a8d0 tx=0x7f481c01c3e0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- 172.21.15.40:0/533849582 shutdown_connections 2023-05-24T03:59:55.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- 172.21.15.40:0/533849582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240714a0 0x7f482414d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- 172.21.15.40:0/533849582 >> v2:172.21.15.67:3300/0 conn(0x7f48241526e0 0x7f4824070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- 172.21.15.40:0/533849582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4824151be0 0x7f4824070350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- 172.21.15.40:0/533849582 >> 172.21.15.40:0/533849582 conn(0x7f48240c0ba0 msgr2=0x7f48240c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- 172.21.15.40:0/533849582 shutdown_connections 2023-05-24T03:59:55.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- 172.21.15.40:0/533849582 wait complete. 2023-05-24T03:59:55.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 Processor -- start 2023-05-24T03:59:55.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- start start 2023-05-24T03:59:55.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48240714a0 0x7f4824144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4824151be0 0x7f4824141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 0x7f4824141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241e9f50 con 0x7f48241526e0 2023-05-24T03:59:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4824145020 con 0x7f48240714a0 2023-05-24T03:59:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.478+0000 7f4828f8e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48241515f0 con 0x7f4824151be0 2023-05-24T03:59:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 0x7f4824141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 0x7f4824141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44900/0 (socket says 172.21.15.40:44900) 2023-05-24T03:59:55.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 -- 172.21.15.40:0/3458191520 learned_addr learned my addr 172.21.15.40:0/3458191520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:55.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f482259c640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48240714a0 0x7f4824144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4821d9b640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4824151be0 0x7f4824141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 -- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4824151be0 msgr2=0x7f4824141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4824151be0 0x7f4824141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 -- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48240714a0 msgr2=0x7f4824144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48240714a0 0x7f4824144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 -- 172.21.15.40:0/3458191520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0094d0 con 0x7f48241526e0 2023-05-24T03:59:55.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4821d9b640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4824151be0 0x7f4824141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:55.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4822d9d640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 0x7f4824141e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4814007e60 tx=0x7f481400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814014420 con 0x7f48241526e0 2023-05-24T03:59:55.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814014580 con 0x7f48241526e0 2023-05-24T03:59:55.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814014930 con 0x7f48241526e0 2023-05-24T03:59:55.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482414e8d0 con 0x7f48241526e0 2023-05-24T03:59:55.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482414e740 con 0x7f48241526e0 2023-05-24T03:59:55.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482414ea60 con 0x7f48241526e0 2023-05-24T03:59:55.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4814014a90 con 0x7f48241526e0 2023-05-24T03:59:55.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f481affd640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4804066280 0x7f4804068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4814084320 con 0x7f48241526e0 2023-05-24T03:59:55.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f482259c640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4804066280 0x7f4804068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.482+0000 7f482259c640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4804066280 0x7f4804068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f481c0ae000 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.490+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4814051ae0 con 0x7f48241526e0 2023-05-24T03:59:55.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.642+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4824066d70 con 0x7f48241526e0 2023-05-24T03:59:55.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.642+0000 7f481affd640 1 -- 172.21.15.40:0/3458191520 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4814055100 con 0x7f48241526e0 2023-05-24T03:59:55.650 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T03:59:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4804066280 msgr2=0x7f4804068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4804066280 0x7f4804068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f481c0ae000 tx=0x7f481c008040 comp rx=0 tx=0).stop 2023-05-24T03:59:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 msgr2=0x7f4824141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 0x7f4824141e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4814007e60 tx=0x7f481400e4b0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 shutdown_connections 2023-05-24T03:59:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4804066280 0x7f4804068730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48241526e0 0x7f4824141e70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4824151be0 0x7f4824141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 --2- 172.21.15.40:0/3458191520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48240714a0 0x7f4824144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 >> 172.21.15.40:0/3458191520 conn(0x7f48240c0ba0 msgr2=0x7f4824070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 shutdown_connections 2023-05-24T03:59:55.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.646+0000 7f4828f8e640 1 -- 172.21.15.40:0/3458191520 wait complete. 2023-05-24T03:59:55.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-24T03:59:55.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.782+0000 7fa6df1db640 1 Processor -- start 2023-05-24T03:59:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.782+0000 7fa6df1db640 1 -- start start 2023-05-24T03:59:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6df1db640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6d8152530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6df1db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d80b8040 con 0x7fa6d80bef60 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6df1db640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d80b7df0 con 0x7fa6d80a3da0 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6df1db640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80c1660 con 0x7fa6d80c11c0 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dcf77640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa6d80bef60 0x7fa6d80c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46464/0 (socket says 172.21.15.40:46464) 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dcf77640 1 -- 172.21.15.40:0/1090312354 learned_addr learned my addr 172.21.15.40:0/1090312354 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dd778640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6d8152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779598748 0 0) 0x7fa6c8001120 con 0x7fa6d80bef60 2023-05-24T03:59:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c0003530 con 0x7fa6d80bef60 2023-05-24T03:59:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2901531100 0 0) 0x7fa6c0003530 con 0x7fa6d80bef60 2023-05-24T03:59:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 msgr2=0x7fa6d8152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6d8152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 >> v1:172.21.15.67:6789/0 conn(0x7fa6d80a3da0 legacy=0x7fa6d8151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80a38d0 con 0x7fa6d80bef60 2023-05-24T03:59:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fa6c8001810 con 0x7fa6d80bef60 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dd778640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6d8152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 >> v1:172.21.15.40:6789/0 conn(0x7fa6d80bef60 legacy=0x7fa6d80c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6c00039b0 0x7fa6c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000bb20 con 0x7fa6c00047d0 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000bc90 con 0x7fa6c00039b0 2023-05-24T03:59:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000be50 con 0x7fa6d80c11c0 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dcf77640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6c00039b0 0x7fa6c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dd778640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d7fff640 1 -- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 msgr2=0x7fa6c0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80c11c0 0x7fa6c0005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d7fff640 1 -- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6c00039b0 msgr2=0x7fa6c0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6c00039b0 0x7fa6c0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6d7fff640 1 -- 172.21.15.40:0/1090312354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0003530 con 0x7fa6c00047d0 2023-05-24T03:59:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.786+0000 7fa6dcf77640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6c00039b0 0x7fa6c0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6c0004c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc001750 tx=0x7fa6cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a3a1e9732909e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0052d0 con 0x7fa6c00047d0 2023-05-24T03:59:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc0a7050 con 0x7fa6c00047d0 2023-05-24T03:59:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d77fe640 1 -- 172.21.15.40:0/1090312354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc003600 con 0x7fa6c00047d0 2023-05-24T03:59:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1090312354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 msgr2=0x7fa6c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1090312354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6c0004c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc001750 tx=0x7fa6cc01c3c0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dd778640 1 -- 172.21.15.40:0/1090312354 reap_dead start 2023-05-24T03:59:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1090312354 shutdown_connections 2023-05-24T03:59:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1090312354 >> 172.21.15.40:0/1090312354 conn(0x7fa6d8065bb0 msgr2=0x7fa6d80a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1090312354 shutdown_connections 2023-05-24T03:59:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1090312354 wait complete. 2023-05-24T03:59:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 Processor -- start 2023-05-24T03:59:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- start start 2023-05-24T03:59:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6d81ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80b5230 0x7fa6d80b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d80b68b0 0x7fa6d81e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81e66b0 con 0x7fa6c00047d0 2023-05-24T03:59:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81eaba0 con 0x7fa6d80b68b0 2023-05-24T03:59:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81e68a0 con 0x7fa6d80b5230 2023-05-24T03:59:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6d81ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6d81ea300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44912/0 (socket says 172.21.15.40:44912) 2023-05-24T03:59:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 -- 172.21.15.40:0/1203311683 learned_addr learned my addr 172.21.15.40:0/1203311683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80b5230 0x7fa6d80b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dd778640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d80b68b0 0x7fa6d81e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 -- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80b5230 msgr2=0x7fa6d80b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80b5230 0x7fa6d80b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 -- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d80b68b0 msgr2=0x7fa6d81e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d80b68b0 0x7fa6d81e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 -- 172.21.15.40:0/1203311683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80bb5d0 con 0x7fa6c00047d0 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6dcf77640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6d81ea300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8007fd0 tx=0x7fa6c800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80074e0 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8007640 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d80bb440 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80049f0 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.790+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80c3410 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.794+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d81e6d40 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.794+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6c8004b50 con 0x7fa6c00047d0 2023-05-24T03:59:55.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.794+0000 7fa6d57fa640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa6c4066280 0x7fa6c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:55.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.794+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa6c80839c0 con 0x7fa6c00047d0 2023-05-24T03:59:55.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.794+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa6c4066280 0x7fa6c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:55.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.794+0000 7fa6d7fff640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa6c4066280 0x7fa6c4068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80a4190 tx=0x7fa6cc0011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:55.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.798+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa6c8054d00 con 0x7fa6c00047d0 2023-05-24T03:59:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.946+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa6d80b8040 con 0x7fa6c00047d0 2023-05-24T03:59:55.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6d57fa640 1 -- 172.21.15.40:0/1203311683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa6d80b8040 con 0x7fa6c00047d0 2023-05-24T03:59:55.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T03:59:55.954 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 2, 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "rbd" 2023-05-24T03:59:55.955 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-24T03:59:55.956 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-05-24T03:59:55.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa6c4066280 msgr2=0x7fa6c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa6c4066280 0x7fa6c4068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80a4190 tx=0x7fa6cc0011a0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 msgr2=0x7fa6d81ea300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6d81ea300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8007fd0 tx=0x7fa6c800dd40 comp rx=0 tx=0).stop 2023-05-24T03:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 shutdown_connections 2023-05-24T03:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa6c4066280 0x7fa6c4068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d80b68b0 0x7fa6d81e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d80b5230 0x7fa6d80b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 --2- 172.21.15.40:0/1203311683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6c00047d0 0x7fa6d81ea300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 >> 172.21.15.40:0/1203311683 conn(0x7fa6d8065bb0 msgr2=0x7fa6d80b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 shutdown_connections 2023-05-24T03:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:55.950+0000 7fa6df1db640 1 -- 172.21.15.40:0/1203311683 wait complete. 2023-05-24T03:59:55.971 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-24T03:59:55.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-24T03:59:56.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 Processor -- start 2023-05-24T03:59:56.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 -- start start 2023-05-24T03:59:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27f014e6a0 0x7f27f014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014f630 0x7f27f0151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00be610 con 0x7f27f00bbd00 2023-05-24T03:59:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00be8f0 con 0x7f27f014e6a0 2023-05-24T03:59:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27f511e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00bebd0 con 0x7f27f014f630 2023-05-24T03:59:56.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27f014e6a0 0x7f27f014f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27f014e6a0 0x7f27f014f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44924/0 (socket says 172.21.15.40:44924) 2023-05-24T03:59:56.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 -- 172.21.15.40:0/845657021 learned_addr learned my addr 172.21.15.40:0/845657021 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:56.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ef59e640 1 --2- 172.21.15.40:0/845657021 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014f630 0x7f27f0151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 -- 172.21.15.40:0/845657021 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014f630 msgr2=0x7f27f0151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:56.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 --2- 172.21.15.40:0/845657021 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014f630 0x7f27f0151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 -- 172.21.15.40:0/845657021 >> v1:172.21.15.67:6789/0 conn(0x7f27f00bbd00 legacy=0x7f27f00bde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.082+0000 7f27ee59c640 1 -- 172.21.15.40:0/845657021 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00bc0d0 con 0x7f27f014e6a0 2023-05-24T03:59:56.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27ee59c640 1 --2- 172.21.15.40:0/845657021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014e6a0 0x7f27f014f0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009870 tx=0x7f27e401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2087f13afb0296 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:56.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27edd9b640 1 -- 172.21.15.40:0/845657021 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0152c20 con 0x7f27f014e6a0 2023-05-24T03:59:56.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27edd9b640 1 -- 172.21.15.40:0/845657021 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e40a9620 con 0x7f27f014e6a0 2023-05-24T03:59:56.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27edd9b640 1 -- 172.21.15.40:0/845657021 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40a99b0 con 0x7f27f014e6a0 2023-05-24T03:59:56.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- 172.21.15.40:0/845657021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014e6a0 msgr2=0x7f27f014f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 --2- 172.21.15.40:0/845657021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014e6a0 0x7f27f014f0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009870 tx=0x7f27e401c540 comp rx=0 tx=0).stop 2023-05-24T03:59:56.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- 172.21.15.40:0/845657021 shutdown_connections 2023-05-24T03:59:56.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 --2- 172.21.15.40:0/845657021 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014f630 0x7f27f0151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 --2- 172.21.15.40:0/845657021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014e6a0 0x7f27f014f0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- 172.21.15.40:0/845657021 >> 172.21.15.40:0/845657021 conn(0x7f27f00a4210 msgr2=0x7f27f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:56.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- 172.21.15.40:0/845657021 shutdown_connections 2023-05-24T03:59:56.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- 172.21.15.40:0/845657021 wait complete. 2023-05-24T03:59:56.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 Processor -- start 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- start start 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27f00bbd00 0x7f27f006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014e6a0 0x7f27f0143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 0x7f27f0143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f014a2e0 con 0x7f27f014f630 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f006c880 con 0x7f27f00bbd00 2023-05-24T03:59:56.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.086+0000 7f27f511e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f014a040 con 0x7f27f014e6a0 2023-05-24T03:59:56.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 0x7f27f0143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 0x7f27f0143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44932/0 (socket says 172.21.15.40:44932) 2023-05-24T03:59:56.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 -- 172.21.15.40:0/613246274 learned_addr learned my addr 172.21.15.40:0/613246274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:56.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ee59c640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014e6a0 0x7f27f0143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27eed9d640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27f00bbd00 0x7f27f006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 -- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014e6a0 msgr2=0x7f27f0143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014e6a0 0x7f27f0143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 -- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27f00bbd00 msgr2=0x7f27f006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27f00bbd00 0x7f27f006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 -- 172.21.15.40:0/613246274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40094d0 con 0x7f27f014f630 2023-05-24T03:59:56.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27eed9d640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27f00bbd00 0x7f27f006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:56.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27ef59e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 0x7f27f0143980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27e800e7f0 tx=0x7f27e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:56.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8009530 con 0x7f27f014f630 2023-05-24T03:59:56.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800eea0 con 0x7f27f014f630 2023-05-24T03:59:56.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f015b970 con 0x7f27f014f630 2023-05-24T03:59:56.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800cb60 con 0x7f27f014f630 2023-05-24T03:59:56.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f015b7e0 con 0x7f27f014f630 2023-05-24T03:59:56.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f015bb00 con 0x7f27f014f630 2023-05-24T03:59:56.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27e800ccc0 con 0x7f27f014f630 2023-05-24T03:59:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27d77fe640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27dc066280 0x7f27dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27eed9d640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27dc066280 0x7f27dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f27e8083a60 con 0x7f27f014f630 2023-05-24T03:59:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.090+0000 7f27eed9d640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27dc066280 0x7f27dc068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27e00012f0 tx=0x7f27e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.094+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f27e80512e0 con 0x7f27f014f630 2023-05-24T03:59:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.246+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f27f01e7bd0 con 0x7f27f014f630 2023-05-24T03:59:56.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.494+0000 7f27d77fe640 1 -- 172.21.15.40:0/613246274 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f27f01e7bd0 con 0x7f27f014f630 2023-05-24T03:59:56.501 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-05-24T03:59:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27dc066280 msgr2=0x7f27dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27dc066280 0x7f27dc068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27e00012f0 tx=0x7f27e0009040 comp rx=0 tx=0).stop 2023-05-24T03:59:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 msgr2=0x7f27f0143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 0x7f27f0143980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27e800e7f0 tx=0x7f27e800ecb0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 shutdown_connections 2023-05-24T03:59:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27dc066280 0x7f27dc068730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f014f630 0x7f27f0143980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27f014e6a0 0x7f27f0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 --2- 172.21.15.40:0/613246274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27f00bbd00 0x7f27f006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 >> 172.21.15.40:0/613246274 conn(0x7f27f00a4210 msgr2=0x7f27f00c17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:56.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 shutdown_connections 2023-05-24T03:59:56.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.498+0000 7f27f511e640 1 -- 172.21.15.40:0/613246274 wait complete. 2023-05-24T03:59:56.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-24T03:59:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 Processor -- start 2023-05-24T03:59:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 -- start start 2023-05-24T03:59:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe69406ba20 0x7fe69414c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe69406be70 0x7fe69414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69414caf0 con 0x7fe69414bca0 2023-05-24T03:59:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6940a6400 con 0x7fe69406ba20 2023-05-24T03:59:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe69a423640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6940a3db0 con 0x7fe69406be70 2023-05-24T03:59:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe6937fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe69406ba20 0x7fe69414c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe693fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe69414bca0 0x7fe6940a5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46468/0 (socket says 172.21.15.40:46468) 2023-05-24T03:59:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe693fff640 1 -- 172.21.15.40:0/1616599453 learned_addr learned my addr 172.21.15.40:0/1616599453 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe6989c0640 1 --2- 172.21.15.40:0/1616599453 >> v2:172.21.15.67:3300/0 conn(0x7fe69406be70 0x7fe69414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe6937fe640 1 -- 172.21.15.40:0/1616599453 >> v2:172.21.15.67:3300/0 conn(0x7fe69406be70 msgr2=0x7fe69414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:56.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe6937fe640 1 --2- 172.21.15.40:0/1616599453 >> v2:172.21.15.67:3300/0 conn(0x7fe69406be70 0x7fe69414c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe6937fe640 1 -- 172.21.15.40:0/1616599453 >> v1:172.21.15.40:6789/0 conn(0x7fe69414bca0 legacy=0x7fe6940a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe6937fe640 1 -- 172.21.15.40:0/1616599453 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940b6c10 con 0x7fe69406ba20 2023-05-24T03:59:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.658+0000 7fe692ffd640 1 -- 172.21.15.40:0/1616599453 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489229308 0 0) 0x7fe69414caf0 con 0x7fe69414bca0 2023-05-24T03:59:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6937fe640 1 --2- 172.21.15.40:0/1616599453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69406ba20 0x7fe69414c070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe694150930 tx=0x7fe68401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56efe979e62241 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe692ffd640 1 -- 172.21.15.40:0/1616599453 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840ab600 con 0x7fe69406ba20 2023-05-24T03:59:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe692ffd640 1 -- 172.21.15.40:0/1616599453 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840a7050 con 0x7fe69406ba20 2023-05-24T03:59:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe692ffd640 1 -- 172.21.15.40:0/1616599453 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840ab980 con 0x7fe69406ba20 2023-05-24T03:59:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- 172.21.15.40:0/1616599453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69406ba20 msgr2=0x7fe69414c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 --2- 172.21.15.40:0/1616599453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69406ba20 0x7fe69414c070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe694150930 tx=0x7fe68401c3a0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- 172.21.15.40:0/1616599453 shutdown_connections 2023-05-24T03:59:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 --2- 172.21.15.40:0/1616599453 >> v2:172.21.15.67:3300/0 conn(0x7fe69406be70 0x7fe69414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 --2- 172.21.15.40:0/1616599453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69406ba20 0x7fe69414c070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- 172.21.15.40:0/1616599453 >> 172.21.15.40:0/1616599453 conn(0x7fe6940c0330 msgr2=0x7fe6940c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:56.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- 172.21.15.40:0/1616599453 shutdown_connections 2023-05-24T03:59:56.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- 172.21.15.40:0/1616599453 wait complete. 2023-05-24T03:59:56.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 Processor -- start 2023-05-24T03:59:56.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- start start 2023-05-24T03:59:56.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe69406ba20 0x7fe6941441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe69406be70 0x7fe69413e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 0x7fe69413e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694156a40 con 0x7fe69414bca0 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6941446e0 con 0x7fe69406be70 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe69a423640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940bae40 con 0x7fe69406ba20 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 0x7fe69413e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 0x7fe69413e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44946/0 (socket says 172.21.15.40:44946) 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 -- 172.21.15.40:0/2218713181 learned_addr learned my addr 172.21.15.40:0/2218713181 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6937fe640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe69406be70 0x7fe69413e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 -- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe69406ba20 msgr2=0x7fe6941441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe693fff640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe69406ba20 0x7fe6941441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe69406ba20 0x7fe6941441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 -- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe69406be70 msgr2=0x7fe69413e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe69406be70 0x7fe69413e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6989c0640 1 -- 172.21.15.40:0/2218713181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684009420 con 0x7fe69414bca0 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.662+0000 7fe6937fe640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe69406be70 0x7fe69413e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:56.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe6989c0640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 0x7fe69413e960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe68c007e60 tx=0x7fe68c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c014420 con 0x7fe69414bca0 2023-05-24T03:59:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0145a0 con 0x7fe69414bca0 2023-05-24T03:59:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c014950 con 0x7fe69414bca0 2023-05-24T03:59:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6940b68c0 con 0x7fe69414bca0 2023-05-24T03:59:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6940b6730 con 0x7fe69414bca0 2023-05-24T03:59:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6940b7050 con 0x7fe69414bca0 2023-05-24T03:59:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe68c014ab0 con 0x7fe69414bca0 2023-05-24T03:59:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe690ff9640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe674066280 0x7fe674068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe693fff640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe674066280 0x7fe674068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe68c0854c0 con 0x7fe69414bca0 2023-05-24T03:59:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.666+0000 7fe693fff640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe674066280 0x7fe674068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000f70 tx=0x7fe67c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.670+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe68c056500 con 0x7fe69414bca0 2023-05-24T03:59:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:56.826+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe6940baca0 con 0x7fe69414bca0 2023-05-24T03:59:57.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.510+0000 7fe690ff9640 1 -- 172.21.15.40:0/2218713181 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe6940baca0 con 0x7fe69414bca0 2023-05-24T03:59:57.518 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-05-24T03:59:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe674066280 msgr2=0x7fe674068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe674066280 0x7fe674068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000f70 tx=0x7fe67c009040 comp rx=0 tx=0).stop 2023-05-24T03:59:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 msgr2=0x7fe69413e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 0x7fe69413e960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe68c007e60 tx=0x7fe68c00e4b0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 shutdown_connections 2023-05-24T03:59:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe674066280 0x7fe674068730 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000f70 tx=0x7fe67c009040 comp rx=0 tx=0).stop 2023-05-24T03:59:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69414bca0 0x7fe69413e960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe69406be70 0x7fe69413e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 --2- 172.21.15.40:0/2218713181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe69406ba20 0x7fe6941441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 >> 172.21.15.40:0/2218713181 conn(0x7fe6940c0330 msgr2=0x7fe6940b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.534+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 shutdown_connections 2023-05-24T03:59:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.538+0000 7fe69a423640 1 -- 172.21.15.40:0/2218713181 wait complete. 2023-05-24T03:59:57.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-24T03:59:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 Processor -- start 2023-05-24T03:59:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 -- start start 2023-05-24T03:59:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38c0071220 0x7f38c0071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c00bcd20 0x7f38c00bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c0070ab0 con 0x7f38c014bc80 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c00a5040 con 0x7f38c0071220 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38c4d91640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c014d0f0 con 0x7f38c00bcd20 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38c0071220 0x7f38c0071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38c0071220 0x7f38c0071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44950/0 (socket says 172.21.15.40:44950) 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 -- 172.21.15.40:0/4227723897 learned_addr learned my addr 172.21.15.40:0/4227723897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bed9d640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c00bcd20 0x7f38c00bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 -- 172.21.15.40:0/4227723897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c00bcd20 msgr2=0x7f38c00bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c00bcd20 0x7f38c00bd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 -- 172.21.15.40:0/4227723897 >> v1:172.21.15.67:6789/0 conn(0x7f38c014bc80 legacy=0x7f38c00a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bdd9b640 1 -- 172.21.15.40:0/4227723897 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0070d00 con 0x7f38c0071220 2023-05-24T03:59:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.690+0000 7f38bed9d640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c00bcd20 0x7f38c00bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bdd9b640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c0071220 0x7f38c0071670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774dcb13cb69b267 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bd59a640 1 -- 172.21.15.40:0/4227723897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00ac620 con 0x7f38c0071220 2023-05-24T03:59:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bd59a640 1 -- 172.21.15.40:0/4227723897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b00ac780 con 0x7f38c0071220 2023-05-24T03:59:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bd59a640 1 -- 172.21.15.40:0/4227723897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00acb10 con 0x7f38c0071220 2023-05-24T03:59:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- 172.21.15.40:0/4227723897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c0071220 msgr2=0x7f38c0071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c0071220 0x7f38c0071670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b001c3e0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- 172.21.15.40:0/4227723897 shutdown_connections 2023-05-24T03:59:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c00bcd20 0x7f38c00bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 --2- 172.21.15.40:0/4227723897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c0071220 0x7f38c0071670 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- 172.21.15.40:0/4227723897 >> 172.21.15.40:0/4227723897 conn(0x7f38c00c0310 msgr2=0x7f38c00c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- 172.21.15.40:0/4227723897 shutdown_connections 2023-05-24T03:59:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- 172.21.15.40:0/4227723897 wait complete. 2023-05-24T03:59:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 Processor -- start 2023-05-24T03:59:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- start start 2023-05-24T03:59:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c0071220 0x7f38c0144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38c00bcd20 0x7f38c013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 0x7f38c013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0070610 con 0x7f38c014bc80 2023-05-24T03:59:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01eac40 con 0x7f38c00bcd20 2023-05-24T03:59:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38c4d91640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01446b0 con 0x7f38c0071220 2023-05-24T03:59:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 0x7f38c013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 0x7f38c013e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44958/0 (socket says 172.21.15.40:44958) 2023-05-24T03:59:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 -- 172.21.15.40:0/2265786843 learned_addr learned my addr 172.21.15.40:0/2265786843 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bdd9b640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38c00bcd20 0x7f38c013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38be59c640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c0071220 0x7f38c0144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 -- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c0071220 msgr2=0x7f38c0144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c0071220 0x7f38c0144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 -- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38c00bcd20 msgr2=0x7f38c013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38c00bcd20 0x7f38c013e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 -- 172.21.15.40:0/2265786843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b00094d0 con 0x7f38c014bc80 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.694+0000 7f38bed9d640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 0x7f38c013e9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38b800cf20 tx=0x7f38b800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800d840 con 0x7f38c014bc80 2023-05-24T03:59:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800d9a0 con 0x7f38c014bc80 2023-05-24T03:59:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c0159470 con 0x7f38c014bc80 2023-05-24T03:59:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800dd50 con 0x7f38c014bc80 2023-05-24T03:59:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c014cd50 con 0x7f38c014bc80 2023-05-24T03:59:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0159600 con 0x7f38c014bc80 2023-05-24T03:59:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38b801d360 con 0x7f38c014bc80 2023-05-24T03:59:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38aeffd640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f38a0066280 0x7f38a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f38b8084c30 con 0x7f38c014bc80 2023-05-24T03:59:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38be59c640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f38a0066280 0x7f38a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.698+0000 7f38be59c640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f38a0066280 0x7f38a0068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b810 tx=0x7f38b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.702+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38b8052180 con 0x7f38c014bc80 2023-05-24T03:59:57.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.890+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f38c00bcb90 con 0x7f38c014bc80 2023-05-24T03:59:57.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.898+0000 7f38aeffd640 1 -- 172.21.15.40:0/2265786843 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f38b801a020 con 0x7f38c014bc80 2023-05-24T03:59:57.906 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 3 and data pool 4 2023-05-24T03:59:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f38a0066280 msgr2=0x7f38a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f38a0066280 0x7f38a0068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b810 tx=0x7f38b4008040 comp rx=0 tx=0).stop 2023-05-24T03:59:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 msgr2=0x7f38c013e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 0x7f38c013e9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38b800cf20 tx=0x7f38b800a7d0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 shutdown_connections 2023-05-24T03:59:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f38a0066280 0x7f38a0068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c014bc80 0x7f38c013e9d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38c00bcd20 0x7f38c013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 --2- 172.21.15.40:0/2265786843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38c0071220 0x7f38c0144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.906+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 >> 172.21.15.40:0/2265786843 conn(0x7f38c00c0310 msgr2=0x7f38c0148b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:57.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.910+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 shutdown_connections 2023-05-24T03:59:57.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:57.910+0000 7f38c4d91640 1 -- 172.21.15.40:0/2265786843 wait complete. 2023-05-24T03:59:57.949 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-24T03:59:57.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-24T03:59:58.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 Processor -- start 2023-05-24T03:59:58.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 -- start start 2023-05-24T03:59:58.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd65c14f7f0 0x7fd65c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 0x7fd65c06c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c150210 con 0x7fd65c06ea50 2023-05-24T03:59:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c1504f0 con 0x7fd65c14f7f0 2023-05-24T03:59:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd662785640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c06efd0 con 0x7fd65c070340 2023-05-24T03:59:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd65b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd65c06ea50 0x7fd65c06bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46484/0 (socket says 172.21.15.40:46484) 2023-05-24T03:59:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd65b7fe640 1 -- 172.21.15.40:0/760305206 learned_addr learned my addr 172.21.15.40:0/760305206 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T03:59:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd660d22640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 0x7fd65c06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd65bfff640 1 --2- 172.21.15.40:0/760305206 >> v2:172.21.15.67:3300/0 conn(0x7fd65c14f7f0 0x7fd65c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163592077 0 0) 0x7fd65c150210 con 0x7fd65c06ea50 2023-05-24T03:59:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.074+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd648003530 con 0x7fd65c06ea50 2023-05-24T03:59:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 500009018 0 0) 0x7fd648003530 con 0x7fd65c06ea50 2023-05-24T03:59:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 msgr2=0x7fd65c06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 0x7fd65c06c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 >> v2:172.21.15.67:3300/0 conn(0x7fd65c14f7f0 msgr2=0x7fd65c14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 --2- 172.21.15.40:0/760305206 >> v2:172.21.15.67:3300/0 conn(0x7fd65c14f7f0 0x7fd65c14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c06d230 con 0x7fd65c06ea50 2023-05-24T03:59:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fd644001a00 con 0x7fd65c06ea50 2023-05-24T03:59:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 >> v1:172.21.15.40:6789/0 conn(0x7fd65c06ea50 legacy=0x7fd65c06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648003980 0x7fd648003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 0x7fd6480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd648004d10 0x7fd648005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1504f0 con 0x7fd648004d10 2023-05-24T03:59:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c06efd0 con 0x7fd648003980 2023-05-24T03:59:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64800b9e0 con 0x7fd65c070340 2023-05-24T03:59:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd648004d10 0x7fd648005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65bfff640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648003980 0x7fd648003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65b7fe640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 0x7fd6480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 -- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 msgr2=0x7fd6480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c070340 0x7fd6480047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 -- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648003980 msgr2=0x7fd648003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648003980 0x7fd648003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 -- 172.21.15.40:0/760305206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648003530 con 0x7fd648004d10 2023-05-24T03:59:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65bfff640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648003980 0x7fd648003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd648004d10 0x7fd648005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd654009ab0 tx=0x7fd65401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fbd33f23e4a35c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540a5620 con 0x7fd648004d10 2023-05-24T03:59:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6540a5780 con 0x7fd648004d10 2023-05-24T03:59:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd65affd640 1 -- 172.21.15.40:0/760305206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540a5af0 con 0x7fd648004d10 2023-05-24T03:59:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd662785640 1 -- 172.21.15.40:0/760305206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd648004d10 msgr2=0x7fd648005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd662785640 1 --2- 172.21.15.40:0/760305206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd648004d10 0x7fd648005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd654009ab0 tx=0x7fd65401ca30 comp rx=0 tx=0).stop 2023-05-24T03:59:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd660d22640 1 -- 172.21.15.40:0/760305206 reap_dead start 2023-05-24T03:59:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd662785640 1 -- 172.21.15.40:0/760305206 shutdown_connections 2023-05-24T03:59:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd662785640 1 -- 172.21.15.40:0/760305206 >> 172.21.15.40:0/760305206 conn(0x7fd65c0c0300 msgr2=0x7fd65c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd662785640 1 -- 172.21.15.40:0/760305206 shutdown_connections 2023-05-24T03:59:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.078+0000 7fd662785640 1 -- 172.21.15.40:0/760305206 wait complete. 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 Processor -- start 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- start start 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648004d10 0x7fd65c1d7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c149420 0x7fd65c1d8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 0x7fd65c1d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1d9380 con 0x7fd65c1d8680 2023-05-24T03:59:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1d8ea0 con 0x7fd648004d10 2023-05-24T03:59:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1d78c0 con 0x7fd65c149420 2023-05-24T03:59:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 0x7fd65c1d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 0x7fd65c1d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44980/0 (socket says 172.21.15.40:44980) 2023-05-24T03:59:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 -- 172.21.15.40:0/3366645770 learned_addr learned my addr 172.21.15.40:0/3366645770 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd65bfff640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648004d10 0x7fd65c1d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd65b7fe640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c149420 0x7fd65c1d8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 -- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c149420 msgr2=0x7fd65c1d8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c149420 0x7fd65c1d8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 -- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648004d10 msgr2=0x7fd65c1d7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648004d10 0x7fd65c1d7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 -- 172.21.15.40:0/3366645770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c070a00 con 0x7fd65c1d8680 2023-05-24T03:59:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd660d22640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 0x7fd65c1d54e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd65401cf10 tx=0x7fd648005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540a5620 con 0x7fd65c1d8680 2023-05-24T03:59:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6540b6460 con 0x7fd65c1d8680 2023-05-24T03:59:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540b67d0 con 0x7fd65c1d8680 2023-05-24T03:59:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c06d3e0 con 0x7fd65c1d8680 2023-05-24T03:59:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c070b90 con 0x7fd65c1d8680 2023-05-24T03:59:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c04ddd0 con 0x7fd65c1d8680 2023-05-24T03:59:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.082+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6540b4070 con 0x7fd65c1d8680 2023-05-24T03:59:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.086+0000 7fd658ff9640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd63c0662b0 0x7fd63c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.086+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd65411dcc0 con 0x7fd65c1d8680 2023-05-24T03:59:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.086+0000 7fd65bfff640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd63c0662b0 0x7fd63c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.086+0000 7fd65bfff640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd63c0662b0 0x7fd63c068760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd65c1d94f0 tx=0x7fd64c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.090+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd6540eb1d0 con 0x7fd65c1d8680 2023-05-24T03:59:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.254+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd65c071920 con 0x7fd65c1d8680 2023-05-24T03:59:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd658ff9640 1 -- 172.21.15.40:0/3366645770 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd6540ee7f0 con 0x7fd65c1d8680 2023-05-24T03:59:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd63c0662b0 msgr2=0x7fd63c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:58.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd63c0662b0 0x7fd63c068760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd65c1d94f0 tx=0x7fd64c008040 comp rx=0 tx=0).stop 2023-05-24T03:59:58.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 msgr2=0x7fd65c1d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:58.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 0x7fd65c1d54e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd65401cf10 tx=0x7fd648005800 comp rx=0 tx=0).stop 2023-05-24T03:59:58.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 shutdown_connections 2023-05-24T03:59:58.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd63c0662b0 0x7fd63c068760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c1d8680 0x7fd65c1d54e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd65c149420 0x7fd65c1d8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 --2- 172.21.15.40:0/3366645770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648004d10 0x7fd65c1d7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:58.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.906+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 >> 172.21.15.40:0/3366645770 conn(0x7fd65c0c0300 msgr2=0x7fd65c0be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:58.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.910+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 shutdown_connections 2023-05-24T03:59:58.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:58.910+0000 7fd662785640 1 -- 172.21.15.40:0/3366645770 wait complete. 2023-05-24T03:59:58.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-24T03:59:59.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 Processor -- start 2023-05-24T03:59:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 -- start start 2023-05-24T03:59:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a00a4610 0x7fe0a014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0a0152990 0x7fe0a006aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0a006f370 0x7fe0a006b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006c050 con 0x7fe0a006f370 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006e950 con 0x7fe0a0152990 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a73e8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00beef0 con 0x7fe0a00a4610 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0a006f370 0x7fe0a006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0a006f370 0x7fe0a006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44994/0 (socket says 172.21.15.40:44994) 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 -- 172.21.15.40:0/1248160176 learned_addr learned my addr 172.21.15.40:0/1248160176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a4983640 1 --2- 172.21.15.40:0/1248160176 >> v2:172.21.15.67:3300/0 conn(0x7fe0a0152990 0x7fe0a006aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5184640 1 --2- 172.21.15.40:0/1248160176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a00a4610 0x7fe0a014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 -- 172.21.15.40:0/1248160176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a00a4610 msgr2=0x7fe0a014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 --2- 172.21.15.40:0/1248160176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a00a4610 0x7fe0a014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 -- 172.21.15.40:0/1248160176 >> v2:172.21.15.67:3300/0 conn(0x7fe0a0152990 msgr2=0x7fe0a006aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 --2- 172.21.15.40:0/1248160176 >> v2:172.21.15.67:3300/0 conn(0x7fe0a0152990 0x7fe0a006aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a5985640 1 -- 172.21.15.40:0/1248160176 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00a3dd0 con 0x7fe0a006f370 2023-05-24T03:59:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.070+0000 7fe0a4983640 1 --2- 172.21.15.40:0/1248160176 >> v2:172.21.15.67:3300/0 conn(0x7fe0a0152990 0x7fe0a006aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:59:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5985640 1 --2- 172.21.15.40:0/1248160176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a006b030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0072070 tx=0x7fe09801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2766df610a88e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe097fff640 1 -- 172.21.15.40:0/1248160176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5870 con 0x7fe0a006f370 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe097fff640 1 -- 172.21.15.40:0/1248160176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980a59d0 con 0x7fe0a006f370 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe097fff640 1 -- 172.21.15.40:0/1248160176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5d60 con 0x7fe0a006f370 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/1248160176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 msgr2=0x7fe0a006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/1248160176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a006b030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0072070 tx=0x7fe09801c9d0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/1248160176 shutdown_connections 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/1248160176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a006b030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/1248160176 >> v2:172.21.15.67:3300/0 conn(0x7fe0a0152990 0x7fe0a006aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/1248160176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a00a4610 0x7fe0a014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/1248160176 >> 172.21.15.40:0/1248160176 conn(0x7fe0a00bf170 msgr2=0x7fe0a00bf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:59:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/1248160176 shutdown_connections 2023-05-24T03:59:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/1248160176 wait complete. 2023-05-24T03:59:59.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 Processor -- start 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- start start 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a00bd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0a00a4610 0x7fe0a0151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a0152990 0x7fe0a00be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01eb5c0 con 0x7fe0a006f370 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00bbe50 con 0x7fe0a00a4610 2023-05-24T03:59:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00a77d0 con 0x7fe0a0152990 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a00bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a00bd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44998/0 (socket says 172.21.15.40:44998) 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 -- 172.21.15.40:0/3062910263 learned_addr learned my addr 172.21.15.40:0/3062910263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a4983640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0a00a4610 0x7fe0a0151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5985640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a0152990 0x7fe0a00be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 -- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a0152990 msgr2=0x7fe0a00be3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a0152990 0x7fe0a00be3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 -- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0a00a4610 msgr2=0x7fe0a0151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0a00a4610 0x7fe0a0151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 -- 172.21.15.40:0/3062910263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009b30 con 0x7fe0a006f370 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a4983640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0a00a4610 0x7fe0a0151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a5184640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a00bd780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d800 tx=0x7fe09c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0096a0 con 0x7fe0a006f370 2023-05-24T03:59:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c009800 con 0x7fe0a006f370 2023-05-24T03:59:59.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a006b700 con 0x7fe0a006f370 2023-05-24T03:59:59.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c009b70 con 0x7fe0a006f370 2023-05-24T03:59:59.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.074+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a006b570 con 0x7fe0a006f370 2023-05-24T03:59:59.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.078+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0071340 con 0x7fe0a006f370 2023-05-24T03:59:59.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.078+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe09c009cd0 con 0x7fe0a006f370 2023-05-24T03:59:59.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.078+0000 7fe095ffb640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe084066280 0x7fe084068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:59:59.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.078+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fe09c084500 con 0x7fe0a006f370 2023-05-24T03:59:59.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.078+0000 7fe0a4983640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe084066280 0x7fe084068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:59:59.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.078+0000 7fe0a4983640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe084066280 0x7fe084068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00bd2a0 tx=0x7fe090008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:59:59.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.082+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe09c051930 con 0x7fe0a006f370 2023-05-24T03:59:59.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T03:59:59.238+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe0a00bbcb0 con 0x7fe0a006f370 2023-05-24T03:59:59.624 INFO:tasks.ceph.mds.b.smithi067.stderr:2023-05-24T03:59:59.615+0000 7fdd4c45f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-24T04:00:00.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.922+0000 7fe095ffb640 1 -- 172.21.15.40:0/3062910263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7fe0a00bbcb0 con 0x7fe0a006f370 2023-05-24T04:00:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' created 2023-05-24T04:00:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe084066280 msgr2=0x7fe084068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe084066280 0x7fe084068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00bd2a0 tx=0x7fe090008040 comp rx=0 tx=0).stop 2023-05-24T04:00:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 msgr2=0x7fe0a00bd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a00bd780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d800 tx=0x7fe09c00dcc0 comp rx=0 tx=0).stop 2023-05-24T04:00:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 shutdown_connections 2023-05-24T04:00:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe084066280 0x7fe084068730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0a0152990 0x7fe0a00be3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0a00a4610 0x7fe0a0151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 --2- 172.21.15.40:0/3062910263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a006f370 0x7fe0a00bd780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.930+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 >> 172.21.15.40:0/3062910263 conn(0x7fe0a00bf170 msgr2=0x7fe0a00bf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.934+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 shutdown_connections 2023-05-24T04:00:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:00.934+0000 7fe0a73e8640 1 -- 172.21.15.40:0/3062910263 wait complete. 2023-05-24T04:00:00.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-24T04:00:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 Processor -- start 2023-05-24T04:00:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 -- start start 2023-05-24T04:00:01.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6fc06fa50 0x7fc6fc0a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:01.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6fc14a750 0x7fc6fc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:01.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc14e870 con 0x7fc6fc0714c0 2023-05-24T04:00:01.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc14eb10 con 0x7fc6fc06fa50 2023-05-24T04:00:01.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc701e0c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc14b0b0 con 0x7fc6fc14a750 2023-05-24T04:00:01.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6faffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6fc06fa50 0x7fc6fc0a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:01.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6fb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc6fc0714c0 0x7fc6fc071890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46486/0 (socket says 172.21.15.40:46486) 2023-05-24T04:00:01.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6fb7fe640 1 -- 172.21.15.40:0/3811799053 learned_addr learned my addr 172.21.15.40:0/3811799053 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:01.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6fbfff640 1 --2- 172.21.15.40:0/3811799053 >> v2:172.21.15.67:3300/0 conn(0x7fc6fc14a750 0x7fc6fc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:01.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6faffd640 1 -- 172.21.15.40:0/3811799053 >> v2:172.21.15.67:3300/0 conn(0x7fc6fc14a750 msgr2=0x7fc6fc14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:01.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6faffd640 1 --2- 172.21.15.40:0/3811799053 >> v2:172.21.15.67:3300/0 conn(0x7fc6fc14a750 0x7fc6fc14ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6faffd640 1 -- 172.21.15.40:0/3811799053 >> v1:172.21.15.40:6789/0 conn(0x7fc6fc0714c0 legacy=0x7fc6fc071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:01.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6faffd640 1 -- 172.21.15.40:0/3811799053 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc14b360 con 0x7fc6fc06fa50 2023-05-24T04:00:01.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.082+0000 7fc6fa7fc640 1 -- 172.21.15.40:0/3811799053 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027187883 0 0) 0x7fc6fc14e870 con 0x7fc6fc0714c0 2023-05-24T04:00:01.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc6faffd640 1 --2- 172.21.15.40:0/3811799053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc06fa50 0x7fc6fc0a34a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc070c50 tx=0x7fc6f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a25efa0d8bc645 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:01.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc6fa7fc640 1 -- 172.21.15.40:0/3811799053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0a55e0 con 0x7fc6fc06fa50 2023-05-24T04:00:01.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc6fa7fc640 1 -- 172.21.15.40:0/3811799053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f00ab5f0 con 0x7fc6fc06fa50 2023-05-24T04:00:01.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc6fa7fc640 1 -- 172.21.15.40:0/3811799053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00ab980 con 0x7fc6fc06fa50 2023-05-24T04:00:01.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 -- 172.21.15.40:0/3811799053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc06fa50 msgr2=0x7fc6fc0a34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 --2- 172.21.15.40:0/3811799053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc06fa50 0x7fc6fc0a34a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc070c50 tx=0x7fc6f001c3d0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 -- 172.21.15.40:0/3811799053 shutdown_connections 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 --2- 172.21.15.40:0/3811799053 >> v2:172.21.15.67:3300/0 conn(0x7fc6fc14a750 0x7fc6fc14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 --2- 172.21.15.40:0/3811799053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc06fa50 0x7fc6fc0a34a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 -- 172.21.15.40:0/3811799053 >> 172.21.15.40:0/3811799053 conn(0x7fc6fc0c0300 msgr2=0x7fc6fc0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 -- 172.21.15.40:0/3811799053 shutdown_connections 2023-05-24T04:00:01.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.086+0000 7fc701e0c640 1 -- 172.21.15.40:0/3811799053 wait complete. 2023-05-24T04:00:01.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 Processor -- start 2023-05-24T04:00:01.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- start start 2023-05-24T04:00:01.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6fc06fa50 0x7fc6fc144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:01.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 0x7fc6fc14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:01.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6fc14a750 0x7fc6fc147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:01.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc153330 con 0x7fc6fc0714c0 2023-05-24T04:00:01.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0bc660 con 0x7fc6fc14a750 2023-05-24T04:00:01.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc14cf90 con 0x7fc6fc06fa50 2023-05-24T04:00:01.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 0x7fc6fc14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 0x7fc6fc14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45016/0 (socket says 172.21.15.40:45016) 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 -- 172.21.15.40:0/109855827 learned_addr learned my addr 172.21.15.40:0/109855827 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6fbfff640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6fc14a750 0x7fc6fc147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6fb7fe640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6fc06fa50 0x7fc6fc144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 -- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6fc06fa50 msgr2=0x7fc6fc144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6fc06fa50 0x7fc6fc144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 -- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6fc14a750 msgr2=0x7fc6fc147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:01.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6fc14a750 0x7fc6fc147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 -- 172.21.15.40:0/109855827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009420 con 0x7fc6fc0714c0 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6fb7fe640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6fc06fa50 0x7fc6fc144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6faffd640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 0x7fc6fc14ca50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0018fe0 tx=0x7fc6f001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00b5810 con 0x7fc6fc0714c0 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f00b5990 con 0x7fc6fc0714c0 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00b5d40 con 0x7fc6fc0714c0 2023-05-24T04:00:01.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc14c220 con 0x7fc6fc0714c0 2023-05-24T04:00:01.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc14c090 con 0x7fc6fc0714c0 2023-05-24T04:00:01.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc157ae0 con 0x7fc6fc0714c0 2023-05-24T04:00:01.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.090+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6f00bf410 con 0x7fc6fc0714c0 2023-05-24T04:00:01.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.094+0000 7fc6e3fff640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc6e8066280 0x7fc6e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:01.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.094+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fc6f00a8050 con 0x7fc6fc0714c0 2023-05-24T04:00:01.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.094+0000 7fc6fb7fe640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc6e8066280 0x7fc6e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:01.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.094+0000 7fc6fb7fe640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc6e8066280 0x7fc6e8068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec007fd0 tx=0x7fc6ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:01.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.098+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc6f00ebf70 con 0x7fc6fc0714c0 2023-05-24T04:00:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.250+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fc6fc146e40 con 0x7fc6fc0714c0 2023-05-24T04:00:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.926+0000 7fc6e3fff640 1 -- 172.21.15.40:0/109855827 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc6fc146e40 con 0x7fc6fc0714c0 2023-05-24T04:00:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 5 allow_ec_overwrites to true 2023-05-24T04:00:01.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.942+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc6e8066280 msgr2=0x7fc6e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:01.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.942+0000 7fc701e0c640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc6e8066280 0x7fc6e8068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec007fd0 tx=0x7fc6ec009040 comp rx=0 tx=0).stop 2023-05-24T04:00:01.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.942+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 msgr2=0x7fc6fc14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:01.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.942+0000 7fc701e0c640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 0x7fc6fc14ca50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0018fe0 tx=0x7fc6f001ac10 comp rx=0 tx=0).stop 2023-05-24T04:00:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 shutdown_connections 2023-05-24T04:00:01.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc6e8066280 0x7fc6e8068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6fc14a750 0x7fc6fc147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6fc0714c0 0x7fc6fc14ca50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 --2- 172.21.15.40:0/109855827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6fc06fa50 0x7fc6fc144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:01.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 >> 172.21.15.40:0/109855827 conn(0x7fc6fc0c0300 msgr2=0x7fc6fc0a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:01.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 shutdown_connections 2023-05-24T04:00:01.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:01.946+0000 7fc701e0c640 1 -- 172.21.15.40:0/109855827 wait complete. 2023-05-24T04:00:01.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-24T04:00:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.110+0000 7fb66cdd9640 1 Processor -- start 2023-05-24T04:00:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.110+0000 7fb66cdd9640 1 -- start start 2023-05-24T04:00:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66cdd9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 0x7fb6680bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66cdd9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb6680c4080 0x7fb6680c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66cdd9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680a3a90 con 0x7fb6680c0e30 2023-05-24T04:00:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66cdd9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6680a37f0 con 0x7fb6680c4080 2023-05-24T04:00:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66cdd9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680aa610 con 0x7fb6680bedc0 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb6680c0e30 0x7fb66806ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44794/0 (socket says 172.21.15.40:44794) 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 -- 172.21.15.40:0/173080323 learned_addr learned my addr 172.21.15.40:0/173080323 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb665d9b640 1 --2- 172.21.15.40:0/173080323 >> v2:172.21.15.67:3300/0 conn(0x7fb6680c4080 0x7fb6680c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66659c640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 0x7fb6680bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369612963 0 0) 0x7fb6680a3a90 con 0x7fb6680c0e30 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb650003530 con 0x7fb6680c0e30 2023-05-24T04:00:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106725839 0 0) 0x7fb650003530 con 0x7fb6680c0e30 2023-05-24T04:00:02.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 msgr2=0x7fb6680bf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 0x7fb6680bf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 >> v2:172.21.15.67:3300/0 conn(0x7fb6680c4080 msgr2=0x7fb6680c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 --2- 172.21.15.40:0/173080323 >> v2:172.21.15.67:3300/0 conn(0x7fb6680c4080 0x7fb6680c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680c44e0 con 0x7fb6680c0e30 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fb660001680 con 0x7fb6680c0e30 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 >> v1:172.21.15.40:6789/0 conn(0x7fb6680c0e30 legacy=0x7fb66806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb650003980 0x7fb650003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 0x7fb6500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb650005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680a37f0 con 0x7fb650004d10 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680aa610 con 0x7fb650003980 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65000b990 con 0x7fb6680bedc0 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb650005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb66659c640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb650003980 0x7fb650003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb665d9b640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 0x7fb6500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 -- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 msgr2=0x7fb6500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680bedc0 0x7fb6500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 -- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb650003980 msgr2=0x7fb650003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb650003980 0x7fb650003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 -- 172.21.15.40:0/173080323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650003530 con 0x7fb650004d10 2023-05-24T04:00:02.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.114+0000 7fb666d9d640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb650005180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c240 tx=0x7fb66001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be7e472baef4085 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6600a5960 con 0x7fb650004d10 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6600a5ac0 con 0x7fb650004d10 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66559a640 1 -- 172.21.15.40:0/173080323 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6600a5e90 con 0x7fb650004d10 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/173080323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 msgr2=0x7fb650005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/173080323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb650005180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c240 tx=0x7fb66001cc00 comp rx=0 tx=0).stop 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb666d9d640 1 -- 172.21.15.40:0/173080323 reap_dead start 2023-05-24T04:00:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/173080323 shutdown_connections 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/173080323 >> 172.21.15.40:0/173080323 conn(0x7fb6680a6340 msgr2=0x7fb6680a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/173080323 shutdown_connections 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/173080323 wait complete. 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 Processor -- start 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- start start 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb6681d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6681d5000 0x7fb6681d3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680999e0 0x7fb6681d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6681d4e40 con 0x7fb650004d10 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66809bb40 con 0x7fb6681d5000 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6681d4920 con 0x7fb6680999e0 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb6681d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb6681d57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56882/0 (socket says 172.21.15.40:56882) 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 -- 172.21.15.40:0/4018542667 learned_addr learned my addr 172.21.15.40:0/4018542667 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb666d9d640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680999e0 0x7fb6681d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb665d9b640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6681d5000 0x7fb6681d3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 -- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680999e0 msgr2=0x7fb6681d43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680999e0 0x7fb6681d43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 -- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6681d5000 msgr2=0x7fb6681d3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6681d5000 0x7fb6681d3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 -- 172.21.15.40:0/4018542667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680bb690 con 0x7fb650004d10 2023-05-24T04:00:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66659c640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb6681d57a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb658007f60 tx=0x7fb658007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800e030 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658016470 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6680bb500 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658016820 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.118+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6680c35e0 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.122+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66804ddd0 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.122+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb658016b90 con 0x7fb650004d10 2023-05-24T04:00:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.122+0000 7fb656ffd640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb648066280 0x7fb648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.122+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb65800f070 con 0x7fb650004d10 2023-05-24T04:00:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.122+0000 7fb665d9b640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb648066280 0x7fb648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.122+0000 7fb665d9b640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb648066280 0x7fb648068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb6681d54a0 tx=0x7fb65c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.126+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb658052320 con 0x7fb650004d10 2023-05-24T04:00:02.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.314+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb6680a9410 con 0x7fb650004d10 2023-05-24T04:00:02.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb656ffd640 1 -- 172.21.15.40:0/4018542667 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb658055940 con 0x7fb650004d10 2023-05-24T04:00:02.331 INFO:teuthology.orchestra.run.smithi040.stderr:added data pool 5 to fsmap 2023-05-24T04:00:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb648066280 msgr2=0x7fb648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb648066280 0x7fb648068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb6681d54a0 tx=0x7fb65c008040 comp rx=0 tx=0).stop 2023-05-24T04:00:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 msgr2=0x7fb6681d57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb6681d57a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb658007f60 tx=0x7fb658007f90 comp rx=0 tx=0).stop 2023-05-24T04:00:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 shutdown_connections 2023-05-24T04:00:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb648066280 0x7fb648068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6680999e0 0x7fb6681d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6681d5000 0x7fb6681d3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 --2- 172.21.15.40:0/4018542667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb650004d10 0x7fb6681d57a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 >> 172.21.15.40:0/4018542667 conn(0x7fb6680a6340 msgr2=0x7fb66806b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 shutdown_connections 2023-05-24T04:00:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.326+0000 7fb66cdd9640 1 -- 172.21.15.40:0/4018542667 wait complete. 2023-05-24T04:00:02.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:00:02.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.470+0000 7fe2bbd12640 1 Processor -- start 2023-05-24T04:00:02.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.470+0000 7fe2bbd12640 1 -- start start 2023-05-24T04:00:02.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b40c2690 0x7fe2b41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2b40be9b0 0x7fe2b40bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40bd630 con 0x7fe2b406e6d0 2023-05-24T04:00:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40bd070 con 0x7fe2b40be9b0 2023-05-24T04:00:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40bcb50 con 0x7fe2b40c2690 2023-05-24T04:00:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2b40be9b0 0x7fe2b40bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2b40be9b0 0x7fe2b40bf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56888/0 (socket says 172.21.15.40:56888) 2023-05-24T04:00:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 -- 172.21.15.40:0/2326082081 learned_addr learned my addr 172.21.15.40:0/2326082081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b9aae640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b40c2690 0x7fe2b41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 -- 172.21.15.40:0/2326082081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b40c2690 msgr2=0x7fe2b41505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b40c2690 0x7fe2b41505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 -- 172.21.15.40:0/2326082081 >> v1:172.21.15.67:6789/0 conn(0x7fe2b406e6d0 legacy=0x7fe2b406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 -- 172.21.15.40:0/2326082081 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40bd2c0 con 0x7fe2b40be9b0 2023-05-24T04:00:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b9aae640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b40c2690 0x7fe2b41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b92ad640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b40bf9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098a0 tx=0x7fe2a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c5b13cdcdb44f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b8aac640 1 -- 172.21.15.40:0/2326082081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40aa610 con 0x7fe2b40be9b0 2023-05-24T04:00:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b8aac640 1 -- 172.21.15.40:0/2326082081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a40a6040 con 0x7fe2b40be9b0 2023-05-24T04:00:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2b8aac640 1 -- 172.21.15.40:0/2326082081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40aa990 con 0x7fe2b40be9b0 2023-05-24T04:00:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 -- 172.21.15.40:0/2326082081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 msgr2=0x7fe2b40bf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.474+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b40bf9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098a0 tx=0x7fe2a401c490 comp rx=0 tx=0).stop 2023-05-24T04:00:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/2326082081 shutdown_connections 2023-05-24T04:00:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b40bf9e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/2326082081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b40c2690 0x7fe2b41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/2326082081 >> 172.21.15.40:0/2326082081 conn(0x7fe2b40726e0 msgr2=0x7fe2b40655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/2326082081 shutdown_connections 2023-05-24T04:00:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/2326082081 wait complete. 2023-05-24T04:00:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 Processor -- start 2023-05-24T04:00:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- start start 2023-05-24T04:00:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b406e6d0 0x7fe2b4144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b41e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2b40c2690 0x7fe2b41ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b414f120 con 0x7fe2b40be9b0 2023-05-24T04:00:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b406c300 con 0x7fe2b40c2690 2023-05-24T04:00:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41ea470 con 0x7fe2b406e6d0 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b41e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b41e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56898/0 (socket says 172.21.15.40:56898) 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b9aae640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b406e6d0 0x7fe2b4144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 -- 172.21.15.40:0/3720443365 learned_addr learned my addr 172.21.15.40:0/3720443365 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2ba2af640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2b40c2690 0x7fe2b41ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 -- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b406e6d0 msgr2=0x7fe2b4144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b406e6d0 0x7fe2b4144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 -- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2b40c2690 msgr2=0x7fe2b41ea900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2b40c2690 0x7fe2b41ea900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 -- 172.21.15.40:0/3720443365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40094d0 con 0x7fe2b40be9b0 2023-05-24T04:00:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2ba2af640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2b40c2690 0x7fe2b41ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2b92ad640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b41e6d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2a401a0c0 tx=0x7fe2a401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40b3800 con 0x7fe2b40be9b0 2023-05-24T04:00:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a40b3980 con 0x7fe2b40be9b0 2023-05-24T04:00:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40b3d30 con 0x7fe2b40be9b0 2023-05-24T04:00:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b41598a0 con 0x7fe2b40be9b0 2023-05-24T04:00:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b4159710 con 0x7fe2b40be9b0 2023-05-24T04:00:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.478+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b4159a30 con 0x7fe2b40be9b0 2023-05-24T04:00:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.482+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2a40c6440 con 0x7fe2b40be9b0 2023-05-24T04:00:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.482+0000 7fe2aa7fc640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe298066280 0x7fe298068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.482+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe2a411eba0 con 0x7fe2b40be9b0 2023-05-24T04:00:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.482+0000 7fe2b9aae640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe298066280 0x7fe298068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.482+0000 7fe2b9aae640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe298066280 0x7fe298068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00045f0 tx=0x7fe2b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.486+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe2a40ebe70 con 0x7fe2b40be9b0 2023-05-24T04:00:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.674+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2b4066d70 con 0x7fe2b40be9b0 2023-05-24T04:00:02.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2aa7fc640 1 -- 172.21.15.40:0/3720443365 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3291 (secure 0 0 0) 0x7fe2a40ef490 con 0x7fe2b40be9b0 2023-05-24T04:00:02.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:02.682 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:02.317720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-24T04:00:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-05-24T04:00:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe298066280 msgr2=0x7fe298068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe298066280 0x7fe298068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00045f0 tx=0x7fe2b0008040 comp rx=0 tx=0).stop 2023-05-24T04:00:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 msgr2=0x7fe2b41e6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b41e6d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2a401a0c0 tx=0x7fe2a401acd0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 shutdown_connections 2023-05-24T04:00:02.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe298066280 0x7fe298068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2b40c2690 0x7fe2b41ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2b40be9b0 0x7fe2b41e6d00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 --2- 172.21.15.40:0/3720443365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2b406e6d0 0x7fe2b4144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 >> 172.21.15.40:0/3720443365 conn(0x7fe2b40726e0 msgr2=0x7fe2b40655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 shutdown_connections 2023-05-24T04:00:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.678+0000 7fe2bbd12640 1 -- 172.21.15.40:0/3720443365 wait complete. 2023-05-24T04:00:02.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:02.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.818+0000 7f50a6fc6640 1 Processor -- start 2023-05-24T04:00:02.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.818+0000 7f50a6fc6640 1 -- start start 2023-05-24T04:00:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a6fc6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a00c2690 0x7f50a00bb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a6fc6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50a00bfc10 0x7f50a006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a6fc6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a00bc820 con 0x7f50a00bc150 2023-05-24T04:00:02.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a6fc6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a006e7d0 con 0x7f50a00bfc10 2023-05-24T04:00:02.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a6fc6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c0080 con 0x7f50a00c2690 2023-05-24T04:00:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f50a00bc150 0x7f50a014dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44808/0 (socket says 172.21.15.40:44808) 2023-05-24T04:00:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 -- 172.21.15.40:0/4132613708 learned_addr learned my addr 172.21.15.40:0/4132613708 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a4d62640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a00c2690 0x7f50a00bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509ffff640 1 --2- 172.21.15.40:0/4132613708 >> v2:172.21.15.67:3300/0 conn(0x7f50a00bfc10 0x7f50a006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475409120 0 0) 0x7f50a00bc820 con 0x7f50a00bc150 2023-05-24T04:00:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5090003530 con 0x7f50a00bc150 2023-05-24T04:00:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571253152 0 0) 0x7f5090003530 con 0x7f50a00bc150 2023-05-24T04:00:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a00c2690 msgr2=0x7f50a00bb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a00c2690 0x7f50a00bb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 >> v2:172.21.15.67:3300/0 conn(0x7f50a00bfc10 msgr2=0x7f50a006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 --2- 172.21.15.40:0/4132613708 >> v2:172.21.15.67:3300/0 conn(0x7f50a00bfc10 0x7f50a006dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00bbdd0 con 0x7f50a00bc150 2023-05-24T04:00:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f5098001a00 con 0x7f50a00bc150 2023-05-24T04:00:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 >> v1:172.21.15.40:6789/0 conn(0x7f50a00bc150 legacy=0x7f50a014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5090003980 0x7f5090003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50900043b0 0x7f5090004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5090004f30 0x7f509000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a006e7d0 con 0x7f5090004f30 2023-05-24T04:00:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c0080 con 0x7f5090003980 2023-05-24T04:00:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509000bed0 con 0x7f50900043b0 2023-05-24T04:00:02.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a4d62640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a00c2690 0x7f50a00bb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:02.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5090004f30 0x7f509000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f509ffff640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50900043b0 0x7f5090004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a4d62640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5090003980 0x7f5090003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 -- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50900043b0 msgr2=0x7f5090004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50900043b0 0x7f5090004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 -- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5090003980 msgr2=0x7f5090003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5090003980 0x7f5090003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a5563640 1 -- 172.21.15.40:0/4132613708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090003530 con 0x7f5090004f30 2023-05-24T04:00:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.822+0000 7f50a4d62640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5090003980 0x7f5090003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a5563640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5090004f30 0x7f509000b990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f509800a860 tx=0x7f509801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1cff54210c26a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980aa6f0 con 0x7f5090004f30 2023-05-24T04:00:02.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50980aa850 con 0x7f5090004f30 2023-05-24T04:00:02.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f509f7fe640 1 -- 172.21.15.40:0/4132613708 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980aac20 con 0x7f5090004f30 2023-05-24T04:00:02.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 -- 172.21.15.40:0/4132613708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5090004f30 msgr2=0x7f509000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/4132613708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5090004f30 0x7f509000b990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f509800a860 tx=0x7f509801fac0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a5563640 1 -- 172.21.15.40:0/4132613708 reap_dead start 2023-05-24T04:00:02.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 -- 172.21.15.40:0/4132613708 shutdown_connections 2023-05-24T04:00:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 -- 172.21.15.40:0/4132613708 >> 172.21.15.40:0/4132613708 conn(0x7f50a00726e0 msgr2=0x7f50a00655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 -- 172.21.15.40:0/4132613708 shutdown_connections 2023-05-24T04:00:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 -- 172.21.15.40:0/4132613708 wait complete. 2023-05-24T04:00:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 Processor -- start 2023-05-24T04:00:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.826+0000 7f50a6fc6640 1 -- start start 2023-05-24T04:00:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a0151660 0x7f50a01e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a0148ec0 0x7f50a01e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 0x7f50a00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a014f290 con 0x7f50a01e7150 2023-05-24T04:00:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a014d9e0 con 0x7f50a0148ec0 2023-05-24T04:00:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a014d6c0 con 0x7f50a0151660 2023-05-24T04:00:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 0x7f50a00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 0x7f50a00a5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56928/0 (socket says 172.21.15.40:56928) 2023-05-24T04:00:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 -- 172.21.15.40:0/159203696 learned_addr learned my addr 172.21.15.40:0/159203696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509ffff640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a0148ec0 0x7f50a01e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a4d62640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a0151660 0x7f50a01e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 -- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a0151660 msgr2=0x7f50a01e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a0151660 0x7f50a01e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 -- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a0148ec0 msgr2=0x7f50a01e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a0148ec0 0x7f50a01e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 -- 172.21.15.40:0/159203696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00c2a60 con 0x7f50a01e7150 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a5563640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 0x7f50a00a5510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f509800a860 tx=0x7f5090005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980aa6f0 con 0x7f50a01e7150 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5098001fe0 con 0x7f50a01e7150 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a006e260 con 0x7f50a01e7150 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980019c0 con 0x7f50a01e7150 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a00c2bf0 con 0x7f50a01e7150 2023-05-24T04:00:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a014f440 con 0x7f50a01e7150 2023-05-24T04:00:02.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50980c6480 con 0x7f50a01e7150 2023-05-24T04:00:02.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509d7fa640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50840662b0 0x7f5084068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:02.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50981214f0 con 0x7f50a01e7150 2023-05-24T04:00:02.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a4d62640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50840662b0 0x7f5084068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:02.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.830+0000 7f50a4d62640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50840662b0 0x7f5084068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50a00664f0 tx=0x7f5094008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:02.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.834+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f50980ee8b0 con 0x7f50a01e7150 2023-05-24T04:00:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.990+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50a014b190 con 0x7f50a01e7150 2023-05-24T04:00:02.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.990+0000 7f509d7fa640 1 -- 172.21.15.40:0/159203696 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f50980f1ed0 con 0x7f50a01e7150 2023-05-24T04:00:02.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:02.996 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:02.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50840662b0 msgr2=0x7f5084068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50840662b0 0x7f5084068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50a00664f0 tx=0x7f5094008040 comp rx=0 tx=0).stop 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 msgr2=0x7f50a00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 0x7f50a00a5510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f509800a860 tx=0x7f5090005800 comp rx=0 tx=0).stop 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 shutdown_connections 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50840662b0 0x7f5084068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a01e7150 0x7f50a00a5510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a0148ec0 0x7f50a01e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 --2- 172.21.15.40:0/159203696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50a0151660 0x7f50a01e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:02.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 >> 172.21.15.40:0/159203696 conn(0x7f50a00726e0 msgr2=0x7f50a00bd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 shutdown_connections 2023-05-24T04:00:03.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:02.994+0000 7f50a6fc6640 1 -- 172.21.15.40:0/159203696 wait complete. 2023-05-24T04:00:03.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.126+0000 7f3b463a3640 1 Processor -- start 2023-05-24T04:00:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.126+0000 7f3b463a3640 1 -- start start 2023-05-24T04:00:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b463a3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b4014aa30 0x7f3b40071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b463a3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b4014bfe0 0x7f3b4006ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b463a3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4014b240 con 0x7f3b400a3290 2023-05-24T04:00:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b463a3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b40071d50 con 0x7f3b4014bfe0 2023-05-24T04:00:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b463a3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4006e810 con 0x7f3b4014aa30 2023-05-24T04:00:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3ffff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b4014aa30 0x7f3b40071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b44940640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b4014bfe0 0x7f3b4006ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3b400a3290 0x7f3b40071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:48866/0 (socket says 172.21.15.40:48866) 2023-05-24T04:00:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3f7fe640 1 -- 172.21.15.40:0/3741617030 learned_addr learned my addr 172.21.15.40:0/3741617030 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3ffff640 1 -- 172.21.15.40:0/3741617030 >> v2:172.21.15.67:3300/0 conn(0x7f3b4014bfe0 msgr2=0x7f3b4006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3ffff640 1 --2- 172.21.15.40:0/3741617030 >> v2:172.21.15.67:3300/0 conn(0x7f3b4014bfe0 0x7f3b4006ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3ffff640 1 -- 172.21.15.40:0/3741617030 >> v1:172.21.15.67:6789/0 conn(0x7f3b400a3290 legacy=0x7f3b40071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3ffff640 1 -- 172.21.15.40:0/3741617030 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4006ea20 con 0x7f3b4014aa30 2023-05-24T04:00:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b44940640 1 --2- 172.21.15.40:0/3741617030 >> v2:172.21.15.67:3300/0 conn(0x7f3b4014bfe0 0x7f3b4006ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.130+0000 7f3b3ffff640 1 --2- 172.21.15.40:0/3741617030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b4014aa30 0x7f3b40071100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097c0 tx=0x7f3b3001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a9bd4372ed8cf server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3effd640 1 -- 172.21.15.40:0/3741617030 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300ad680 con 0x7f3b4014aa30 2023-05-24T04:00:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3effd640 1 -- 172.21.15.40:0/3741617030 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300ad7e0 con 0x7f3b4014aa30 2023-05-24T04:00:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3effd640 1 -- 172.21.15.40:0/3741617030 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300adb70 con 0x7f3b4014aa30 2023-05-24T04:00:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/3741617030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b4014aa30 msgr2=0x7f3b40071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 --2- 172.21.15.40:0/3741617030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b4014aa30 0x7f3b40071100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097c0 tx=0x7f3b3001c360 comp rx=0 tx=0).stop 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/3741617030 shutdown_connections 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 --2- 172.21.15.40:0/3741617030 >> v2:172.21.15.67:3300/0 conn(0x7f3b4014bfe0 0x7f3b4006ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 --2- 172.21.15.40:0/3741617030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b4014aa30 0x7f3b40071100 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/3741617030 >> 172.21.15.40:0/3741617030 conn(0x7f3b400c0280 msgr2=0x7f3b400c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/3741617030 shutdown_connections 2023-05-24T04:00:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/3741617030 wait complete. 2023-05-24T04:00:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 Processor -- start 2023-05-24T04:00:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- start start 2023-05-24T04:00:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 0x7f3b4013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4014bfe0 0x7f3b4013d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b40153b70 0x7f3b4013da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40140400 con 0x7f3b4014aa30 2023-05-24T04:00:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40154930 con 0x7f3b4014bfe0 2023-05-24T04:00:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401551d0 con 0x7f3b40153b70 2023-05-24T04:00:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 0x7f3b4013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 0x7f3b4013f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56940/0 (socket says 172.21.15.40:56940) 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 -- 172.21.15.40:0/2612966499 learned_addr learned my addr 172.21.15.40:0/2612966499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b44940640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b40153b70 0x7f3b4013da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3f7fe640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4014bfe0 0x7f3b4013d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 -- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b40153b70 msgr2=0x7f3b4013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b40153b70 0x7f3b4013da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 -- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4014bfe0 msgr2=0x7f3b4013d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4014bfe0 0x7f3b4013d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 -- 172.21.15.40:0/2612966499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009a70 con 0x7f3b4014aa30 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3ffff640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 0x7f3b4013f9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b30019f90 tx=0x7f3b30019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300add60 con 0x7f3b4014aa30 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300b6410 con 0x7f3b4014aa30 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b30009420 con 0x7f3b4014aa30 2023-05-24T04:00:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300b67a0 con 0x7f3b4014aa30 2023-05-24T04:00:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.134+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b40157b70 con 0x7f3b4014aa30 2023-05-24T04:00:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.138+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b401579e0 con 0x7f3b4014aa30 2023-05-24T04:00:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.138+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b300b4040 con 0x7f3b4014aa30 2023-05-24T04:00:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.138+0000 7f3b3cff9640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3b2c0662b0 0x7f3b2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.138+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b3011e1e0 con 0x7f3b4014aa30 2023-05-24T04:00:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.138+0000 7f3b3f7fe640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3b2c0662b0 0x7f3b2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.138+0000 7f3b3f7fe640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3b2c0662b0 0x7f3b2c068760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b400c0250 tx=0x7f3b34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.142+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3b300eb400 con 0x7f3b4014aa30 2023-05-24T04:00:03.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.298+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b40157d00 con 0x7f3b4014aa30 2023-05-24T04:00:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.298+0000 7f3b3cff9640 1 -- 172.21.15.40:0/2612966499 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f3b300eea20 con 0x7f3b4014aa30 2023-05-24T04:00:03.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3b2c0662b0 msgr2=0x7f3b2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3b2c0662b0 0x7f3b2c068760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b400c0250 tx=0x7f3b34009040 comp rx=0 tx=0).stop 2023-05-24T04:00:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 msgr2=0x7f3b4013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 0x7f3b4013f9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b30019f90 tx=0x7f3b30019100 comp rx=0 tx=0).stop 2023-05-24T04:00:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 shutdown_connections 2023-05-24T04:00:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3b2c0662b0 0x7f3b2c068760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b40153b70 0x7f3b4013da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4014bfe0 0x7f3b4013d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 --2- 172.21.15.40:0/2612966499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4014aa30 0x7f3b4013f9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 >> 172.21.15.40:0/2612966499 conn(0x7f3b400c0280 msgr2=0x7f3b40071400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 shutdown_connections 2023-05-24T04:00:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.302+0000 7f3b463a3640 1 -- 172.21.15.40:0/2612966499 wait complete. 2023-05-24T04:00:03.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:00:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.462+0000 7ff9a32ed640 1 Processor -- start 2023-05-24T04:00:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.462+0000 7ff9a32ed640 1 -- start start 2023-05-24T04:00:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a32ed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff99c0c11c0 0x7ff99c152530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a32ed640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0b8040 con 0x7ff99c0bef60 2023-05-24T04:00:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a32ed640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0b7df0 con 0x7ff99c0a3da0 2023-05-24T04:00:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a32ed640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0c1660 con 0x7ff99c0c11c0 2023-05-24T04:00:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a1089640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff99c0bef60 0x7ff99c0c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44812/0 (socket says 172.21.15.40:44812) 2023-05-24T04:00:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a1089640 1 -- 172.21.15.40:0/4105049508 learned_addr learned my addr 172.21.15.40:0/4105049508 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a188a640 1 --2- 172.21.15.40:0/4105049508 >> v2:172.21.15.40:3300/0 conn(0x7ff99c0c11c0 0x7ff99c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff99bfff640 1 -- 172.21.15.40:0/4105049508 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888739798 0 0) 0x7ff98c001120 con 0x7ff99c0bef60 2023-05-24T04:00:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff99bfff640 1 -- 172.21.15.40:0/4105049508 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984003530 con 0x7ff99c0bef60 2023-05-24T04:00:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a188a640 1 -- 172.21.15.40:0/4105049508 >> v1:172.21.15.67:6789/0 conn(0x7ff99c0a3da0 legacy=0x7ff99c151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a188a640 1 -- 172.21.15.40:0/4105049508 >> v1:172.21.15.40:6789/0 conn(0x7ff99c0bef60 legacy=0x7ff99c0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a188a640 1 -- 172.21.15.40:0/4105049508 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0a38d0 con 0x7ff99c0c11c0 2023-05-24T04:00:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff9a188a640 1 --2- 172.21.15.40:0/4105049508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c152530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff994009d90 tx=0x7ff99401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be1ad368ae160b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.466+0000 7ff99bfff640 1 -- 172.21.15.40:0/4105049508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a5790 con 0x7ff99c0c11c0 2023-05-24T04:00:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff99bfff640 1 -- 172.21.15.40:0/4105049508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940a58f0 con 0x7ff99c0c11c0 2023-05-24T04:00:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff99bfff640 1 -- 172.21.15.40:0/4105049508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a5c80 con 0x7ff99c0c11c0 2023-05-24T04:00:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/4105049508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 msgr2=0x7ff99c152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/4105049508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c152530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff994009d90 tx=0x7ff99401c880 comp rx=0 tx=0).stop 2023-05-24T04:00:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/4105049508 shutdown_connections 2023-05-24T04:00:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/4105049508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c152530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/4105049508 >> 172.21.15.40:0/4105049508 conn(0x7ff99c065bb0 msgr2=0x7ff99c0a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/4105049508 shutdown_connections 2023-05-24T04:00:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/4105049508 wait complete. 2023-05-24T04:00:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 Processor -- start 2023-05-24T04:00:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- start start 2023-05-24T04:00:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c0a3da0 0x7ff99c148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff99c0bef60 0x7ff99c0bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c0b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0bda20 con 0x7ff99c0c11c0 2023-05-24T04:00:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0a9fc0 con 0x7ff99c0a3da0 2023-05-24T04:00:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0a8f20 con 0x7ff99c0bef60 2023-05-24T04:00:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c0b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c0b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56946/0 (socket says 172.21.15.40:56946) 2023-05-24T04:00:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 -- 172.21.15.40:0/159042763 learned_addr learned my addr 172.21.15.40:0/159042763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a0888640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff99c0bef60 0x7ff99c0bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a1089640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c0a3da0 0x7ff99c148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 -- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff99c0bef60 msgr2=0x7ff99c0bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff99c0bef60 0x7ff99c0bd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 -- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c0a3da0 msgr2=0x7ff99c148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c0a3da0 0x7ff99c148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 -- 172.21.15.40:0/159042763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994009a70 con 0x7ff99c0c11c0 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a1089640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c0a3da0 0x7ff99c148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a188a640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c0b84f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9940b0040 tx=0x7ff994019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940b9650 con 0x7ff99c0c11c0 2023-05-24T04:00:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940b97b0 con 0x7ff99c0c11c0 2023-05-24T04:00:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c0bb5d0 con 0x7ff99c0c11c0 2023-05-24T04:00:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940b9b20 con 0x7ff99c0c11c0 2023-05-24T04:00:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.470+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0bb440 con 0x7ff99c0c11c0 2023-05-24T04:00:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.474+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c0c3410 con 0x7ff99c0c11c0 2023-05-24T04:00:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.474+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9940b9c80 con 0x7ff99c0c11c0 2023-05-24T04:00:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.474+0000 7ff999ffb640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff988066280 0x7ff988068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.474+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff99411f1b0 con 0x7ff99c0c11c0 2023-05-24T04:00:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.474+0000 7ff9a1089640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff988066280 0x7ff988068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.474+0000 7ff9a1089640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff988066280 0x7ff988068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff98c007fd0 tx=0x7ff98c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.478+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff9940ec340 con 0x7ff99c0c11c0 2023-05-24T04:00:03.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.658+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff99c1ea4a0 con 0x7ff99c0c11c0 2023-05-24T04:00:03.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff999ffb640 1 -- 172.21.15.40:0/159042763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3291 (secure 0 0 0) 0x7ff9940ef960 con 0x7ff99c0c11c0 2023-05-24T04:00:03.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:03.666 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:02.317720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-24T04:00:03.666 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-05-24T04:00:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff988066280 msgr2=0x7ff988068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff988066280 0x7ff988068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff98c007fd0 tx=0x7ff98c009040 comp rx=0 tx=0).stop 2023-05-24T04:00:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 msgr2=0x7ff99c0b84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c0b84f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9940b0040 tx=0x7ff994019620 comp rx=0 tx=0).stop 2023-05-24T04:00:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 shutdown_connections 2023-05-24T04:00:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff988066280 0x7ff988068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0c11c0 0x7ff99c0b84f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff99c0bef60 0x7ff99c0bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 --2- 172.21.15.40:0/159042763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c0a3da0 0x7ff99c148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 >> 172.21.15.40:0/159042763 conn(0x7ff99c065bb0 msgr2=0x7ff99c0a61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 shutdown_connections 2023-05-24T04:00:03.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.662+0000 7ff9a32ed640 1 -- 172.21.15.40:0/159042763 wait complete. 2023-05-24T04:00:03.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34264ca640 1 Processor -- start 2023-05-24T04:00:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34264ca640 1 -- start start 2023-05-24T04:00:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34264ca640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34200befa0 0x7f34200c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34264ca640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34200c2660 con 0x7f34200c4070 2023-05-24T04:00:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34264ca640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34200c4470 con 0x7f34200a37e0 2023-05-24T04:00:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34264ca640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34200a3dc0 con 0x7f34200befa0 2023-05-24T04:00:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f3424a67640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f34200c4070 0x7f3420151f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44824/0 (socket says 172.21.15.40:44824) 2023-05-24T04:00:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f3424a67640 1 -- 172.21.15.40:0/3659661692 learned_addr learned my addr 172.21.15.40:0/3659661692 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 --2- 172.21.15.40:0/3659661692 >> v2:172.21.15.67:3300/0 conn(0x7f34200befa0 0x7f34200c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477767945 0 0) 0x7f34200c2660 con 0x7f34200c4070 2023-05-24T04:00:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f340c003530 con 0x7f34200c4070 2023-05-24T04:00:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179379491 0 0) 0x7f340c003530 con 0x7f34200c4070 2023-05-24T04:00:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 >> v2:172.21.15.67:3300/0 conn(0x7f34200befa0 msgr2=0x7f34200c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 --2- 172.21.15.40:0/3659661692 >> v2:172.21.15.67:3300/0 conn(0x7f34200befa0 0x7f34200c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 >> v1:172.21.15.67:6789/0 conn(0x7f34200a37e0 legacy=0x7f34200c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200c3670 con 0x7f34200c4070 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f3418001a00 con 0x7f34200c4070 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 >> v1:172.21.15.40:6789/0 conn(0x7f34200c4070 legacy=0x7f3420151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f340c003980 0x7f340c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f340c0047d0 0x7f340c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f340c005180 0x7f340c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00c0e0 con 0x7f340c003980 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00c250 con 0x7f340c005180 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00c410 con 0x7f340c0047d0 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f340c003980 0x7f340c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f3424a67640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f340c005180 0x7f340c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f34177fe640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f340c0047d0 0x7f340c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 -- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f340c0047d0 msgr2=0x7f340c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f340c0047d0 0x7f340c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 -- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f340c005180 msgr2=0x7f340c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f340c005180 0x7f340c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f341ffff640 1 -- 172.21.15.40:0/3659661692 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c003530 con 0x7f340c003980 2023-05-24T04:00:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f3424a67640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f340c005180 0x7f340c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.798+0000 7f3424a67640 1 -- 172.21.15.40:0/3659661692 reap_dead start 2023-05-24T04:00:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f341ffff640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f340c003980 0x7f340c003d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3410009ab0 tx=0x7f341001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a493a1b21e6d8975 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100a5600 con 0x7f340c003980 2023-05-24T04:00:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34100a5760 con 0x7f340c003980 2023-05-24T04:00:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f341f7fe640 1 -- 172.21.15.40:0/3659661692 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100a5b10 con 0x7f340c003980 2023-05-24T04:00:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- 172.21.15.40:0/3659661692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f340c003980 msgr2=0x7f340c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f340c003980 0x7f340c003d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3410009ab0 tx=0x7f341001ca30 comp rx=0 tx=0).stop 2023-05-24T04:00:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- 172.21.15.40:0/3659661692 shutdown_connections 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 --2- 172.21.15.40:0/3659661692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f340c003980 0x7f340c003d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- 172.21.15.40:0/3659661692 >> 172.21.15.40:0/3659661692 conn(0x7f3420066220 msgr2=0x7f34200a62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- 172.21.15.40:0/3659661692 shutdown_connections 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- 172.21.15.40:0/3659661692 wait complete. 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 Processor -- start 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- start start 2023-05-24T04:00:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34200b8480 0x7f34200bd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34200be190 0x7f34200b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 0x7f342014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34200b9c60 con 0x7f34200b8d90 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342014f610 con 0x7f34200b8480 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34264ca640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200bddb0 con 0x7f34200be190 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f3424a67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 0x7f342014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f3424a67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 0x7f342014e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56960/0 (socket says 172.21.15.40:56960) 2023-05-24T04:00:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f3424a67640 1 -- 172.21.15.40:0/1377964008 learned_addr learned my addr 172.21.15.40:0/1377964008 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.802+0000 7f34177fe640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34200be190 0x7f34200b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f3424a67640 1 -- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34200be190 msgr2=0x7f34200b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f3424a67640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34200be190 0x7f34200b8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f3424a67640 1 -- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34200b8480 msgr2=0x7f34200bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341ffff640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34200b8480 0x7f34200bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f3424a67640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34200b8480 0x7f34200bd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f3424a67640 1 -- 172.21.15.40:0/1377964008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200bb480 con 0x7f34200b8d90 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f34177fe640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34200be190 0x7f34200b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f3424a67640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 0x7f342014e4e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34200c4440 tx=0x7f3418001ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418007070 con 0x7f34200b8d90 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34180071d0 con 0x7f34200b8d90 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34200aa620 con 0x7f34200b8d90 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418007580 con 0x7f34200b8d90 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34200bb610 con 0x7f34200b8d90 2023-05-24T04:00:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342014f0e0 con 0x7f34200b8d90 2023-05-24T04:00:03.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34180076e0 con 0x7f34200b8d90 2023-05-24T04:00:03.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341d7fa640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f34000662b0 0x7f3400068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:03.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3418083990 con 0x7f34200b8d90 2023-05-24T04:00:03.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341ffff640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f34000662b0 0x7f3400068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:03.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.806+0000 7f341ffff640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f34000662b0 0x7f3400068760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34100af000 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:03.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.810+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f342014f0e0 con 0x7f34200b8d90 2023-05-24T04:00:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.966+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f342014f0e0 con 0x7f34200b8d90 2023-05-24T04:00:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f341d7fa640 1 -- 172.21.15.40:0/1377964008 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f342014f0e0 con 0x7f34200b8d90 2023-05-24T04:00:03.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:03.975 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f34000662b0 msgr2=0x7f3400068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f34000662b0 0x7f3400068760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34100af000 tx=0x7f3410008040 comp rx=0 tx=0).stop 2023-05-24T04:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 msgr2=0x7f342014e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 0x7f342014e4e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34200c4440 tx=0x7f3418001ed0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 shutdown_connections 2023-05-24T04:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f34000662b0 0x7f3400068760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34200b8d90 0x7f342014e4e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34200be190 0x7f34200b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 --2- 172.21.15.40:0/1377964008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34200b8480 0x7f34200bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:03.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 >> 172.21.15.40:0/1377964008 conn(0x7f340c003980 msgr2=0x7f34200a8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:03.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 shutdown_connections 2023-05-24T04:00:03.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:03.970+0000 7f34264ca640 1 -- 172.21.15.40:0/1377964008 wait complete. 2023-05-24T04:00:04.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-24T03:59:57.892410+0000', 'modified': '2023-05-24T04:00:02.317720+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6833/3554538206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 3554538206}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 3554538206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-24T04:00:04.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-24T04:00:04.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-24T04:00:04.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b407f640 1 Processor -- start 2023-05-24T04:00:04.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b407f640 1 -- start start 2023-05-24T04:00:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b407f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60ac14fa70 0x7f60ac06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b407f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac06ea20 con 0x7f60ac145df0 2023-05-24T04:00:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b407f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac06ec70 con 0x7f60ac070b20 2023-05-24T04:00:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b407f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac150230 con 0x7f60ac14fa70 2023-05-24T04:00:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f60ac145df0 0x7f60ac156ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44834/0 (socket says 172.21.15.40:44834) 2023-05-24T04:00:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 -- 172.21.15.40:0/2906413429 learned_addr learned my addr 172.21.15.40:0/2906413429 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/2906413429 >> v2:172.21.15.67:3300/0 conn(0x7f60ac14fa70 0x7f60ac06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202870057 0 0) 0x7f60ac06ea20 con 0x7f60ac145df0 2023-05-24T04:00:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6098003530 con 0x7f60ac145df0 2023-05-24T04:00:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2744336748 0 0) 0x7f6098003530 con 0x7f60ac145df0 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 >> v2:172.21.15.67:3300/0 conn(0x7f60ac14fa70 msgr2=0x7f60ac06fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 --2- 172.21.15.40:0/2906413429 >> v2:172.21.15.67:3300/0 conn(0x7f60ac14fa70 0x7f60ac06fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 >> v1:172.21.15.67:6789/0 conn(0x7f60ac070b20 legacy=0x7f60ac06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac06c1d0 con 0x7f60ac145df0 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f60a4001a00 con 0x7f60ac145df0 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 >> v1:172.21.15.40:6789/0 conn(0x7f60ac145df0 legacy=0x7f60ac156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6098003980 0x7f6098003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60980047d0 0x7f6098004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6098005180 0x7f609800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac150230 con 0x7f6098005180 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609800c000 con 0x7f6098003980 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609800c1c0 con 0x7f60980047d0 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6098005180 0x7f609800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6098003980 0x7f6098003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b161a640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60980047d0 0x7f6098004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 -- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60980047d0 msgr2=0x7f6098004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60980047d0 0x7f6098004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 -- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6098003980 msgr2=0x7f6098003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6098003980 0x7f6098003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b261c640 1 -- 172.21.15.40:0/2906413429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098003530 con 0x7f6098005180 2023-05-24T04:00:04.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.326+0000 7f60b161a640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60980047d0 0x7f6098004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:04.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b261c640 1 -- 172.21.15.40:0/2906413429 reap_dead start 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b261c640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6098005180 0x7f609800b990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60a400a830 tx=0x7f60a401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96aed251045eb33 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40072d0 con 0x7f6098005180 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a40a8070 con 0x7f6098005180 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b0e19640 1 -- 172.21.15.40:0/2906413429 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40076b0 con 0x7f6098005180 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- 172.21.15.40:0/2906413429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6098005180 msgr2=0x7f609800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6098005180 0x7f609800b990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60a400a830 tx=0x7f60a401d340 comp rx=0 tx=0).stop 2023-05-24T04:00:04.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- 172.21.15.40:0/2906413429 shutdown_connections 2023-05-24T04:00:04.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 --2- 172.21.15.40:0/2906413429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6098005180 0x7f609800b990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- 172.21.15.40:0/2906413429 >> 172.21.15.40:0/2906413429 conn(0x7f60ac0c0280 msgr2=0x7f60ac0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- 172.21.15.40:0/2906413429 shutdown_connections 2023-05-24T04:00:04.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- 172.21.15.40:0/2906413429 wait complete. 2023-05-24T04:00:04.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 Processor -- start 2023-05-24T04:00:04.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- start start 2023-05-24T04:00:04.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6098005180 0x7f60ac1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 0x7f60ac149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac1e4630 0x7f60ac1e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0b5f90 con 0x7f60ac14bab0 2023-05-24T04:00:04.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac148930 con 0x7f60ac1e4630 2023-05-24T04:00:04.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b407f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac148c10 con 0x7f6098005180 2023-05-24T04:00:04.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b161a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 0x7f60ac149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b161a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 0x7f60ac149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56976/0 (socket says 172.21.15.40:56976) 2023-05-24T04:00:04.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.330+0000 7f60b161a640 1 -- 172.21.15.40:0/873325243 learned_addr learned my addr 172.21.15.40:0/873325243 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6098005180 0x7f60ac1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b261c640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac1e4630 0x7f60ac1e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b161a640 1 -- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6098005180 msgr2=0x7f60ac1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b161a640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6098005180 0x7f60ac1478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b161a640 1 -- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac1e4630 msgr2=0x7f60ac1e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b161a640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac1e4630 0x7f60ac1e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b161a640 1 -- 172.21.15.40:0/873325243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac14d330 con 0x7f60ac14bab0 2023-05-24T04:00:04.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b161a640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 0x7f60ac149130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f609c00d480 tx=0x7f609c00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60a27fc640 1 -- 172.21.15.40:0/873325243 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c005480 con 0x7f60ac14bab0 2023-05-24T04:00:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60a27fc640 1 -- 172.21.15.40:0/873325243 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c003620 con 0x7f60ac14bab0 2023-05-24T04:00:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac0c10d0 con 0x7f60ac14bab0 2023-05-24T04:00:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60a27fc640 1 -- 172.21.15.40:0/873325243 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0039b0 con 0x7f60ac14bab0 2023-05-24T04:00:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac14fe40 con 0x7f60ac14bab0 2023-05-24T04:00:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60a27fc640 1 -- 172.21.15.40:0/873325243 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f609c003b10 con 0x7f60ac14bab0 2023-05-24T04:00:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60a27fc640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6090066280 0x7f6090068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60a27fc640 1 -- 172.21.15.40:0/873325243 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f609c083eb0 con 0x7f60ac14bab0 2023-05-24T04:00:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6090066280 0x7f6090068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6090066280 0x7f6090068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60a80099b0 tx=0x7f60a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b71a4000 1 Processor -- start 2023-05-24T04:00:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.334+0000 7f60b71a4000 1 -- start start 2023-05-24T04:00:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a3005ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005ca590 0x55a3005ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 0x55a30060d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a300491c30 con 0x55a3005caea0 2023-05-24T04:00:04.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3003cbe20 con 0x55a3005ca590 2023-05-24T04:00:04.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a30041f4f0 con 0x55a3005c9c80 2023-05-24T04:00:04.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 0x55a30060d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 0x55a30060d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56980/0 (socket says 172.21.15.40:56980) 2023-05-24T04:00:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 -- 172.21.15.40:0/1905565791 learned_addr learned my addr 172.21.15.40:0/1905565791 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a3005ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 -- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 msgr2=0x55a3005ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a3005ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005ca590 0x55a3005ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 -- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005ca590 msgr2=0x55a3005ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005ca590 0x55a3005ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 -- 172.21.15.40:0/1905565791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3003dd530 con 0x55a3005caea0 2023-05-24T04:00:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 0x55a30060d5e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60a401dbe0 tx=0x7f60a4009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40161550534b6175 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f608f7fe640 1 -- 172.21.15.40:0/1905565791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4001800 con 0x55a3005caea0 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f608f7fe640 1 -- 172.21.15.40:0/1905565791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4001960 con 0x55a3005caea0 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f608f7fe640 1 -- 172.21.15.40:0/1905565791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4004d70 con 0x55a3005caea0 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- 172.21.15.40:0/1905565791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 msgr2=0x55a30060d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 0x55a30060d5e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60a401dbe0 tx=0x7f60a4009050 comp rx=0 tx=0).stop 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- 172.21.15.40:0/1905565791 shutdown_connections 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005caea0 0x55a30060d5e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005ca590 0x55a3005ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1905565791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a3005ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- 172.21.15.40:0/1905565791 >> 172.21.15.40:0/1905565791 conn(0x55a3005c6180 msgr2=0x55a3005c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- 172.21.15.40:0/1905565791 shutdown_connections 2023-05-24T04:00:04.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- 172.21.15.40:0/1905565791 wait complete. 2023-05-24T04:00:04.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- start start 2023-05-24T04:00:04.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 Processor -- start 2023-05-24T04:00:04.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005c9c80 0x55a3005cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a300603db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005caea0 0x55a3006042f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a300418590 con 0x55a3005ca590 2023-05-24T04:00:04.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3003d51c0 con 0x55a3005c9c80 2023-05-24T04:00:04.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3003d4e60 con 0x55a3005caea0 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 10 client.0 _ll_register_callbacks cb 0x55a3005b5790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a300603db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a300603db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56992/0 (socket says 172.21.15.40:56992) 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 -- 172.21.15.40:0/1967814709 learned_addr learned my addr 172.21.15.40:0/1967814709 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005c9c80 0x55a3005cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b261c640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005caea0 0x55a3006042f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 -- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005caea0 msgr2=0x55a3006042f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005caea0 0x55a3006042f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 -- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005c9c80 msgr2=0x55a3005cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005c9c80 0x55a3005cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 -- 172.21.15.40:0/1967814709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a40b4040 con 0x55a3005ca590 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b161a640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a300603db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f609c05cbb0 tx=0x7f609c05d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f02e79133823d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f608cff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-24T04:00:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f608cff9640 1 -- 172.21.15.40:0/1967814709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0531f0 con 0x55a3005ca590 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f608cff9640 1 -- 172.21.15.40:0/1967814709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f609c053cf0 con 0x55a3005ca590 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.338+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3003e7e40 con 0x55a3005ca590 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 1 -- 172.21.15.40:0/1967814709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f609c053eb0 con 0x55a3005ca590 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 10 client.4419 fetch_fsmap learned FSMap version 6 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55a300114890 con 0x55a3005ca590 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 1 -- 172.21.15.40:0/1967814709 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3003e7e40 con 0x55a3005ca590 2023-05-24T04:00:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 1 -- 172.21.15.40:0/1967814709 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 2152+0+0 (secure 0 0 0) 0x7f609c080070 con 0x55a3005ca590 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 20 client.4419 populate_metadata read hostname 'smithi040' 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a3006027b0 0x55a300602b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 4 client.4419 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 --> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a300448210 con 0x55a3006027b0 2023-05-24T04:00:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a3006027b0 0x55a300602b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 10 client.4419 ms_handle_connect on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a3006027b0 0x55a300602b80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7517f7d31cedc02 server_cookie=718484692011be09 in_seq=0 out_seq=0 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 1 -- 172.21.15.40:0/1967814709 <== mds.0 v2:172.21.15.67:6832/3554538206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a300448210 con 0x55a3006027b0 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 10 client.4419 handle_command_reply: tid=0 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 client.4419 shutdown 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 msgr2=0x55a300603db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a300603db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f609c05cbb0 tx=0x7f609c05d220 comp rx=0 tx=0).stop 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 shutdown_connections 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a3006027b0 0x55a300602b80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005caea0 0x55a3006042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a300603db0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 --2- 172.21.15.40:0/1967814709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005c9c80 0x55a3005cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f608cff9640 0 client.4419 ms_handle_reset on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:04.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 >> 172.21.15.40:0/1967814709 conn(0x55a3005c6180 msgr2=0x55a3005c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 shutdown_connections 2023-05-24T04:00:04.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 1 -- 172.21.15.40:0/1967814709 wait complete. 2023-05-24T04:00:04.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.342+0000 7f60b71a4000 20 client.4419 trim_cache size 0 max 16384 2023-05-24T04:00:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 Processor -- start 2023-05-24T04:00:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 -- start start 2023-05-24T04:00:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 0x55a300600dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005ca590 0x55a300601300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 0x55a300601840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3005c6040 con 0x55a3005c9c80 2023-05-24T04:00:04.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3000d5940 con 0x55a3005caea0 2023-05-24T04:00:04.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a300415da0 con 0x55a3005ca590 2023-05-24T04:00:04.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 0x55a300600dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 0x55a300600dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56996/0 (socket says 172.21.15.40:56996) 2023-05-24T04:00:04.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 -- 172.21.15.40:0/4085398682 learned_addr learned my addr 172.21.15.40:0/4085398682 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 -- 172.21.15.40:0/4085398682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005ca590 msgr2=0x55a300601300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005ca590 0x55a300601300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 -- 172.21.15.40:0/4085398682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 msgr2=0x55a300601840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 0x55a300601840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 -- 172.21.15.40:0/4085398682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3003dd7e0 con 0x55a3005c9c80 2023-05-24T04:00:04.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 0x55a300600dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60a8013f90 tx=0x7f60a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6c8936ab973f25 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.358+0000 7f608ffff640 1 -- 172.21.15.40:0/4085398682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8029040 con 0x55a3005c9c80 2023-05-24T04:00:04.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608ffff640 1 -- 172.21.15.40:0/4085398682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a802a500 con 0x55a3005c9c80 2023-05-24T04:00:04.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608ffff640 1 -- 172.21.15.40:0/4085398682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8004220 con 0x55a3005c9c80 2023-05-24T04:00:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/4085398682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 msgr2=0x55a300600dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 0x55a300600dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60a8013f90 tx=0x7f60a8019000 comp rx=0 tx=0).stop 2023-05-24T04:00:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/4085398682 shutdown_connections 2023-05-24T04:00:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 0x55a300601840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005ca590 0x55a300601300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- 172.21.15.40:0/4085398682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005c9c80 0x55a300600dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/4085398682 >> 172.21.15.40:0/4085398682 conn(0x55a3005c6180 msgr2=0x55a3005c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/4085398682 shutdown_connections 2023-05-24T04:00:04.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/4085398682 wait complete. 2023-05-24T04:00:04.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- start start 2023-05-24T04:00:04.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 Processor -- start 2023-05-24T04:00:04.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a30061be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a30061c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 0x55a30061c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a300420780 con 0x55a3005ca590 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3004e4390 con 0x55a3005caea0 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3003dc350 con 0x55a3005c9c80 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 10 client.0 _ll_register_callbacks cb 0x55a3003b84c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a30061c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a30061c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57002/0 (socket says 172.21.15.40:57002) 2023-05-24T04:00:04.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 -- 172.21.15.40:0/254555930 learned_addr learned my addr 172.21.15.40:0/254555930 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 -- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 msgr2=0x55a30061be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a30061be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 -- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 msgr2=0x55a30061c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 0x55a30061c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 -- 172.21.15.40:0/254555930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a8013cc0 con 0x55a3005ca590 2023-05-24T04:00:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b161a640 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a30061c3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f609c082070 tx=0x7f609c000f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666f2776fd54feb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-24T04:00:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 1 -- 172.21.15.40:0/254555930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c06c510 con 0x55a3005ca590 2023-05-24T04:00:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 1 -- 172.21.15.40:0/254555930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f609c0531f0 con 0x55a3005ca590 2023-05-24T04:00:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3003e7a70 con 0x55a3005ca590 2023-05-24T04:00:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 1 -- 172.21.15.40:0/254555930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f609c052f90 con 0x55a3005ca590 2023-05-24T04:00:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 10 client.4425 fetch_fsmap learned FSMap version 6 2023-05-24T04:00:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55a3003c3060 con 0x55a3005ca590 2023-05-24T04:00:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 1 -- 172.21.15.40:0/254555930 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3003e7a70 con 0x55a3005ca590 2023-05-24T04:00:04.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 1 -- 172.21.15.40:0/254555930 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 2152+0+0 (secure 0 0 0) 0x7f609c080070 con 0x55a3005ca590 2023-05-24T04:00:04.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 10 client.4425 fetch_fsmap finished waiting for FSMap version 6 2023-05-24T04:00:04.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-24T04:00:04.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 20 client.4425 populate_metadata read hostname 'smithi040' 2023-05-24T04:00:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a30061d2c0 0x55a30066caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 4 client.4425 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-05-24T04:00:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 --> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a300411570 con 0x55a30061d2c0 2023-05-24T04:00:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a30061d2c0 0x55a30066caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f60b1e1b640 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a30061d2c0 0x55a30066caf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3630af7713dd5848 server_cookie=90eb412bc65cbaea in_seq=0 out_seq=0 2023-05-24T04:00:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.362+0000 7f608cff9640 10 client.4425 ms_handle_connect on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:04.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f608cff9640 1 -- 172.21.15.40:0/254555930 <== mds.0 v2:172.21.15.67:6832/3554538206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55a300411570 con 0x55a30061d2c0 2023-05-24T04:00:04.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f608cff9640 10 client.4425 handle_command_reply: tid=0 2023-05-24T04:00:04.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 client.4425 shutdown 2023-05-24T04:00:04.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 msgr2=0x55a30061c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a30061c3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f609c082070 tx=0x7f609c000f80 comp rx=0 tx=0).stop 2023-05-24T04:00:04.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 shutdown_connections 2023-05-24T04:00:04.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x55a30061d2c0 0x55a30066caf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3005caea0 0x55a30061c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a3005ca590 0x55a30061c3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 --2- 172.21.15.40:0/254555930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55a3005c9c80 0x55a30061be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f608cff9640 0 client.4425 ms_handle_reset on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:04.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 >> 172.21.15.40:0/254555930 conn(0x55a3005c6180 msgr2=0x55a3005c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 shutdown_connections 2023-05-24T04:00:04.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 1 -- 172.21.15.40:0/254555930 wait complete. 2023-05-24T04:00:04.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b71a4000 20 client.4425 trim_cache size 0 max 16384 2023-05-24T04:00:04.393 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "b4b82cba-0383-492a-85bf-0de09746a380", 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4279, 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 6.4694760589999998, 2023-05-24T04:00:04.394 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 6, 2023-05-24T04:00:04.395 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 27, 2023-05-24T04:00:04.395 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 26, 2023-05-24T04:00:04.395 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 10.77320115 2023-05-24T04:00:04.396 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:00:04.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6090066280 msgr2=0x7f6090068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6090066280 0x7f6090068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60a80099b0 tx=0x7f60a8008040 comp rx=0 tx=0).stop 2023-05-24T04:00:04.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 msgr2=0x7f60ac149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 0x7f60ac149130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f609c00d480 tx=0x7f609c00d940 comp rx=0 tx=0).stop 2023-05-24T04:00:04.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 shutdown_connections 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6090066280 0x7f6090068730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac1e4630 0x7f60ac1e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60ac14bab0 0x7f60ac149130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 --2- 172.21.15.40:0/873325243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6098005180 0x7f60ac1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 >> 172.21.15.40:0/873325243 conn(0x7f60ac0c0280 msgr2=0x7f60ac142830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 shutdown_connections 2023-05-24T04:00:04.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.366+0000 7f60b407f640 1 -- 172.21.15.40:0/873325243 wait complete. 2023-05-24T04:00:04.399 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T04:00:04.400 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:04.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T04:00:04.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 Processor -- start 2023-05-24T04:00:04.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 -- start start 2023-05-24T04:00:04.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e200a3e20 0x7f4e200a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e2006f970 0x7f4e200a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e200bd720 con 0x7f4e20069c40 2023-05-24T04:00:04.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e20156d60 con 0x7f4e2006f970 2023-05-24T04:00:04.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e261a5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200bd970 con 0x7f4e200a3e20 2023-05-24T04:00:04.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e2006f970 0x7f4e200a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e2006f970 0x7f4e200a2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57016/0 (socket says 172.21.15.40:57016) 2023-05-24T04:00:04.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 -- 172.21.15.40:0/3734785650 learned_addr learned my addr 172.21.15.40:0/3734785650 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1effd640 1 --2- 172.21.15.40:0/3734785650 >> v2:172.21.15.67:3300/0 conn(0x7f4e200a3e20 0x7f4e200a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 -- 172.21.15.40:0/3734785650 >> v2:172.21.15.67:3300/0 conn(0x7f4e200a3e20 msgr2=0x7f4e200a2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 --2- 172.21.15.40:0/3734785650 >> v2:172.21.15.67:3300/0 conn(0x7f4e200a3e20 0x7f4e200a2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 -- 172.21.15.40:0/3734785650 >> v1:172.21.15.67:6789/0 conn(0x7f4e20069c40 legacy=0x7f4e20151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 -- 172.21.15.40:0/3734785650 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20156980 con 0x7f4e2006f970 2023-05-24T04:00:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1ffff640 1 --2- 172.21.15.40:0/3734785650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2006f970 0x7f4e200a2d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006f420 tx=0x7f4e1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d8bd8ba1a940e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.514+0000 7f4e1e7fc640 1 -- 172.21.15.40:0/3734785650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180ac630 con 0x7f4e2006f970 2023-05-24T04:00:04.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1e7fc640 1 -- 172.21.15.40:0/3734785650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e180ac790 con 0x7f4e2006f970 2023-05-24T04:00:04.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1e7fc640 1 -- 172.21.15.40:0/3734785650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180acb20 con 0x7f4e2006f970 2023-05-24T04:00:04.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/3734785650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2006f970 msgr2=0x7f4e200a2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 --2- 172.21.15.40:0/3734785650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2006f970 0x7f4e200a2d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006f420 tx=0x7f4e1801c430 comp rx=0 tx=0).stop 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/3734785650 shutdown_connections 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 --2- 172.21.15.40:0/3734785650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2006f970 0x7f4e200a2d50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 --2- 172.21.15.40:0/3734785650 >> v2:172.21.15.67:3300/0 conn(0x7f4e200a3e20 0x7f4e200a2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/3734785650 >> 172.21.15.40:0/3734785650 conn(0x7f4e200c13f0 msgr2=0x7f4e200c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/3734785650 shutdown_connections 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/3734785650 wait complete. 2023-05-24T04:00:04.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 Processor -- start 2023-05-24T04:00:04.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- start start 2023-05-24T04:00:04.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 0x7f4e20150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e2006f970 0x7f4e200a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e200a3e20 0x7f4e200a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201eee30 con 0x7f4e20069c40 2023-05-24T04:00:04.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e20151330 con 0x7f4e200a3e20 2023-05-24T04:00:04.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201ef2c0 con 0x7f4e2006f970 2023-05-24T04:00:04.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 0x7f4e20150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 0x7f4e20150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57028/0 (socket says 172.21.15.40:57028) 2023-05-24T04:00:04.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 -- 172.21.15.40:0/805768742 learned_addr learned my addr 172.21.15.40:0/805768742 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1effd640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e2006f970 0x7f4e200a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1ffff640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e200a3e20 0x7f4e200a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 -- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e2006f970 msgr2=0x7f4e200a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e2006f970 0x7f4e200a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 -- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e200a3e20 msgr2=0x7f4e200a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e200a3e20 0x7f4e200a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 -- 172.21.15.40:0/805768742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180094d0 con 0x7f4e20069c40 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1ffff640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e200a3e20 0x7f4e200a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e1f7fe640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 0x7f4e20150df0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c7f0 tx=0x7f4e1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000aa50 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000abb0 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2015fa80 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10012420 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.518+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e200a36a0 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.522+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2015fc10 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.522+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e10012580 con 0x7f4e20069c40 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.522+0000 7f4e07fff640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4e0c066280 0x7f4e0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.522+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e100842f0 con 0x7f4e20069c40 2023-05-24T04:00:04.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.522+0000 7f4e1effd640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4e0c066280 0x7f4e0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:04.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.522+0000 7f4e1effd640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4e0c066280 0x7f4e0c068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4e20151b00 tx=0x7f4e14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:04.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.526+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4e10051480 con 0x7f4e20069c40 2023-05-24T04:00:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.706+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e2006d620 con 0x7f4e20069c40 2023-05-24T04:00:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.706+0000 7f4e07fff640 1 -- 172.21.15.40:0/805768742 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4e10016070 con 0x7f4e20069c40 2023-05-24T04:00:04.713 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T04:00:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4e0c066280 msgr2=0x7f4e0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4e0c066280 0x7f4e0c068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4e20151b00 tx=0x7f4e14008040 comp rx=0 tx=0).stop 2023-05-24T04:00:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 msgr2=0x7f4e20150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 0x7f4e20150df0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c7f0 tx=0x7f4e1000ccb0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 shutdown_connections 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4e0c066280 0x7f4e0c068730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e200a3e20 0x7f4e200a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e2006f970 0x7f4e200a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 --2- 172.21.15.40:0/805768742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e20069c40 0x7f4e20150df0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 >> 172.21.15.40:0/805768742 conn(0x7f4e200c13f0 msgr2=0x7f4e200be3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 shutdown_connections 2023-05-24T04:00:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:04.710+0000 7f4e261a5640 1 -- 172.21.15.40:0/805768742 wait complete. 2023-05-24T04:00:04.731 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-24T04:00:04.731 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T04:00:04.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2023-05-24T04:00:04.732 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-24T04:00:04.732 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:04.732 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-24T04:00:04.732 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T04:00:04.733 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T04:00:04.733 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-24T04:00:04.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:04.734 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2023-05-24T04:00:04.740 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T04:00:04.740 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T04:00:04.740 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2023-05-24T04:00:04.741 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-24T04:00:04.742 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42439sec preferred_lft 42439sec 2023-05-24T04:00:04.743 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2023-05-24T04:00:04.743 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:04.743 INFO:teuthology.orchestra.run.smithi121.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-24T04:00:04.743 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 02:42:9c:cf:d4:9d brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:04.743 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-24T04:00:04.743 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:04.744 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T04:00:04.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:04.744 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:04.745 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:04.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2023-05-24T04:00:04.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2023-05-24T04:00:04.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2023-05-24T04:00:04.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T04:00:04.746 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:04.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:04.826 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T04:00:04.881 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-05-24T04:00:04.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:04.882 DEBUG:teuthology.orchestra.run.smithi121:> route 2023-05-24T04:00:04.943 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2023-05-24T04:00:04.944 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T04:00:04.944 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-24T04:00:04.944 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T04:00:04.944 INFO:teuthology.orchestra.run.smithi121.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-24T04:00:04.944 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T04:00:04.945 INFO:teuthology.orchestra.run.smithi121.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:04.945 INFO:teuthology.orchestra.run.smithi121.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:04.945 INFO:teuthology.orchestra.run.smithi121.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:04.945 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T04:00:04.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:04.946 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:04.947 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:04.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T04:00:04.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T04:00:04.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T04:00:04.948 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:05.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.016 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-05-24T04:00:05.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.066 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2023-05-24T04:00:05.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.111 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:05.112 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:05.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-24T04:00:05.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-24T04:00:05.113 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:05.181 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-24T04:00:05.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.182 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:05.183 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:05.184 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-24T04:00:05.184 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T04:00:05.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-24T04:00:05.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-24T04:00:05.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-24T04:00:05.186 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:05.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.285 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:05.286 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:05.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2023-05-24T04:00:05.287 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T04:00:05.287 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:05.307 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-24T04:00:05.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:05.308 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-24T04:00:05.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:05.355 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:05.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2023-05-24T04:00:05.458 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:05.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:05.517 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:05.519 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:05.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.520 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2023-05-24T04:00:05.567 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-24T04:00:05.567 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-24T04:00:05.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2023-05-24T04:00:05.628 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:05.629 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:05.683 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:05.683 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:05.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:05.685 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2023-05-24T04:00:05.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:2023-05-24T04:00:05.700+0000 7ffab5046580 -1 init, newargv = 0x56007627b6e0 newargc=15 2023-05-24T04:00:05.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:ceph-fuse[32357]: starting ceph client 2023-05-24T04:00:05.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:ceph-fuse[32357]: starting fuse 2023-05-24T04:00:06.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2023-05-24T04:00:06.828 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:06.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:07.054 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:07.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:07.055 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2023-05-24T04:00:07.103 INFO:teuthology.orchestra.run.smithi121.stdout:45 2023-05-24T04:00:07.103 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-05-24T04:00:07.104 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2023-05-24T04:00:07.105 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2023-05-24T04:00:07.105 DEBUG:teuthology.orchestra.run.smithi121:> import re 2023-05-24T04:00:07.105 DEBUG:teuthology.orchestra.run.smithi121:> import os 2023-05-24T04:00:07.105 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2023-05-24T04:00:07.106 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:07.106 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2023-05-24T04:00:07.106 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-24T04:00:07.107 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2023-05-24T04:00:07.107 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-24T04:00:07.107 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:07.107 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2023-05-24T04:00:07.108 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2023-05-24T04:00:07.108 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2023-05-24T04:00:07.109 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2023-05-24T04:00:07.109 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:07.109 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2023-05-24T04:00:07.110 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-24T04:00:07.110 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-24T04:00:07.110 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-24T04:00:07.111 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2023-05-24T04:00:07.111 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2023-05-24T04:00:07.111 DEBUG:teuthology.orchestra.run.smithi121:> return f 2023-05-24T04:00:07.111 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-24T04:00:07.112 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:07.112 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.admin")) 2023-05-24T04:00:07.112 DEBUG:teuthology.orchestra.run.smithi121:> ' 2023-05-24T04:00:07.228 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.admin.32357.asok 2023-05-24T04:00:07.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-05-24T04:00:07 stdin-killer ERROR: exiting normally with 0 2023-05-24T04:00:07.241 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32357.asok 2023-05-24T04:00:07.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:07.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32357.asok status 2023-05-24T04:00:07.396 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-05-24T04:00:07.396 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2023-05-24T04:00:07.396 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "fa0e62c4a1d8e4a737d9cbe50224f70009b79b28", 2023-05-24T04:00:07.396 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 18.0.0-4167-gfa0e62c4 (fa0e62c4a1d8e4a737d9cbe50224f70009b79b28) reef (dev)", 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "admin", 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "32357", 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:07.397 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2023-05-24T04:00:07.398 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2023-05-24T04:00:07.398 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4387, 2023-05-24T04:00:07.398 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2023-05-24T04:00:07.398 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2023-05-24T04:00:07.398 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2023-05-24T04:00:07.398 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4387 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:0", 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41446068 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:0", 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41446068 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4387 172.21.15.121:0/41446068", 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "172.21.15.121:0/41446068", 2023-05-24T04:00:07.400 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2023-05-24T04:00:07.401 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 6, 2023-05-24T04:00:07.401 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 27, 2023-05-24T04:00:07.401 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2023-05-24T04:00:07.401 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2023-05-24T04:00:07.402 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2023-05-24T04:00:07.404 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-05-24T04:00:07.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:07.410 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2023-05-24T04:00:07.410 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:07.417 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2023-05-24T04:00:07.417 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:07.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:07.418 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:07.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:07.472 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-24T04:00:07.627 INFO:teuthology.orchestra.run.smithi121.stdout:# file: . 2023-05-24T04:00:07.628 INFO:teuthology.orchestra.run.smithi121.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-24T04:00:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-05-24T04:00:07.628 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T04:00:07.628 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:07.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:07.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.762+0000 7f598bff9640 1 Processor -- start 2023-05-24T04:00:07.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.762+0000 7f598bff9640 1 -- start start 2023-05-24T04:00:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f598bff9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 0x7f598406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f598bff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598406ea20 con 0x7f598414fa70 2023-05-24T04:00:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f598bff9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598406ec70 con 0x7f598406c000 2023-05-24T04:00:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f598bff9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5984070460 con 0x7f5984070b20 2023-05-24T04:00:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989d95640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f598414fa70 0x7f598406fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44846/0 (socket says 172.21.15.40:44846) 2023-05-24T04:00:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989d95640 1 -- 172.21.15.40:0/3671608441 learned_addr learned my addr 172.21.15.40:0/3671608441 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:07.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 0x7f598406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541323911 0 0) 0x7f598406ea20 con 0x7f598414fa70 2023-05-24T04:00:07.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5970003530 con 0x7f598414fa70 2023-05-24T04:00:07.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011397908 0 0) 0x7f5970003530 con 0x7f598414fa70 2023-05-24T04:00:07.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 msgr2=0x7f598406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:07.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 0x7f598406bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 >> v1:172.21.15.67:6789/0 conn(0x7f598406c000 legacy=0x7f5984145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984150230 con 0x7f598414fa70 2023-05-24T04:00:07.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f5980001a00 con 0x7f598414fa70 2023-05-24T04:00:07.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 >> v1:172.21.15.40:6789/0 conn(0x7f598414fa70 legacy=0x7f598406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700039b0 0x7f5970003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59700047d0 0x7f5970004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 0x7f5970005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984070460 con 0x7f59700047d0 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597000ba40 con 0x7f59700039b0 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597000bbd0 con 0x7f5984070b20 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59700047d0 0x7f5970004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989d95640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700039b0 0x7f5970003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f598a596640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 0x7f5970005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 -- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 msgr2=0x7f5970005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5984070b20 0x7f5970005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 -- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700039b0 msgr2=0x7f5970003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700039b0 0x7f5970003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989594640 1 -- 172.21.15.40:0/3671608441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970003530 con 0x7f59700047d0 2023-05-24T04:00:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.766+0000 7f5989d95640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700039b0 0x7f5970003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:07.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f5989594640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59700047d0 0x7f5970004c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5974009ae0 tx=0x7f597401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b500a5fb27223268 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:07.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a5640 con 0x7f59700047d0 2023-05-24T04:00:07.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5980002100 con 0x7f59700047d0 2023-05-24T04:00:07.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f5988d93640 1 -- 172.21.15.40:0/3671608441 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a59e0 con 0x7f59700047d0 2023-05-24T04:00:07.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- 172.21.15.40:0/3671608441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59700047d0 msgr2=0x7f5970004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 --2- 172.21.15.40:0/3671608441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59700047d0 0x7f5970004c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5974009ae0 tx=0x7f597401ca50 comp rx=0 tx=0).stop 2023-05-24T04:00:07.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598a596640 1 -- 172.21.15.40:0/3671608441 reap_dead start 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- 172.21.15.40:0/3671608441 shutdown_connections 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- 172.21.15.40:0/3671608441 >> 172.21.15.40:0/3671608441 conn(0x7f59840c0280 msgr2=0x7f59840c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- 172.21.15.40:0/3671608441 shutdown_connections 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- 172.21.15.40:0/3671608441 wait complete. 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 Processor -- start 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- start start 2023-05-24T04:00:07.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700047d0 0x7f5984147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 0x7f59841e4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f598414c3c0 0x7f5984145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59841428d0 con 0x7f59840bc800 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59841e49b0 con 0x7f59700047d0 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.770+0000 7f598bff9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598414bee0 con 0x7f598414c3c0 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 0x7f59841e4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 0x7f59841e4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57048/0 (socket says 172.21.15.40:57048) 2023-05-24T04:00:07.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 -- 172.21.15.40:0/3750733509 learned_addr learned my addr 172.21.15.40:0/3750733509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f598a596640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f598414c3c0 0x7f5984145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989d95640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700047d0 0x7f5984147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 -- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f598414c3c0 msgr2=0x7f5984145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f598414c3c0 0x7f5984145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 -- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700047d0 msgr2=0x7f5984147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700047d0 0x7f5984147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 -- 172.21.15.40:0/3750733509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598414d330 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989594640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 0x7f59841e4470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5974009ae0 tx=0x7f5970005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974004220 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974004380 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840c10d0 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974003820 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598414fe40 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598414c020 con 0x7f59840bc800 2023-05-24T04:00:07.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59740b4040 con 0x7f59840bc800 2023-05-24T04:00:07.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f597a7fc640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f59680662b0 0x7f5968068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:07.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989d95640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f59680662b0 0x7f5968068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:07.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f597411e2e0 con 0x7f59840bc800 2023-05-24T04:00:07.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.774+0000 7f5989d95640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f59680662b0 0x7f5968068760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5980004c00 tx=0x7f5980001860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:07.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.778+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59740eb6d0 con 0x7f59840bc800 2023-05-24T04:00:07.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.934+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f598404ddd0 con 0x7f59840bc800 2023-05-24T04:00:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.938+0000 7f597a7fc640 1 -- 172.21.15.40:0/3750733509 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f59740eecf0 con 0x7f59840bc800 2023-05-24T04:00:07.944 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:07.944 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:07.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f59680662b0 msgr2=0x7f5968068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f59680662b0 0x7f5968068760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5980004c00 tx=0x7f5980001860 comp rx=0 tx=0).stop 2023-05-24T04:00:07.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 msgr2=0x7f59841e4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:07.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 0x7f59841e4470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5974009ae0 tx=0x7f5970005800 comp rx=0 tx=0).stop 2023-05-24T04:00:07.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 shutdown_connections 2023-05-24T04:00:07.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f59680662b0 0x7f5968068760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f598414c3c0 0x7f5984145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59840bc800 0x7f59841e4470 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 --2- 172.21.15.40:0/3750733509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59700047d0 0x7f5984147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 >> 172.21.15.40:0/3750733509 conn(0x7f59840c0280 msgr2=0x7f5984144070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 shutdown_connections 2023-05-24T04:00:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:07.942+0000 7f598bff9640 1 -- 172.21.15.40:0/3750733509 wait complete. 2023-05-24T04:00:07.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:07.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:08.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5b00bba640 1 Processor -- start 2023-05-24T04:00:08.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5b00bba640 1 -- start start 2023-05-24T04:00:08.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5b00bba640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5afc14bc80 0x7f5afc0a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5b00bba640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc070ab0 con 0x7f5afc071670 2023-05-24T04:00:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5b00bba640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc071a90 con 0x7f5afc071220 2023-05-24T04:00:08.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5b00bba640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc0a5040 con 0x7f5afc14bc80 2023-05-24T04:00:08.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5afc071670 0x7f5afc0bd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44854/0 (socket says 172.21.15.40:44854) 2023-05-24T04:00:08.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 -- 172.21.15.40:0/207440339 learned_addr learned my addr 172.21.15.40:0/207440339 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:08.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afa59c640 1 --2- 172.21.15.40:0/207440339 >> v2:172.21.15.67:3300/0 conn(0x7f5afc14bc80 0x7f5afc0a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127028331 0 0) 0x7f5afc070ab0 con 0x7f5afc071670 2023-05-24T04:00:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae8003530 con 0x7f5afc071670 2023-05-24T04:00:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418739113 0 0) 0x7f5ae8003530 con 0x7f5afc071670 2023-05-24T04:00:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 >> v2:172.21.15.67:3300/0 conn(0x7f5afc14bc80 msgr2=0x7f5afc0a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 --2- 172.21.15.40:0/207440339 >> v2:172.21.15.67:3300/0 conn(0x7f5afc14bc80 0x7f5afc0a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 >> v1:172.21.15.67:6789/0 conn(0x7f5afc071220 legacy=0x7f5afc0bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc14d0f0 con 0x7f5afc071670 2023-05-24T04:00:08.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f5af4001680 con 0x7f5afc071670 2023-05-24T04:00:08.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 >> v1:172.21.15.40:6789/0 conn(0x7f5afc071670 legacy=0x7f5afc0bd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ae8003980 0x7f5ae8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80047d0 0x7f5ae8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae80052a0 0x7f5ae800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0a5040 con 0x7f5ae80052a0 2023-05-24T04:00:08.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800c1d0 con 0x7f5ae8003980 2023-05-24T04:00:08.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800c390 con 0x7f5ae80047d0 2023-05-24T04:00:08.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae80052a0 0x7f5ae800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afa59c640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ae8003980 0x7f5ae8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5af9d9b640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80047d0 0x7f5ae8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 -- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80047d0 msgr2=0x7f5ae8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80047d0 0x7f5ae8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 -- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ae8003980 msgr2=0x7f5ae8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ae8003980 0x7f5ae8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.090+0000 7f5afad9d640 1 -- 172.21.15.40:0/207440339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8003530 con 0x7f5ae80052a0 2023-05-24T04:00:08.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5afad9d640 1 -- 172.21.15.40:0/207440339 reap_dead start 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5afad9d640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae80052a0 0x7f5ae800b990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c240 tx=0x7f5af401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45c74975266b506 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af40a5b20 con 0x7f5ae80052a0 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af40a5cc0 con 0x7f5ae80052a0 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5af959a640 1 -- 172.21.15.40:0/207440339 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4005b20 con 0x7f5ae80052a0 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 -- 172.21.15.40:0/207440339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae80052a0 msgr2=0x7f5ae800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae80052a0 0x7f5ae800b990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c240 tx=0x7f5af401cc40 comp rx=0 tx=0).stop 2023-05-24T04:00:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 -- 172.21.15.40:0/207440339 shutdown_connections 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 --2- 172.21.15.40:0/207440339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae80052a0 0x7f5ae800b990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 -- 172.21.15.40:0/207440339 >> 172.21.15.40:0/207440339 conn(0x7f5afc0c0310 msgr2=0x7f5afc0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 -- 172.21.15.40:0/207440339 shutdown_connections 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 -- 172.21.15.40:0/207440339 wait complete. 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 Processor -- start 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 -- start start 2023-05-24T04:00:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.094+0000 7f5b00bba640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80052a0 0x7f5afc13e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 0x7f5afc13f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc13fa10 0x7f5afc140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1eab10 con 0x7f5afc13eca0 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc149180 con 0x7f5afc13fa10 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc148e50 con 0x7f5ae80052a0 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 0x7f5afc13f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 0x7f5afc13f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57062/0 (socket says 172.21.15.40:57062) 2023-05-24T04:00:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 -- 172.21.15.40:0/3549167675 learned_addr learned my addr 172.21.15.40:0/3549167675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5afad9d640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc13fa10 0x7f5afc140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5afa59c640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80052a0 0x7f5afc13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 -- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80052a0 msgr2=0x7f5afc13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80052a0 0x7f5afc13e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 -- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc13fa10 msgr2=0x7f5afc140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc13fa10 0x7f5afc140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 -- 172.21.15.40:0/3549167675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc14c050 con 0x7f5afc13eca0 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af9d9b640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 0x7f5afc13f4d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00f960 tx=0x7f5aec00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec001950 con 0x7f5afc13eca0 2023-05-24T04:00:08.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec006d70 con 0x7f5afc13eca0 2023-05-24T04:00:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc06b1d0 con 0x7f5afc13eca0 2023-05-24T04:00:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec003bc0 con 0x7f5afc13eca0 2023-05-24T04:00:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc14cd50 con 0x7f5afc13eca0 2023-05-24T04:00:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc06ccf0 con 0x7f5afc13eca0 2023-05-24T04:00:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5aec003d20 con 0x7f5afc13eca0 2023-05-24T04:00:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af2ffd640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5adc0662b0 0x7f5adc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5aec0838e0 con 0x7f5afc13eca0 2023-05-24T04:00:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5afa59c640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5adc0662b0 0x7f5adc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.098+0000 7f5afa59c640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5adc0662b0 0x7f5adc068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009aa0 tx=0x7f5ae4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.102+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5aec050b00 con 0x7f5afc13eca0 2023-05-24T04:00:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.258+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5afc0bcb90 con 0x7f5afc13eca0 2023-05-24T04:00:08.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.258+0000 7f5af2ffd640 1 -- 172.21.15.40:0/3549167675 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aec054120 con 0x7f5afc13eca0 2023-05-24T04:00:08.264 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5adc0662b0 msgr2=0x7f5adc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5adc0662b0 0x7f5adc068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009aa0 tx=0x7f5ae4008040 comp rx=0 tx=0).stop 2023-05-24T04:00:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 msgr2=0x7f5afc13f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 0x7f5afc13f4d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00f960 tx=0x7f5aec00fe20 comp rx=0 tx=0).stop 2023-05-24T04:00:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 shutdown_connections 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5adc0662b0 0x7f5adc068760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc13fa10 0x7f5afc140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc13eca0 0x7f5afc13f4d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 --2- 172.21.15.40:0/3549167675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ae80052a0 0x7f5afc13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 >> 172.21.15.40:0/3549167675 conn(0x7f5afc0c0310 msgr2=0x7f5afc0bf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 shutdown_connections 2023-05-24T04:00:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.262+0000 7f5b00bba640 1 -- 172.21.15.40:0/3549167675 wait complete. 2023-05-24T04:00:08.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:08.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468fdaf640 1 Processor -- start 2023-05-24T04:00:08.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468fdaf640 1 -- start start 2023-05-24T04:00:08.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468fdaf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 0x7f46881593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468fdaf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880a3a90 con 0x7f46880bedc0 2023-05-24T04:00:08.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468fdaf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880aa610 con 0x7f46880c4080 2023-05-24T04:00:08.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468fdaf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a37f0 con 0x7f46880bf190 2023-05-24T04:00:08.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468db4b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46880bedc0 0x7f46880c08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44856/0 (socket says 172.21.15.40:44856) 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468db4b640 1 -- 172.21.15.40:0/3617247067 learned_addr learned my addr 172.21.15.40:0/3617247067 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468e34c640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 0x7f46881593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156801795 0 0) 0x7f46880a3a90 con 0x7f46880bedc0 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4670003530 con 0x7f46880bedc0 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702340404 0 0) 0x7f46880aa610 con 0x7f46880c4080 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46880a3a90 con 0x7f46880c4080 2023-05-24T04:00:08.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1727889588 0 0) 0x7f4670003530 con 0x7f46880bedc0 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 msgr2=0x7f46881593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 0x7f46881593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 >> v1:172.21.15.67:6789/0 conn(0x7f46880c4080 legacy=0x7f46880c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880c44e0 con 0x7f46880bedc0 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f4678001680 con 0x7f46880bedc0 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 >> v1:172.21.15.40:6789/0 conn(0x7f46880bedc0 legacy=0x7f46880c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 0x7f4670003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46700040f0 0x7f46700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4670004d10 0x7f4670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a37f0 con 0x7f46700040f0 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467000baa0 con 0x7f4670004d10 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467000bc60 con 0x7f46880bf190 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468d34a640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46700040f0 0x7f46700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468e34c640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4670004d10 0x7f4670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468db4b640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 0x7f4670003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468d34a640 1 -- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 msgr2=0x7f4670003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468d34a640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bf190 0x7f4670003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468d34a640 1 -- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4670004d10 msgr2=0x7f4670005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468d34a640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4670004d10 0x7f4670005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.446+0000 7f468d34a640 1 -- 172.21.15.40:0/3617247067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670003530 con 0x7f46700040f0 2023-05-24T04:00:08.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468d34a640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46700040f0 0x7f46700047d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f467c001fd0 tx=0x7f467c01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16ac2e3ca9a799e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0a8c70 con 0x7f46700040f0 2023-05-24T04:00:08.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c0a8df0 con 0x7f46700040f0 2023-05-24T04:00:08.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468cb49640 1 -- 172.21.15.40:0/3617247067 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c003bc0 con 0x7f46700040f0 2023-05-24T04:00:08.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 -- 172.21.15.40:0/3617247067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46700040f0 msgr2=0x7f46700047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 --2- 172.21.15.40:0/3617247067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46700040f0 0x7f46700047d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f467c001fd0 tx=0x7f467c01f050 comp rx=0 tx=0).stop 2023-05-24T04:00:08.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468e34c640 1 -- 172.21.15.40:0/3617247067 reap_dead start 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 -- 172.21.15.40:0/3617247067 shutdown_connections 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 -- 172.21.15.40:0/3617247067 >> 172.21.15.40:0/3617247067 conn(0x7f46880a6340 msgr2=0x7f46880a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 -- 172.21.15.40:0/3617247067 shutdown_connections 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 -- 172.21.15.40:0/3617247067 wait complete. 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 Processor -- start 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.450+0000 7f468fdaf640 1 -- start start 2023-05-24T04:00:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46700040f0 0x7f468809a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bdb40 0x7f46881e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 0x7f46881d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881e41c0 con 0x7f46881d4260 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880be1a0 con 0x7f46700040f0 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880be480 con 0x7f46880bdb40 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 0x7f46881d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 0x7f46881d46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57080/0 (socket says 172.21.15.40:57080) 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 -- 172.21.15.40:0/446494920 learned_addr learned my addr 172.21.15.40:0/446494920 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468db4b640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46700040f0 0x7f468809a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468d34a640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bdb40 0x7f46881e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 -- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bdb40 msgr2=0x7f46881e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bdb40 0x7f46881e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 -- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46700040f0 msgr2=0x7f468809a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46700040f0 0x7f468809a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 -- 172.21.15.40:0/446494920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880bb690 con 0x7f46881d4260 2023-05-24T04:00:08.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468e34c640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 0x7f46881d46d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f468808a4e0 tx=0x7f4680011550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680004500 con 0x7f46881d4260 2023-05-24T04:00:08.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46800118a0 con 0x7f46881d4260 2023-05-24T04:00:08.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46880bb500 con 0x7f46881d4260 2023-05-24T04:00:08.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680011c90 con 0x7f46881d4260 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46880c35e0 con 0x7f46881d4260 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46880be000 con 0x7f46881d4260 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4680003620 con 0x7f46881d4260 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f46867fc640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4674066280 0x7f4674068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4680083e30 con 0x7f46881d4260 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468db4b640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4674066280 0x7f4674068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.454+0000 7f468db4b640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4674066280 0x7f4674068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4678001060 tx=0x7f4678009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.458+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f46800511e0 con 0x7f46881d4260 2023-05-24T04:00:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.614+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46880be000 con 0x7f46881d4260 2023-05-24T04:00:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.614+0000 7f46867fc640 1 -- 172.21.15.40:0/446494920 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46880be000 con 0x7f46881d4260 2023-05-24T04:00:08.625 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4674066280 msgr2=0x7f4674068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4674066280 0x7f4674068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4678001060 tx=0x7f4678009040 comp rx=0 tx=0).stop 2023-05-24T04:00:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 msgr2=0x7f46881d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 0x7f46881d46d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f468808a4e0 tx=0x7f4680011550 comp rx=0 tx=0).stop 2023-05-24T04:00:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 shutdown_connections 2023-05-24T04:00:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4674066280 0x7f4674068730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46881d4260 0x7f46881d46d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46880bdb40 0x7f46881e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 --2- 172.21.15.40:0/446494920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46700040f0 0x7f468809a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 >> 172.21.15.40:0/446494920 conn(0x7f46880a6340 msgr2=0x7f46880c1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:08.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 shutdown_connections 2023-05-24T04:00:08.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.618+0000 7f468fdaf640 1 -- 172.21.15.40:0/446494920 wait complete. 2023-05-24T04:00:08.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:08.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f710e640 1 Processor -- start 2023-05-24T04:00:08.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f710e640 1 -- start start 2023-05-24T04:00:08.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f710e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39f00a4d10 0x7f39f00bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f710e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f0148760 con 0x7f39f0148390 2023-05-24T04:00:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f710e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f006eac0 con 0x7f39f00bdb60 2023-05-24T04:00:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f710e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00702d0 con 0x7f39f00a4d10 2023-05-24T04:00:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f39f0148390 0x7f39f0071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44864/0 (socket says 172.21.15.40:44864) 2023-05-24T04:00:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 -- 172.21.15.40:0/3573147616 learned_addr learned my addr 172.21.15.40:0/3573147616 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387127601 0 0) 0x7f39f0148760 con 0x7f39f0148390 2023-05-24T04:00:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d8003450 con 0x7f39f0148390 2023-05-24T04:00:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39effff640 1 --2- 172.21.15.40:0/3573147616 >> v2:172.21.15.67:3300/0 conn(0x7f39f00a4d10 0x7f39f00bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055104581 0 0) 0x7f39d8003450 con 0x7f39f0148390 2023-05-24T04:00:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 >> v2:172.21.15.67:3300/0 conn(0x7f39f00a4d10 msgr2=0x7f39f00bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 --2- 172.21.15.40:0/3573147616 >> v2:172.21.15.67:3300/0 conn(0x7f39f00a4d10 0x7f39f00bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 >> v1:172.21.15.67:6789/0 conn(0x7f39f00bdb60 legacy=0x7f39f0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00a5150 con 0x7f39f0148390 2023-05-24T04:00:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f39e0001680 con 0x7f39f0148390 2023-05-24T04:00:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 >> v1:172.21.15.40:6789/0 conn(0x7f39f0148390 legacy=0x7f39f0071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39d8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d80088b0 0x7f39d800ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d800b510 0x7f39d800d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00702d0 con 0x7f39d8003a70 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d800e2a0 con 0x7f39d80088b0 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d800e460 con 0x7f39d800b510 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39d8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39effff640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d80088b0 0x7f39d800ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 -- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d800b510 msgr2=0x7f39d800d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f56ab640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d800b510 0x7f39d800d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d800b510 0x7f39d800d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 -- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d80088b0 msgr2=0x7f39d800ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d80088b0 0x7f39d800ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f4eaa640 1 -- 172.21.15.40:0/3573147616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8003450 con 0x7f39d8003a70 2023-05-24T04:00:08.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39f56ab640 1 -- 172.21.15.40:0/3573147616 reap_dead start 2023-05-24T04:00:08.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.766+0000 7f39effff640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d80088b0 0x7f39d800ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:08.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39d8003e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c1c0 tx=0x7f39e001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815ec613e4c38c61 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a5af0 con 0x7f39d8003a70 2023-05-24T04:00:08.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e00a5c50 con 0x7f39d8003a70 2023-05-24T04:00:08.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39ef7fe640 1 -- 172.21.15.40:0/3573147616 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00058e0 con 0x7f39d8003a70 2023-05-24T04:00:08.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- 172.21.15.40:0/3573147616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 msgr2=0x7f39d8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39d8003e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c1c0 tx=0x7f39e001cc10 comp rx=0 tx=0).stop 2023-05-24T04:00:08.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- 172.21.15.40:0/3573147616 shutdown_connections 2023-05-24T04:00:08.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 --2- 172.21.15.40:0/3573147616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39d8003e60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- 172.21.15.40:0/3573147616 >> 172.21.15.40:0/3573147616 conn(0x7f39f00c0310 msgr2=0x7f39f00c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:08.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- 172.21.15.40:0/3573147616 shutdown_connections 2023-05-24T04:00:08.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- 172.21.15.40:0/3573147616 wait complete. 2023-05-24T04:00:08.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 Processor -- start 2023-05-24T04:00:08.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- start start 2023-05-24T04:00:08.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39f01e6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39f00bfe10 0x7f39f01d8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39f013eac0 0x7f39f01e2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f013b080 con 0x7f39d8003a70 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01e6890 con 0x7f39f013eac0 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f710e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0140c90 con 0x7f39f00bfe10 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f4eaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39f01e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f4eaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39f01e6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57088/0 (socket says 172.21.15.40:57088) 2023-05-24T04:00:08.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f4eaa640 1 -- 172.21.15.40:0/2944799016 learned_addr learned my addr 172.21.15.40:0/2944799016 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:08.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.770+0000 7f39f56ab640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39f013eac0 0x7f39f01e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39effff640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39f00bfe10 0x7f39f01d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f4eaa640 1 -- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39f00bfe10 msgr2=0x7f39f01d8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39f00bfe10 0x7f39f01d8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f4eaa640 1 -- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39f013eac0 msgr2=0x7f39f01e2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39f013eac0 0x7f39f01e2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f4eaa640 1 -- 172.21.15.40:0/2944799016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00c1100 con 0x7f39d8003a70 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39effff640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39f00bfe10 0x7f39f01d8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f4eaa640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39f01e6350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c1c0 tx=0x7f39d8003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00b3070 con 0x7f39d8003a70 2023-05-24T04:00:08.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0004e50 con 0x7f39d8003a70 2023-05-24T04:00:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f006ed10 con 0x7f39d8003a70 2023-05-24T04:00:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a5af0 con 0x7f39d8003a70 2023-05-24T04:00:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f00bc8e0 con 0x7f39d8003a70 2023-05-24T04:00:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f013ab50 con 0x7f39d8003a70 2023-05-24T04:00:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39e0001440 con 0x7f39d8003a70 2023-05-24T04:00:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39ed7fa640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f39dc0662b0 0x7f39dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:08.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39e011dd50 con 0x7f39d8003a70 2023-05-24T04:00:08.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39effff640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f39dc0662b0 0x7f39dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:08.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.774+0000 7f39effff640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f39dc0662b0 0x7f39dc068760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39f006ec50 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:08.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.778+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f39e0121030 con 0x7f39d8003a70 2023-05-24T04:00:08.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.930+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39f004ddd0 con 0x7f39d8003a70 2023-05-24T04:00:08.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.930+0000 7f39ed7fa640 1 -- 172.21.15.40:0/2944799016 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39e00eaf70 con 0x7f39d8003a70 2023-05-24T04:00:08.937 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:08.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f39dc0662b0 msgr2=0x7f39dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f39dc0662b0 0x7f39dc068760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39f006ec50 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2023-05-24T04:00:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 msgr2=0x7f39f01e6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39f01e6350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c1c0 tx=0x7f39d8003700 comp rx=0 tx=0).stop 2023-05-24T04:00:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 shutdown_connections 2023-05-24T04:00:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f39dc0662b0 0x7f39dc068760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39f013eac0 0x7f39f01e2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39f00bfe10 0x7f39f01d8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 --2- 172.21.15.40:0/2944799016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d8003a70 0x7f39f01e6350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 >> 172.21.15.40:0/2944799016 conn(0x7f39f00c0310 msgr2=0x7f39f0148ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 shutdown_connections 2023-05-24T04:00:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:08.934+0000 7f39f710e640 1 -- 172.21.15.40:0/2944799016 wait complete. 2023-05-24T04:00:08.954 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:00:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 Processor -- start 2023-05-24T04:00:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 -- start start 2023-05-24T04:00:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff21c069c40 0x7ff21c152560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff21c06d5d0 0x7ff21c0ba730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c0bac70 0x7ff21c0bb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c152aa0 con 0x7ff21c069c40 2023-05-24T04:00:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c0bc030 con 0x7ff21c06d5d0 2023-05-24T04:00:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff22394c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0bc990 con 0x7ff21c0bac70 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff21c069c40 0x7ff21c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff21c069c40 0x7ff21c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57094/0 (socket says 172.21.15.40:57094) 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 -- 172.21.15.40:0/4245131128 learned_addr learned my addr 172.21.15.40:0/4245131128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 -- 172.21.15.40:0/4245131128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c0bac70 msgr2=0x7ff21c0bb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff220ee7640 1 --2- 172.21.15.40:0/4245131128 >> v2:172.21.15.67:3300/0 conn(0x7ff21c06d5d0 0x7ff21c0ba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff221ee9640 1 --2- 172.21.15.40:0/4245131128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c0bac70 0x7ff21c0bb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 --2- 172.21.15.40:0/4245131128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c0bac70 0x7ff21c0bb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 -- 172.21.15.40:0/4245131128 >> v2:172.21.15.67:3300/0 conn(0x7ff21c06d5d0 msgr2=0x7ff21c0ba730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 --2- 172.21.15.40:0/4245131128 >> v2:172.21.15.67:3300/0 conn(0x7ff21c06d5d0 0x7ff21c0ba730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff2216e8640 1 -- 172.21.15.40:0/4245131128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0bc620 con 0x7ff21c069c40 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.082+0000 7ff220ee7640 1 --2- 172.21.15.40:0/4245131128 >> v2:172.21.15.67:3300/0 conn(0x7ff21c06d5d0 0x7ff21c0ba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff2216e8640 1 --2- 172.21.15.40:0/4245131128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c069c40 0x7ff21c152560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff21c06cc30 tx=0x7ff21801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958e15b970329912 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff213fff640 1 -- 172.21.15.40:0/4245131128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180ac630 con 0x7ff21c069c40 2023-05-24T04:00:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff213fff640 1 -- 172.21.15.40:0/4245131128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2180ac790 con 0x7ff21c069c40 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff213fff640 1 -- 172.21.15.40:0/4245131128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180acb20 con 0x7ff21c069c40 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/4245131128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c069c40 msgr2=0x7ff21c152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- 172.21.15.40:0/4245131128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c069c40 0x7ff21c152560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff21c06cc30 tx=0x7ff21801c500 comp rx=0 tx=0).stop 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/4245131128 shutdown_connections 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- 172.21.15.40:0/4245131128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c0bac70 0x7ff21c0bb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- 172.21.15.40:0/4245131128 >> v2:172.21.15.67:3300/0 conn(0x7ff21c06d5d0 0x7ff21c0ba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- 172.21.15.40:0/4245131128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c069c40 0x7ff21c152560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/4245131128 >> 172.21.15.40:0/4245131128 conn(0x7ff21c0c1420 msgr2=0x7ff21c0c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/4245131128 shutdown_connections 2023-05-24T04:00:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/4245131128 wait complete. 2023-05-24T04:00:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 Processor -- start 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- start start 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c069c40 0x7ff21c1435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff21c06d5d0 0x7ff21c1e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 0x7ff21c148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1e9850 con 0x7ff21c0bac70 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c14ac40 con 0x7ff21c06d5d0 2023-05-24T04:00:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0a7010 con 0x7ff21c069c40 2023-05-24T04:00:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 0x7ff21c148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 0x7ff21c148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57106/0 (socket says 172.21.15.40:57106) 2023-05-24T04:00:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 -- 172.21.15.40:0/3624441860 learned_addr learned my addr 172.21.15.40:0/3624441860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff2216e8640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c069c40 0x7ff21c1435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff220ee7640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff21c06d5d0 0x7ff21c1e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 -- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c069c40 msgr2=0x7ff21c1435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c069c40 0x7ff21c1435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 -- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff21c06d5d0 msgr2=0x7ff21c1e9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff21c06d5d0 0x7ff21c1e9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 -- 172.21.15.40:0/3624441860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180094d0 con 0x7ff21c0bac70 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff2216e8640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c069c40 0x7ff21c1435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff220ee7640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff21c06d5d0 0x7ff21c1e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff221ee9640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 0x7ff21c148b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff21400cc30 tx=0x7ff21400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400ce40 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2140039a0 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214003d30 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c0bba70 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.086+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c06e130 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.090+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c0bbc00 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.090+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff214003e90 con 0x7ff21c0bac70 2023-05-24T04:00:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.090+0000 7ff211ffb640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff200066280 0x7ff200068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.090+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff214084350 con 0x7ff21c0bac70 2023-05-24T04:00:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.090+0000 7ff2216e8640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff200066280 0x7ff200068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.090+0000 7ff2216e8640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff200066280 0x7ff200068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2180ae000 tx=0x7ff218008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.094+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff214051570 con 0x7ff21c0bac70 2023-05-24T04:00:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff21c14adb0 con 0x7ff21c0bac70 2023-05-24T04:00:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff211ffb640 1 -- 172.21.15.40:0/3624441860 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff214054b90 con 0x7ff21c0bac70 2023-05-24T04:00:09.252 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:00:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff200066280 msgr2=0x7ff200068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff200066280 0x7ff200068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2180ae000 tx=0x7ff218008040 comp rx=0 tx=0).stop 2023-05-24T04:00:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 msgr2=0x7ff21c148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 0x7ff21c148b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff21400cc30 tx=0x7ff21400a5c0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 shutdown_connections 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff200066280 0x7ff200068730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c0bac70 0x7ff21c148b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff21c06d5d0 0x7ff21c1e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 --2- 172.21.15.40:0/3624441860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff21c069c40 0x7ff21c1435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 >> 172.21.15.40:0/3624441860 conn(0x7ff21c0c1420 msgr2=0x7ff21c0c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 shutdown_connections 2023-05-24T04:00:09.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.242+0000 7ff22394c640 1 -- 172.21.15.40:0/3624441860 wait complete. 2023-05-24T04:00:09.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:00:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.370+0000 7fe709e39640 1 Processor -- start 2023-05-24T04:00:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.370+0000 7fe709e39640 1 -- start start 2023-05-24T04:00:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe709e39640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe70414bc80 0x7fe7040a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe709e39640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe704070ab0 con 0x7fe704071670 2023-05-24T04:00:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe709e39640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe704071a90 con 0x7fe704071220 2023-05-24T04:00:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe709e39640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040a5040 con 0x7fe70414bc80 2023-05-24T04:00:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe703fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe704071670 0x7fe7040bd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44866/0 (socket says 172.21.15.40:44866) 2023-05-24T04:00:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe703fff640 1 -- 172.21.15.40:0/2947340968 learned_addr learned my addr 172.21.15.40:0/2947340968 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 --2- 172.21.15.40:0/2947340968 >> v2:172.21.15.67:3300/0 conn(0x7fe70414bc80 0x7fe7040a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860237034 0 0) 0x7fe704070ab0 con 0x7fe704071670 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6ec003530 con 0x7fe704071670 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509781357 0 0) 0x7fe6ec003530 con 0x7fe704071670 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 >> v2:172.21.15.67:3300/0 conn(0x7fe70414bc80 msgr2=0x7fe7040a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 --2- 172.21.15.40:0/2947340968 >> v2:172.21.15.67:3300/0 conn(0x7fe70414bc80 0x7fe7040a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 >> v1:172.21.15.67:6789/0 conn(0x7fe704071220 legacy=0x7fe7040bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70414d0f0 con 0x7fe704071670 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fe6fc001a00 con 0x7fe704071670 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 >> v1:172.21.15.40:6789/0 conn(0x7fe704071670 legacy=0x7fe7040bd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6ec003980 0x7fe6ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec0047d0 0x7fe6ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec0052a0 0x7fe6ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040a5040 con 0x7fe6ec003980 2023-05-24T04:00:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec00c1d0 con 0x7fe6ec0052a0 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec00c390 con 0x7fe6ec0047d0 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6ec003980 0x7fe6ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe702ffd640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec0047d0 0x7fe6ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 -- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec0047d0 msgr2=0x7fe6ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec0047d0 0x7fe6ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 -- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec0052a0 msgr2=0x7fe6ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec0052a0 0x7fe6ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe7037fe640 1 -- 172.21.15.40:0/2947340968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec003530 con 0x7fe6ec003980 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe703fff640 1 -- 172.21.15.40:0/2947340968 reap_dead start 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.374+0000 7fe702ffd640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec0047d0 0x7fe6ec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe7037fe640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6ec003980 0x7fe6ec003d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009ae0 tx=0x7fe6f401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a4f4b414e88990 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40a5680 con 0x7fe6ec003980 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40a57e0 con 0x7fe6ec003980 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe7027fc640 1 -- 172.21.15.40:0/2947340968 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40a5b90 con 0x7fe6ec003980 2023-05-24T04:00:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- 172.21.15.40:0/2947340968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6ec003980 msgr2=0x7fe6ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6ec003980 0x7fe6ec003d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009ae0 tx=0x7fe6f401ca90 comp rx=0 tx=0).stop 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- 172.21.15.40:0/2947340968 shutdown_connections 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 --2- 172.21.15.40:0/2947340968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6ec003980 0x7fe6ec003d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- 172.21.15.40:0/2947340968 >> 172.21.15.40:0/2947340968 conn(0x7fe7040c0310 msgr2=0x7fe7040c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- 172.21.15.40:0/2947340968 shutdown_connections 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- 172.21.15.40:0/2947340968 wait complete. 2023-05-24T04:00:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 Processor -- start 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- start start 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec003980 0x7fe7041db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 0x7fe70406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe70406ee10 0x7fe7041dba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040bca50 con 0x7fe7041dac50 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040baa40 con 0x7fe70406ee10 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe709e39640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040ba550 con 0x7fe6ec003980 2023-05-24T04:00:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 0x7fe70406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 0x7fe70406e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57120/0 (socket says 172.21.15.40:57120) 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 -- 172.21.15.40:0/3124639950 learned_addr learned my addr 172.21.15.40:0/3124639950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe7037fe640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec003980 0x7fe7041db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe703fff640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe70406ee10 0x7fe7041dba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 -- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec003980 msgr2=0x7fe7041db1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec003980 0x7fe7041db1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 -- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe70406ee10 msgr2=0x7fe7041dba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe70406ee10 0x7fe7041dba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 -- 172.21.15.40:0/3124639950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70414cd50 con 0x7fe7041dac50 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe703fff640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe70406ee10 0x7fe7041dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.378+0000 7fe702ffd640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 0x7fe70406e8d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800d4d0 tx=0x7fe6f800d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800b070 con 0x7fe7041dac50 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8005330 con 0x7fe7041dac50 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70414c050 con 0x7fe7041dac50 2023-05-24T04:00:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8007270 con 0x7fe7041dac50 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7040a37b0 con 0x7fe7041dac50 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040bcb90 con 0x7fe7041dac50 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6f80073d0 con 0x7fe7041dac50 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe6ebfff640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe6f00662b0 0x7fe6f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe6f8083950 con 0x7fe7041dac50 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe7037fe640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe6f00662b0 0x7fe6f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.382+0000 7fe7037fe640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe6f00662b0 0x7fe6f0068760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40af000 tx=0x7fe6f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.386+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe6f8050ba0 con 0x7fe7041dac50 2023-05-24T04:00:09.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe70404ddd0 con 0x7fe7041dac50 2023-05-24T04:00:09.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe6ebfff640 1 -- 172.21.15.40:0/3124639950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe6f80541c0 con 0x7fe7041dac50 2023-05-24T04:00:09.538 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:09.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe6f00662b0 msgr2=0x7fe6f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe6f00662b0 0x7fe6f0068760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40af000 tx=0x7fe6f4008040 comp rx=0 tx=0).stop 2023-05-24T04:00:09.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 msgr2=0x7fe70406e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 0x7fe70406e8d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800d4d0 tx=0x7fe6f800d5c0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 shutdown_connections 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe6f00662b0 0x7fe6f0068760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe70406ee10 0x7fe7041dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7041dac50 0x7fe70406e8d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 --2- 172.21.15.40:0/3124639950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6ec003980 0x7fe7041db1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 >> 172.21.15.40:0/3124639950 conn(0x7fe7040c0310 msgr2=0x7fe7041495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 shutdown_connections 2023-05-24T04:00:09.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.534+0000 7fe709e39640 1 -- 172.21.15.40:0/3124639950 wait complete. 2023-05-24T04:00:09.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:00:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 Processor -- start 2023-05-24T04:00:09.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 -- start start 2023-05-24T04:00:09.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff000be680 0x7eff000bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff00146580 0x7eff000699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0014c2e0 con 0x7eff00071810 2023-05-24T04:00:09.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000bdc80 con 0x7eff000be680 2023-05-24T04:00:09.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7eff06060640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000bc070 con 0x7eff00146580 2023-05-24T04:00:09.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7eff00071810 0x7eff00069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44872/0 (socket says 172.21.15.40:44872) 2023-05-24T04:00:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefffff640 1 -- 172.21.15.40:0/4092439825 learned_addr learned my addr 172.21.15.40:0/4092439825 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efeff7fe640 1 --2- 172.21.15.40:0/4092439825 >> v2:172.21.15.67:3300/0 conn(0x7eff000be680 0x7eff000bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefeffd640 1 --2- 172.21.15.40:0/4092439825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff00146580 0x7eff000699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefe7fc640 1 -- 172.21.15.40:0/4092439825 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450263570 0 0) 0x7efef00014a0 con 0x7eff00071810 2023-05-24T04:00:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefe7fc640 1 -- 172.21.15.40:0/4092439825 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee8003530 con 0x7eff00071810 2023-05-24T04:00:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefe7fc640 1 -- 172.21.15.40:0/4092439825 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262092989 0 0) 0x7efee8003530 con 0x7eff00071810 2023-05-24T04:00:09.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefeffd640 1 -- 172.21.15.40:0/4092439825 >> v2:172.21.15.67:3300/0 conn(0x7eff000be680 msgr2=0x7eff000bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefeffd640 1 --2- 172.21.15.40:0/4092439825 >> v2:172.21.15.67:3300/0 conn(0x7eff000be680 0x7eff000bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefeffd640 1 -- 172.21.15.40:0/4092439825 >> v1:172.21.15.40:6789/0 conn(0x7eff00071810 legacy=0x7eff00069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.666+0000 7efefeffd640 1 -- 172.21.15.40:0/4092439825 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0014d540 con 0x7eff00146580 2023-05-24T04:00:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7efefeffd640 1 --2- 172.21.15.40:0/4092439825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff00146580 0x7eff000699e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efef40097c0 tx=0x7efef401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424833719b333de5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7efefe7fc640 1 -- 172.21.15.40:0/4092439825 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0001b90 con 0x7eff00146580 2023-05-24T04:00:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7efefe7fc640 1 -- 172.21.15.40:0/4092439825 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef40a7050 con 0x7eff00146580 2023-05-24T04:00:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7efefe7fc640 1 -- 172.21.15.40:0/4092439825 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40ab600 con 0x7eff00146580 2023-05-24T04:00:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 -- 172.21.15.40:0/4092439825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff00146580 msgr2=0x7eff000699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 --2- 172.21.15.40:0/4092439825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff00146580 0x7eff000699e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efef40097c0 tx=0x7efef401c2e0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 -- 172.21.15.40:0/4092439825 shutdown_connections 2023-05-24T04:00:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 --2- 172.21.15.40:0/4092439825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff00146580 0x7eff000699e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 --2- 172.21.15.40:0/4092439825 >> v2:172.21.15.67:3300/0 conn(0x7eff000be680 0x7eff000bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 -- 172.21.15.40:0/4092439825 >> 172.21.15.40:0/4092439825 conn(0x7eff0006aef0 msgr2=0x7eff0006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 -- 172.21.15.40:0/4092439825 shutdown_connections 2023-05-24T04:00:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 -- 172.21.15.40:0/4092439825 wait complete. 2023-05-24T04:00:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 Processor -- start 2023-05-24T04:00:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.670+0000 7eff06060640 1 -- start start 2023-05-24T04:00:09.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff00071810 0x7eff001373c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 0x7eff00140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff000b8080 0x7eff000b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00141910 con 0x7eff000be680 2023-05-24T04:00:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00137900 con 0x7eff00071810 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff00137b20 con 0x7eff000b8080 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 0x7eff00140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 0x7eff00140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57122/0 (socket says 172.21.15.40:57122) 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 -- 172.21.15.40:0/3243750664 learned_addr learned my addr 172.21.15.40:0/3243750664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efeff7fe640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff00071810 0x7eff001373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefffff640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff000b8080 0x7eff000b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 -- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff000b8080 msgr2=0x7eff000b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff000b8080 0x7eff000b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 -- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff00071810 msgr2=0x7eff001373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff00071810 0x7eff001373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 -- 172.21.15.40:0/3243750664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4009420 con 0x7eff000be680 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefffff640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff000b8080 0x7eff000b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efeff7fe640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff00071810 0x7eff001373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efefeffd640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 0x7eff00140480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efef4000c10 tx=0x7efef4019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4006e20 con 0x7eff000be680 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef40b4400 con 0x7eff000be680 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40b4770 con 0x7eff000be680 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff000bb9b0 con 0x7eff000be680 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff000bb820 con 0x7eff000be680 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff001594d0 con 0x7eff000be680 2023-05-24T04:00:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efef40b2040 con 0x7eff000be680 2023-05-24T04:00:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efee7fff640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efeec0662b0 0x7efeec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efef411db20 con 0x7eff000be680 2023-05-24T04:00:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efeff7fe640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efeec0662b0 0x7efeec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.674+0000 7efeff7fe640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efeec0662b0 0x7efeec068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff0014c2b0 tx=0x7efef8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.678+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efef40ead40 con 0x7eff000be680 2023-05-24T04:00:09.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff000674e0 con 0x7eff000be680 2023-05-24T04:00:09.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7efee7fff640 1 -- 172.21.15.40:0/3243750664 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7efef40ee360 con 0x7eff000be680 2023-05-24T04:00:09.847 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:00:09.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efeec0662b0 msgr2=0x7efeec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efeec0662b0 0x7efeec068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff0014c2b0 tx=0x7efef8008040 comp rx=0 tx=0).stop 2023-05-24T04:00:09.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 msgr2=0x7eff00140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 0x7eff00140480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efef4000c10 tx=0x7efef4019080 comp rx=0 tx=0).stop 2023-05-24T04:00:09.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 shutdown_connections 2023-05-24T04:00:09.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efeec0662b0 0x7efeec068760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff000b8080 0x7eff000b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff000be680 0x7eff00140480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 --2- 172.21.15.40:0/3243750664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff00071810 0x7eff001373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 >> 172.21.15.40:0/3243750664 conn(0x7eff0006aef0 msgr2=0x7eff001454e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 shutdown_connections 2023-05-24T04:00:09.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.842+0000 7eff06060640 1 -- 172.21.15.40:0/3243750664 wait complete. 2023-05-24T04:00:09.864 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T04:00:09.865 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:09.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:09.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 Processor -- start 2023-05-24T04:00:09.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 -- start start 2023-05-24T04:00:09.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f435814aa30 0x7f4358071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f435814bfe0 0x7f435806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435814b240 con 0x7f43580a3290 2023-05-24T04:00:09.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4358071d50 con 0x7f435814bfe0 2023-05-24T04:00:09.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435fc27640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435806e810 con 0x7f435814aa30 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f435814bfe0 0x7f435806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f435814bfe0 0x7f435806ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57138/0 (socket says 172.21.15.40:57138) 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 -- 172.21.15.40:0/2124697784 learned_addr learned my addr 172.21.15.40:0/2124697784 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435d9c3640 1 --2- 172.21.15.40:0/2124697784 >> v2:172.21.15.67:3300/0 conn(0x7f435814aa30 0x7f4358071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 -- 172.21.15.40:0/2124697784 >> v2:172.21.15.67:3300/0 conn(0x7f435814aa30 msgr2=0x7f4358071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 --2- 172.21.15.40:0/2124697784 >> v2:172.21.15.67:3300/0 conn(0x7f435814aa30 0x7f4358071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 -- 172.21.15.40:0/2124697784 >> v1:172.21.15.67:6789/0 conn(0x7f43580a3290 legacy=0x7f4358071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:09.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.986+0000 7f435e1c4640 1 -- 172.21.15.40:0/2124697784 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435806ea20 con 0x7f435814bfe0 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435e1c4640 1 --2- 172.21.15.40:0/2124697784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435806ef40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43580bdf10 tx=0x7f435001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb2dfe0c8483e8d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435c9c1640 1 -- 172.21.15.40:0/2124697784 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500a5750 con 0x7f435814bfe0 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435c9c1640 1 -- 172.21.15.40:0/2124697784 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500a58b0 con 0x7f435814bfe0 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435c9c1640 1 -- 172.21.15.40:0/2124697784 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500a5c40 con 0x7f435814bfe0 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- 172.21.15.40:0/2124697784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 msgr2=0x7f435806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 --2- 172.21.15.40:0/2124697784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435806ef40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43580bdf10 tx=0x7f435001c870 comp rx=0 tx=0).stop 2023-05-24T04:00:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- 172.21.15.40:0/2124697784 shutdown_connections 2023-05-24T04:00:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 --2- 172.21.15.40:0/2124697784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435806ef40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 --2- 172.21.15.40:0/2124697784 >> v2:172.21.15.67:3300/0 conn(0x7f435814aa30 0x7f4358071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- 172.21.15.40:0/2124697784 >> 172.21.15.40:0/2124697784 conn(0x7f43580c0280 msgr2=0x7f43580c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- 172.21.15.40:0/2124697784 shutdown_connections 2023-05-24T04:00:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- 172.21.15.40:0/2124697784 wait complete. 2023-05-24T04:00:09.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 Processor -- start 2023-05-24T04:00:09.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- start start 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f435814aa30 0x7f435806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435813f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43580a2db0 0x7f435813f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435806cfb0 con 0x7f435814bfe0 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580be440 con 0x7f435814aa30 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435fc27640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580be720 con 0x7f43580a2db0 2023-05-24T04:00:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435813f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57140/0 (socket says 172.21.15.40:57140) 2023-05-24T04:00:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 -- 172.21.15.40:0/3547435460 learned_addr learned my addr 172.21.15.40:0/3547435460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d9c3640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f435814aa30 0x7f435806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435e1c4640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43580a2db0 0x7f435813f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 -- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43580a2db0 msgr2=0x7f435813f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43580a2db0 0x7f435813f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 -- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f435814aa30 msgr2=0x7f435806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f435814aa30 0x7f435806ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 -- 172.21.15.40:0/3547435460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350009b30 con 0x7f435814bfe0 2023-05-24T04:00:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.990+0000 7f435d1c2640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435813f030 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f434800c450 tx=0x7f434800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348012830 con 0x7f435814bfe0 2023-05-24T04:00:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480129b0 con 0x7f435814bfe0 2023-05-24T04:00:10.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348012d60 con 0x7f435814bfe0 2023-05-24T04:00:10.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4358157b70 con 0x7f435814bfe0 2023-05-24T04:00:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43581579e0 con 0x7f435814bfe0 2023-05-24T04:00:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358157d00 con 0x7f435814bfe0 2023-05-24T04:00:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f434801c460 con 0x7f435814bfe0 2023-05-24T04:00:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f434e7fc640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f433c066280 0x7f433c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4348083fa0 con 0x7f435814bfe0 2023-05-24T04:00:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f435d9c3640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f433c066280 0x7f433c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.994+0000 7f435d9c3640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f433c066280 0x7f433c068730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f435400b9d0 tx=0x7f4354008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:09.998+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4348051090 con 0x7f435814bfe0 2023-05-24T04:00:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.146+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f435804ddd0 con 0x7f435814bfe0 2023-05-24T04:00:10.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f434e7fc640 1 -- 172.21.15.40:0/3547435460 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f43480546b0 con 0x7f435814bfe0 2023-05-24T04:00:10.154 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:10.155 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f433c066280 msgr2=0x7f433c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f433c066280 0x7f433c068730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f435400b9d0 tx=0x7f4354008040 comp rx=0 tx=0).stop 2023-05-24T04:00:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 msgr2=0x7f435813f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435813f030 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f434800c450 tx=0x7f434800c910 comp rx=0 tx=0).stop 2023-05-24T04:00:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 shutdown_connections 2023-05-24T04:00:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f433c066280 0x7f433c068730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43580a2db0 0x7f435813f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435814bfe0 0x7f435813f030 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 --2- 172.21.15.40:0/3547435460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f435814aa30 0x7f435806ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 >> 172.21.15.40:0/3547435460 conn(0x7f43580c0280 msgr2=0x7f4358149d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 shutdown_connections 2023-05-24T04:00:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.150+0000 7f435fc27640 1 -- 172.21.15.40:0/3547435460 wait complete. 2023-05-24T04:00:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:10.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:10.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.294+0000 7f646198e640 1 Processor -- start 2023-05-24T04:00:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.294+0000 7f646198e640 1 -- start start 2023-05-24T04:00:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f646198e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f645c0be6f0 0x7f645c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f646198e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 0x7f645c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f646198e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c06b010 con 0x7f645c0b5c10 2023-05-24T04:00:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f646198e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c06b730 con 0x7f645c0be6f0 2023-05-24T04:00:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f646198e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c06ada0 con 0x7f645c06bba0 2023-05-24T04:00:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f645c0b5c10 0x7f645c070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44884/0 (socket says 172.21.15.40:44884) 2023-05-24T04:00:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645b7fe640 1 -- 172.21.15.40:0/2090314748 learned_addr learned my addr 172.21.15.40:0/2090314748 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 --2- 172.21.15.40:0/2090314748 >> v2:172.21.15.67:3300/0 conn(0x7f645c0be6f0 0x7f645c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645a7fc640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 0x7f645c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745769603 0 0) 0x7f645c06b010 con 0x7f645c0b5c10 2023-05-24T04:00:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6444003530 con 0x7f645c0b5c10 2023-05-24T04:00:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2687668994 0 0) 0x7f6444003530 con 0x7f645c0b5c10 2023-05-24T04:00:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 msgr2=0x7f645c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 0x7f645c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 >> v2:172.21.15.67:3300/0 conn(0x7f645c0be6f0 msgr2=0x7f645c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 --2- 172.21.15.40:0/2090314748 >> v2:172.21.15.67:3300/0 conn(0x7f645c0be6f0 0x7f645c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c152100 con 0x7f645c0b5c10 2023-05-24T04:00:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f6454001a00 con 0x7f645c0b5c10 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 >> v1:172.21.15.40:6789/0 conn(0x7f645c0b5c10 legacy=0x7f645c070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6444003980 0x7f6444003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64440047d0 0x7f6444004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 0x7f6444005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c06b730 con 0x7f6444003980 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c06ada0 con 0x7f64440047d0 2023-05-24T04:00:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644400ba40 con 0x7f645c06bba0 2023-05-24T04:00:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6444003980 0x7f6444003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645a7fc640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64440047d0 0x7f6444004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645b7fe640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 0x7f6444005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 -- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 msgr2=0x7f6444005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c06bba0 0x7f6444005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 -- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64440047d0 msgr2=0x7f6444004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64440047d0 0x7f6444004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645affd640 1 -- 172.21.15.40:0/2090314748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444003530 con 0x7f6444003980 2023-05-24T04:00:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.298+0000 7f645a7fc640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64440047d0 0x7f6444004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645affd640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6444003980 0x7f6444003d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f644c009ae0 tx=0x7f644c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2e9c671d86044f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0a5680 con 0x7f6444003980 2023-05-24T04:00:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c0a57e0 con 0x7f6444003980 2023-05-24T04:00:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f6459ffb640 1 -- 172.21.15.40:0/2090314748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0a5b90 con 0x7f6444003980 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- 172.21.15.40:0/2090314748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6444003980 msgr2=0x7f6444003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 --2- 172.21.15.40:0/2090314748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6444003980 0x7f6444003d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f644c009ae0 tx=0x7f644c01ca90 comp rx=0 tx=0).stop 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 -- 172.21.15.40:0/2090314748 reap_dead start 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- 172.21.15.40:0/2090314748 shutdown_connections 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- 172.21.15.40:0/2090314748 >> 172.21.15.40:0/2090314748 conn(0x7f645c0c2540 msgr2=0x7f645c0c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- 172.21.15.40:0/2090314748 shutdown_connections 2023-05-24T04:00:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- 172.21.15.40:0/2090314748 wait complete. 2023-05-24T04:00:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 Processor -- start 2023-05-24T04:00:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- start start 2023-05-24T04:00:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6444003980 0x7f645c0c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c0a5430 0x7f645c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 0x7f645c1eac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c14b850 con 0x7f645c1ea820 2023-05-24T04:00:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0a6f00 con 0x7f6444003980 2023-05-24T04:00:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f646198e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c155020 con 0x7f645c0a5430 2023-05-24T04:00:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 0x7f645c1eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 0x7f645c1eac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57156/0 (socket says 172.21.15.40:57156) 2023-05-24T04:00:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 -- 172.21.15.40:0/2352603701 learned_addr learned my addr 172.21.15.40:0/2352603701 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645a7fc640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c0a5430 0x7f645c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645affd640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6444003980 0x7f645c0c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 -- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c0a5430 msgr2=0x7f645c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c0a5430 0x7f645c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 -- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6444003980 msgr2=0x7f645c0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6444003980 0x7f645c0c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.302+0000 7f645b7fe640 1 -- 172.21.15.40:0/2352603701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c071b10 con 0x7f645c1ea820 2023-05-24T04:00:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f645b7fe640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 0x7f645c1eac90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f645c0708a0 tx=0x7f6454007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540114f0 con 0x7f645c1ea820 2023-05-24T04:00:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454011690 con 0x7f645c1ea820 2023-05-24T04:00:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c071980 con 0x7f645c1ea820 2023-05-24T04:00:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011a40 con 0x7f645c1ea820 2023-05-24T04:00:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c159c40 con 0x7f645c1ea820 2023-05-24T04:00:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c0a5800 con 0x7f645c1ea820 2023-05-24T04:00:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6454011ba0 con 0x7f645c1ea820 2023-05-24T04:00:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f6443fff640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6448066280 0x7f6448068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f64540837e0 con 0x7f645c1ea820 2023-05-24T04:00:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f645affd640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6448066280 0x7f6448068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.306+0000 7f645affd640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6448066280 0x7f6448068730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f644c0af000 tx=0x7f644c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.310+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6454050a20 con 0x7f645c1ea820 2023-05-24T04:00:10.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f645c0a82a0 con 0x7f645c1ea820 2023-05-24T04:00:10.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f6443fff640 1 -- 172.21.15.40:0/2352603701 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64540190a0 con 0x7f645c1ea820 2023-05-24T04:00:10.471 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:10.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6448066280 msgr2=0x7f6448068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6448066280 0x7f6448068730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f644c0af000 tx=0x7f644c0046d0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 msgr2=0x7f645c1eac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 0x7f645c1eac90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f645c0708a0 tx=0x7f6454007a20 comp rx=0 tx=0).stop 2023-05-24T04:00:10.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 shutdown_connections 2023-05-24T04:00:10.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6448066280 0x7f6448068730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f645c1ea820 0x7f645c1eac90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f645c0a5430 0x7f645c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 --2- 172.21.15.40:0/2352603701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6444003980 0x7f645c0c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 >> 172.21.15.40:0/2352603701 conn(0x7f645c0c2540 msgr2=0x7f645c14dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:10.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 shutdown_connections 2023-05-24T04:00:10.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.466+0000 7f646198e640 1 -- 172.21.15.40:0/2352603701 wait complete. 2023-05-24T04:00:10.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.618+0000 7f00ea4c7640 1 Processor -- start 2023-05-24T04:00:10.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.618+0000 7f00ea4c7640 1 -- start start 2023-05-24T04:00:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00e414bc80 0x7f00e40a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e4071670 0x7f00e40bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e4070ab0 con 0x7f00e4071220 2023-05-24T04:00:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e40a5040 con 0x7f00e4071670 2023-05-24T04:00:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e4071a90 con 0x7f00e414bc80 2023-05-24T04:00:10.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e4071670 0x7f00e40bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e4071670 0x7f00e40bd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57170/0 (socket says 172.21.15.40:57170) 2023-05-24T04:00:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 -- 172.21.15.40:0/1854176050 learned_addr learned my addr 172.21.15.40:0/1854176050 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e3fff640 1 --2- 172.21.15.40:0/1854176050 >> v2:172.21.15.67:3300/0 conn(0x7f00e414bc80 0x7f00e40a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 -- 172.21.15.40:0/1854176050 >> v2:172.21.15.67:3300/0 conn(0x7f00e414bc80 msgr2=0x7f00e40a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 --2- 172.21.15.40:0/1854176050 >> v2:172.21.15.67:3300/0 conn(0x7f00e414bc80 0x7f00e40a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 -- 172.21.15.40:0/1854176050 >> v1:172.21.15.67:6789/0 conn(0x7f00e4071220 legacy=0x7f00e40bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 -- 172.21.15.40:0/1854176050 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e414d0f0 con 0x7f00e4071670 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e8a64640 1 --2- 172.21.15.40:0/1854176050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e4071670 0x7f00e40bd430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00e406e350 tx=0x7f00dc01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cc2d4bd235c4aa server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e37fe640 1 -- 172.21.15.40:0/1854176050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0a5730 con 0x7f00e4071670 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e37fe640 1 -- 172.21.15.40:0/1854176050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0a5890 con 0x7f00e4071670 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00e37fe640 1 -- 172.21.15.40:0/1854176050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0a5c20 con 0x7f00e4071670 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- 172.21.15.40:0/1854176050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e4071670 msgr2=0x7f00e40bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/1854176050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e4071670 0x7f00e40bd430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00e406e350 tx=0x7f00dc01c870 comp rx=0 tx=0).stop 2023-05-24T04:00:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- 172.21.15.40:0/1854176050 shutdown_connections 2023-05-24T04:00:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/1854176050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e4071670 0x7f00e40bd430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/1854176050 >> v2:172.21.15.67:3300/0 conn(0x7f00e414bc80 0x7f00e40a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- 172.21.15.40:0/1854176050 >> 172.21.15.40:0/1854176050 conn(0x7f00e40c0310 msgr2=0x7f00e40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- 172.21.15.40:0/1854176050 shutdown_connections 2023-05-24T04:00:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.622+0000 7f00ea4c7640 1 -- 172.21.15.40:0/1854176050 wait complete. 2023-05-24T04:00:10.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 Processor -- start 2023-05-24T04:00:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- start start 2023-05-24T04:00:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e4071220 0x7f00e414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e4071670 0x7f00e40be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 0x7f00e413d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40bebc0 con 0x7f00e414bc80 2023-05-24T04:00:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e41ea0d0 con 0x7f00e4071220 2023-05-24T04:00:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e41ea3b0 con 0x7f00e4071670 2023-05-24T04:00:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 0x7f00e413d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 0x7f00e413d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57180/0 (socket says 172.21.15.40:57180) 2023-05-24T04:00:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 -- 172.21.15.40:0/3005936105 learned_addr learned my addr 172.21.15.40:0/3005936105 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e3fff640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e4071220 0x7f00e414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00db7fe640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e4071670 0x7f00e40be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 -- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e4071670 msgr2=0x7f00e40be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e4071670 0x7f00e40be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 -- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e4071220 msgr2=0x7f00e414fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e4071220 0x7f00e414fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 -- 172.21.15.40:0/3005936105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009b30 con 0x7f00e414bc80 2023-05-24T04:00:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e8a64640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 0x7f00e413d580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0af040 tx=0x7f00dc019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b8670 con 0x7f00e414bc80 2023-05-24T04:00:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0b87d0 con 0x7f00e414bc80 2023-05-24T04:00:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e406b1d0 con 0x7f00e414bc80 2023-05-24T04:00:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b8b80 con 0x7f00e414bc80 2023-05-24T04:00:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e40bd970 con 0x7f00e414bc80 2023-05-24T04:00:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e414c050 con 0x7f00e414bc80 2023-05-24T04:00:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.626+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00dc0b8ce0 con 0x7f00e414bc80 2023-05-24T04:00:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.630+0000 7f00e17fa640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f00c4066280 0x7f00c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.630+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00dc11f370 con 0x7f00e414bc80 2023-05-24T04:00:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.630+0000 7f00e3fff640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f00c4066280 0x7f00c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.630+0000 7f00e3fff640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f00c4066280 0x7f00c4068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00e4156a40 tx=0x7f00d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.634+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f00dc0ec6c0 con 0x7f00e414bc80 2023-05-24T04:00:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00e40bcb90 con 0x7f00e414bc80 2023-05-24T04:00:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00e17fa640 1 -- 172.21.15.40:0/3005936105 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00dc0efca0 con 0x7f00e414bc80 2023-05-24T04:00:10.793 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f00c4066280 msgr2=0x7f00c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f00c4066280 0x7f00c4068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00e4156a40 tx=0x7f00d4008040 comp rx=0 tx=0).stop 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 msgr2=0x7f00e413d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 0x7f00e413d580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0af040 tx=0x7f00dc019610 comp rx=0 tx=0).stop 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 shutdown_connections 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f00c4066280 0x7f00c4068730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e414bc80 0x7f00e413d580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e4071670 0x7f00e40be680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 --2- 172.21.15.40:0/3005936105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e4071220 0x7f00e414fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 >> 172.21.15.40:0/3005936105 conn(0x7f00e40c0310 msgr2=0x7f00e40bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:10.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 shutdown_connections 2023-05-24T04:00:10.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.786+0000 7f00ea4c7640 1 -- 172.21.15.40:0/3005936105 wait complete. 2023-05-24T04:00:10.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.926+0000 7f822414f640 1 Processor -- start 2023-05-24T04:00:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f822414f640 1 -- start start 2023-05-24T04:00:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f822414f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0bd4f0 0x7f821c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f822414f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f821c150220 0x7f821c150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f822414f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0be160 con 0x7f821c14c1b0 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f822414f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0be8c0 con 0x7f821c150220 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f822414f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c150ba0 con 0x7f821c0bd4f0 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8221eeb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f821c14c1b0 0x7f821c070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44894/0 (socket says 172.21.15.40:44894) 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8221eeb640 1 -- 172.21.15.40:0/174094213 learned_addr learned my addr 172.21.15.40:0/174094213 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82226ec640 1 --2- 172.21.15.40:0/174094213 >> v2:172.21.15.40:3300/0 conn(0x7f821c150220 0x7f821c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0bd4f0 0x7f821c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280684457 0 0) 0x7f8218001120 con 0x7f821c14c1b0 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8208003530 con 0x7f821c14c1b0 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3285775894 0 0) 0x7f8208003530 con 0x7f821c14c1b0 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0bd4f0 msgr2=0x7f821c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0bd4f0 0x7f821c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 >> v2:172.21.15.40:3300/0 conn(0x7f821c150220 msgr2=0x7f821c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 --2- 172.21.15.40:0/174094213 >> v2:172.21.15.40:3300/0 conn(0x7f821c150220 0x7f821c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0a7ea0 con 0x7f821c14c1b0 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f8218001810 con 0x7f821c14c1b0 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82226ec640 1 --2- 172.21.15.40:0/174094213 >> v2:172.21.15.40:3300/0 conn(0x7f821c150220 0x7f821c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 >> v1:172.21.15.40:6789/0 conn(0x7f821c14c1b0 legacy=0x7f821c070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080039b0 0x7f8208003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82080047d0 0x7f8208004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8208005180 0x7f820800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0be8c0 con 0x7f82080047d0 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c150ba0 con 0x7f82080039b0 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8208005690 con 0x7f8208005180 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82080047d0 0x7f8208004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 -- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8208005180 msgr2=0x7f820800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8208005180 0x7f820800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 -- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080039b0 msgr2=0x7f8208003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080039b0 0x7f8208003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.930+0000 7f82216ea640 1 -- 172.21.15.40:0/174094213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208003530 con 0x7f82080047d0 2023-05-24T04:00:10.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82216ea640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82080047d0 0x7f8208004c40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f820c009ae0 tx=0x7f820c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa034703724d2419 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0a5570 con 0x7f82080047d0 2023-05-24T04:00:10.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0a56d0 con 0x7f82080047d0 2023-05-24T04:00:10.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f8220ee9640 1 -- 172.21.15.40:0/174094213 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0a5a80 con 0x7f82080047d0 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/174094213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82080047d0 msgr2=0x7f8208004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 --2- 172.21.15.40:0/174094213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82080047d0 0x7f8208004c40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f820c009ae0 tx=0x7f820c01ca90 comp rx=0 tx=0).stop 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 -- 172.21.15.40:0/174094213 reap_dead start 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/174094213 shutdown_connections 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/174094213 >> 172.21.15.40:0/174094213 conn(0x7f821c0c2540 msgr2=0x7f821c0c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/174094213 shutdown_connections 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/174094213 wait complete. 2023-05-24T04:00:10.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 Processor -- start 2023-05-24T04:00:10.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- start start 2023-05-24T04:00:10.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080047d0 0x7f821c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0c1fb0 0x7f821c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 0x7f821c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c0d50 con 0x7f821c0b5300 2023-05-24T04:00:10.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c152820 con 0x7f82080047d0 2023-05-24T04:00:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c0fa0 con 0x7f821c0c1fb0 2023-05-24T04:00:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 0x7f821c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 0x7f821c1522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57202/0 (socket says 172.21.15.40:57202) 2023-05-24T04:00:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 -- 172.21.15.40:0/2470788215 learned_addr learned my addr 172.21.15.40:0/2470788215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f8221eeb640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080047d0 0x7f821c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82216ea640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0c1fb0 0x7f821c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 -- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0c1fb0 msgr2=0x7f821c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0c1fb0 0x7f821c151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 -- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080047d0 msgr2=0x7f821c06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080047d0 0x7f821c06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 -- 172.21.15.40:0/2470788215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0a80f0 con 0x7f821c0b5300 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82226ec640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 0x7f821c1522e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f821c1505f0 tx=0x7f821400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214010040 con 0x7f821c0b5300 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214003bc0 con 0x7f821c0b5300 2023-05-24T04:00:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0711b0 con 0x7f821c0b5300 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214004030 con 0x7f821c0b5300 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.934+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0a83f0 con 0x7f821c0b5300 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.938+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c066d70 con 0x7f821c0b5300 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.938+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8214004190 con 0x7f821c0b5300 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.938+0000 7f82127fc640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f82000662b0 0x7f8200068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.938+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8214083ff0 con 0x7f821c0b5300 2023-05-24T04:00:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.938+0000 7f8221eeb640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f82000662b0 0x7f8200068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.938+0000 7f8221eeb640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f82000662b0 0x7f8200068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8218000f70 tx=0x7f8218001cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:10.942+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8214051210 con 0x7f821c0b5300 2023-05-24T04:00:11.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f821c0a5e10 con 0x7f821c0b5300 2023-05-24T04:00:11.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f82127fc640 1 -- 172.21.15.40:0/2470788215 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8214054830 con 0x7f821c0b5300 2023-05-24T04:00:11.099 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:11.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f82000662b0 msgr2=0x7f8200068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f82000662b0 0x7f8200068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8218000f70 tx=0x7f8218001cc0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 msgr2=0x7f821c1522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 0x7f821c1522e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f821c1505f0 tx=0x7f821400eea0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 shutdown_connections 2023-05-24T04:00:11.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f82000662b0 0x7f8200068760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821c0b5300 0x7f821c1522e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f821c0c1fb0 0x7f821c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 --2- 172.21.15.40:0/2470788215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82080047d0 0x7f821c06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 >> 172.21.15.40:0/2470788215 conn(0x7f821c0c2540 msgr2=0x7f821c14d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:11.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 shutdown_connections 2023-05-24T04:00:11.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.094+0000 7f822414f640 1 -- 172.21.15.40:0/2470788215 wait complete. 2023-05-24T04:00:11.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:00:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.246+0000 7f5431c31640 1 Processor -- start 2023-05-24T04:00:11.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.246+0000 7f5431c31640 1 -- start start 2023-05-24T04:00:11.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.246+0000 7f5431c31640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f542c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.246+0000 7f5431c31640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c06feb0 con 0x7f542c071b80 2023-05-24T04:00:11.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.246+0000 7f5431c31640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c1509a0 con 0x7f542c14bfe0 2023-05-24T04:00:11.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.246+0000 7f5431c31640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c14d800 con 0x7f542c069c40 2023-05-24T04:00:11.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f542c071b80 0x7f542c06cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44906/0 (socket says 172.21.15.40:44906) 2023-05-24T04:00:11.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542affd640 1 -- 172.21.15.40:0/1084142895 learned_addr learned my addr 172.21.15.40:0/1084142895 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542b7fe640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f542c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750884017 0 0) 0x7f542c06feb0 con 0x7f542c071b80 2023-05-24T04:00:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5414003530 con 0x7f542c071b80 2023-05-24T04:00:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90687261 0 0) 0x7f5414003530 con 0x7f542c071b80 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 msgr2=0x7f542c14baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f542c14baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 >> v1:172.21.15.67:6789/0 conn(0x7f542c14bfe0 legacy=0x7f542c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c14c450 con 0x7f542c071b80 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f5420001680 con 0x7f542c071b80 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 >> v1:172.21.15.40:6789/0 conn(0x7f542c071b80 legacy=0x7f542c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f54140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414003f30 0x7f54140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004d10 0x7f5414005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c14d800 con 0x7f5414004d10 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541400ba70 con 0x7f5414003f30 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541400bc30 con 0x7f542c069c40 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004d10 0x7f5414005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542b7fe640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f54140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542affd640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414003f30 0x7f54140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 -- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 msgr2=0x7f54140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f54140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 -- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414003f30 msgr2=0x7f54140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414003f30 0x7f54140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 -- 172.21.15.40:0/1084142895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5414003530 con 0x7f5414004d10 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542b7fe640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c069c40 0x7f54140039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542bfff640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004d10 0x7f5414005180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5424001e40 tx=0x7f542401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eeac6f073d054b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424003b80 con 0x7f5414004d10 2023-05-24T04:00:11.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424003ce0 con 0x7f5414004d10 2023-05-24T04:00:11.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.250+0000 7f542a7fc640 1 -- 172.21.15.40:0/1084142895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240052c0 con 0x7f5414004d10 2023-05-24T04:00:11.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/1084142895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004d10 msgr2=0x7f5414005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 --2- 172.21.15.40:0/1084142895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004d10 0x7f5414005180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5424001e40 tx=0x7f542401c740 comp rx=0 tx=0).stop 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 -- 172.21.15.40:0/1084142895 reap_dead start 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/1084142895 shutdown_connections 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/1084142895 >> 172.21.15.40:0/1084142895 conn(0x7f542c06b780 msgr2=0x7f542c0c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/1084142895 shutdown_connections 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/1084142895 wait complete. 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 Processor -- start 2023-05-24T04:00:11.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- start start 2023-05-24T04:00:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c0a3220 0x7f542c0badd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0a35f0 0x7f542c0b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 0x7f542c1486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0b8b90 con 0x7f542c148260 2023-05-24T04:00:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0ba7f0 con 0x7f542c0a35f0 2023-05-24T04:00:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c148c10 con 0x7f542c0a3220 2023-05-24T04:00:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 0x7f542c1486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 0x7f542c1486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57234/0 (socket says 172.21.15.40:57234) 2023-05-24T04:00:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 -- 172.21.15.40:0/4232089906 learned_addr learned my addr 172.21.15.40:0/4232089906 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542affd640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0a35f0 0x7f542c0b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542b7fe640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c0a3220 0x7f542c0badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 -- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c0a3220 msgr2=0x7f542c0badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c0a3220 0x7f542c0badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 -- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0a35f0 msgr2=0x7f542c0b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0a35f0 0x7f542c0b9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 -- 172.21.15.40:0/4232089906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c070170 con 0x7f542c148260 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542b7fe640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c0a3220 0x7f542c0badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f542bfff640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 0x7f542c1486d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f542401c780 tx=0x7f5414005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424006d60 con 0x7f542c148260 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424005030 con 0x7f542c148260 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240053c0 con 0x7f542c148260 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c06db00 con 0x7f542c148260 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c06fbd0 con 0x7f542c148260 2023-05-24T04:00:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.254+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c0ba010 con 0x7f542c148260 2023-05-24T04:00:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.258+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5424005520 con 0x7f542c148260 2023-05-24T04:00:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.258+0000 7f5413fff640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f54180662b0 0x7f5418068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.258+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f542411cd70 con 0x7f542c148260 2023-05-24T04:00:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.258+0000 7f542b7fe640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f54180662b0 0x7f5418068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.258+0000 7f542b7fe640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f54180662b0 0x7f5418068760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f541c009aa0 tx=0x7f541c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.262+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f54240e9e80 con 0x7f542c148260 2023-05-24T04:00:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.410+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f542c0b6390 con 0x7f542c148260 2023-05-24T04:00:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5413fff640 1 -- 172.21.15.40:0/4232089906 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54240b8030 con 0x7f542c148260 2023-05-24T04:00:11.418 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f54180662b0 msgr2=0x7f5418068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f54180662b0 0x7f5418068760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f541c009aa0 tx=0x7f541c008040 comp rx=0 tx=0).stop 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 msgr2=0x7f542c1486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 0x7f542c1486d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f542401c780 tx=0x7f5414005800 comp rx=0 tx=0).stop 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 shutdown_connections 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f54180662b0 0x7f5418068760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542c148260 0x7f542c1486d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0a35f0 0x7f542c0b9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 --2- 172.21.15.40:0/4232089906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f542c0a3220 0x7f542c0badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 >> 172.21.15.40:0/4232089906 conn(0x7f542c06b780 msgr2=0x7f542c14fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:11.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 shutdown_connections 2023-05-24T04:00:11.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.414+0000 7f5431c31640 1 -- 172.21.15.40:0/4232089906 wait complete. 2023-05-24T04:00:11.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:00:11.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 Processor -- start 2023-05-24T04:00:11.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 -- start start 2023-05-24T04:00:11.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 0x7f45880bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45880a6bb0 0x7f458814a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4588070f60 con 0x7f458806cf40 2023-05-24T04:00:11.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45880bbfc0 con 0x7f45880a6bb0 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f458d5b5640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45880a73e0 con 0x7f45880a3d30 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 0x7f45880bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45877fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45880a6bb0 0x7f458814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 0x7f45880bba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:55306/0 (socket says 172.21.15.40:55306) 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 -- 172.21.15.40:0/1822480565 learned_addr learned my addr 172.21.15.40:0/1822480565 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f4586ffd640 1 --1- 172.21.15.40:0/1822480565 >> v1:172.21.15.67:6789/0 conn(0x7f458806cf40 0x7f45880bce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:38000/0 (socket says 172.21.15.40:38000) 2023-05-24T04:00:11.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 -- 172.21.15.40:0/1822480565 >> v2:172.21.15.67:3300/0 conn(0x7f45880a6bb0 msgr2=0x7f458814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:11.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 --2- 172.21.15.40:0/1822480565 >> v2:172.21.15.67:3300/0 conn(0x7f45880a6bb0 0x7f458814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 -- 172.21.15.40:0/1822480565 >> v1:172.21.15.67:6789/0 conn(0x7f458806cf40 legacy=0x7f45880bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.554+0000 7f45867fc640 1 -- 172.21.15.40:0/1822480565 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45880a7100 con 0x7f45880a3d30 2023-05-24T04:00:11.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f45867fc640 1 --2- 172.21.15.40:0/1822480565 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 0x7f45880bba80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4578009870 tx=0x7f457801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e0bb5c68d6833f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f4585ffb640 1 -- 172.21.15.40:0/1822480565 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780ab600 con 0x7f45880a3d30 2023-05-24T04:00:11.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f4585ffb640 1 -- 172.21.15.40:0/1822480565 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45780a7050 con 0x7f45880a3d30 2023-05-24T04:00:11.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f4585ffb640 1 -- 172.21.15.40:0/1822480565 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780ab980 con 0x7f45880a3d30 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 -- 172.21.15.40:0/1822480565 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 msgr2=0x7f45880bba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 --2- 172.21.15.40:0/1822480565 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 0x7f45880bba80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4578009870 tx=0x7f457801c3f0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 -- 172.21.15.40:0/1822480565 shutdown_connections 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 --2- 172.21.15.40:0/1822480565 >> v2:172.21.15.67:3300/0 conn(0x7f45880a6bb0 0x7f458814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 --2- 172.21.15.40:0/1822480565 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45880a3d30 0x7f45880bba80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 -- 172.21.15.40:0/1822480565 >> 172.21.15.40:0/1822480565 conn(0x7f458806b780 msgr2=0x7f45880c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:11.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 -- 172.21.15.40:0/1822480565 shutdown_connections 2023-05-24T04:00:11.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 -- 172.21.15.40:0/1822480565 wait complete. 2023-05-24T04:00:11.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 Processor -- start 2023-05-24T04:00:11.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.558+0000 7f458d5b5640 1 -- start start 2023-05-24T04:00:11.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f458806cf40 0x7f4588147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45880a3d30 0x7f45880b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 0x7f45880b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45880b8c90 con 0x7f45880a6bb0 2023-05-24T04:00:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45881481a0 con 0x7f45880a3d30 2023-05-24T04:00:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45881e88c0 con 0x7f458806cf40 2023-05-24T04:00:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 0x7f45880b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 0x7f45880b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39794/0 (socket says 172.21.15.40:39794) 2023-05-24T04:00:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 -- 172.21.15.40:0/2098905999 learned_addr learned my addr 172.21.15.40:0/2098905999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45867fc640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45880a3d30 0x7f45880b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f4586ffd640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f458806cf40 0x7f4588147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 -- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f458806cf40 msgr2=0x7f4588147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f458806cf40 0x7f4588147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 -- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45880a3d30 msgr2=0x7f45880b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45880a3d30 0x7f45880b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 -- 172.21.15.40:0/2098905999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780094d0 con 0x7f45880a6bb0 2023-05-24T04:00:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45867fc640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45880a3d30 0x7f45880b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f45877fe640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 0x7f45880b9cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f458000efc0 tx=0x7f458000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580014480 con 0x7f45880a6bb0 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458000f040 con 0x7f45880a6bb0 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580014820 con 0x7f45880a6bb0 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458806d4a0 con 0x7f45880a6bb0 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458806d310 con 0x7f45880a6bb0 2023-05-24T04:00:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458814f730 con 0x7f45880a6bb0 2023-05-24T04:00:11.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4580014980 con 0x7f45880a6bb0 2023-05-24T04:00:11.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f456f7fe640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f45740662b0 0x7f4574068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4580084b30 con 0x7f45880a6bb0 2023-05-24T04:00:11.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f4586ffd640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f45740662b0 0x7f4574068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.562+0000 7f4586ffd640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f45740662b0 0x7f4574068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f70 tx=0x7f457c007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.566+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4580051d50 con 0x7f45880a6bb0 2023-05-24T04:00:11.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.722+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4588066d70 con 0x7f45880a6bb0 2023-05-24T04:00:11.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f456f7fe640 1 -- 172.21.15.40:0/2098905999 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45800180a0 con 0x7f45880a6bb0 2023-05-24T04:00:11.730 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:11.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f45740662b0 msgr2=0x7f4574068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f45740662b0 0x7f4574068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f70 tx=0x7f457c007cb0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 msgr2=0x7f45880b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 0x7f45880b9cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f458000efc0 tx=0x7f458000c490 comp rx=0 tx=0).stop 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 shutdown_connections 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f45740662b0 0x7f4574068760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45880a6bb0 0x7f45880b9cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45880a3d30 0x7f45880b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 --2- 172.21.15.40:0/2098905999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f458806cf40 0x7f4588147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 >> 172.21.15.40:0/2098905999 conn(0x7f458806b780 msgr2=0x7f45880c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:11.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 shutdown_connections 2023-05-24T04:00:11.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.726+0000 7f458d5b5640 1 -- 172.21.15.40:0/2098905999 wait complete. 2023-05-24T04:00:11.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:00:11.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 Processor -- start 2023-05-24T04:00:11.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 -- start start 2023-05-24T04:00:11.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 0x7f78bc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78bc145df0 0x7f78bc146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc06ea20 con 0x7f78bc070b20 2023-05-24T04:00:11.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc06ec70 con 0x7f78bc145df0 2023-05-24T04:00:11.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78c1ffc640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc150230 con 0x7f78bc14fa70 2023-05-24T04:00:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 0x7f78bc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78bc145df0 0x7f78bc146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 0x7f78bc06fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:55328/0 (socket says 172.21.15.40:55328) 2023-05-24T04:00:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 -- 172.21.15.40:0/692517807 learned_addr learned my addr 172.21.15.40:0/692517807 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 -- 172.21.15.40:0/692517807 >> v2:172.21.15.67:3300/0 conn(0x7f78bc145df0 msgr2=0x7f78bc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 --2- 172.21.15.40:0/692517807 >> v2:172.21.15.67:3300/0 conn(0x7f78bc145df0 0x7f78bc146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 -- 172.21.15.40:0/692517807 >> v1:172.21.15.67:6789/0 conn(0x7f78bc070b20 legacy=0x7f78bc06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.862+0000 7f78bb7fe640 1 -- 172.21.15.40:0/692517807 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc06c1d0 con 0x7f78bc14fa70 2023-05-24T04:00:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78bb7fe640 1 --2- 172.21.15.40:0/692517807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 0x7f78bc06fd50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009870 tx=0x7f78ac01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76343edce783cb1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78ba7fc640 1 -- 172.21.15.40:0/692517807 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0ab650 con 0x7f78bc14fa70 2023-05-24T04:00:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78ba7fc640 1 -- 172.21.15.40:0/692517807 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0ab7b0 con 0x7f78bc14fa70 2023-05-24T04:00:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78ba7fc640 1 -- 172.21.15.40:0/692517807 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0abb40 con 0x7f78bc14fa70 2023-05-24T04:00:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- 172.21.15.40:0/692517807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 msgr2=0x7f78bc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/692517807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 0x7f78bc06fd50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009870 tx=0x7f78ac01c540 comp rx=0 tx=0).stop 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- 172.21.15.40:0/692517807 shutdown_connections 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/692517807 >> v2:172.21.15.67:3300/0 conn(0x7f78bc145df0 0x7f78bc146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/692517807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc14fa70 0x7f78bc06fd50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- 172.21.15.40:0/692517807 >> 172.21.15.40:0/692517807 conn(0x7f78bc0c0280 msgr2=0x7f78bc0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- 172.21.15.40:0/692517807 shutdown_connections 2023-05-24T04:00:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- 172.21.15.40:0/692517807 wait complete. 2023-05-24T04:00:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 Processor -- start 2023-05-24T04:00:11.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- start start 2023-05-24T04:00:11.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc070b20 0x7f78bc1e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc145df0 0x7f78bc1e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 0x7f78bc1407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc137140 con 0x7f78bc14fa70 2023-05-24T04:00:11.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1e8760 con 0x7f78bc145df0 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78c1ffc640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc14f2c0 con 0x7f78bc070b20 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 0x7f78bc1407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 0x7f78bc1407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39800/0 (socket says 172.21.15.40:39800) 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.866+0000 7f78bbfff640 1 -- 172.21.15.40:0/2374168428 learned_addr learned my addr 172.21.15.40:0/2374168428 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78baffd640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc145df0 0x7f78bc1e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bb7fe640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc070b20 0x7f78bc1e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bbfff640 1 -- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc070b20 msgr2=0x7f78bc1e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bbfff640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc070b20 0x7f78bc1e8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bbfff640 1 -- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc145df0 msgr2=0x7f78bc1e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:11.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bbfff640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc145df0 0x7f78bc1e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:11.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bbfff640 1 -- 172.21.15.40:0/2374168428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0094d0 con 0x7f78bc14fa70 2023-05-24T04:00:11.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78baffd640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc145df0 0x7f78bc1e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:11.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bbfff640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 0x7f78bc1407c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f78b400efc0 tx=0x7f78b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400ced0 con 0x7f78bc14fa70 2023-05-24T04:00:11.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b400f040 con 0x7f78bc14fa70 2023-05-24T04:00:11.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc14fe40 con 0x7f78bc14fa70 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40146c0 con 0x7f78bc14fa70 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc070290 con 0x7f78bc14fa70 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc14ffd0 con 0x7f78bc14fa70 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78b4014820 con 0x7f78bc14fa70 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78a3fff640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f78a8066280 0x7f78a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f78b4084eb0 con 0x7f78bc14fa70 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bb7fe640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f78a8066280 0x7f78a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:11.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.870+0000 7f78bb7fe640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f78a8066280 0x7f78a8068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0af000 tx=0x7f78ac0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:11.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:11.874+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78b4055ad0 con 0x7f78bc14fa70 2023-05-24T04:00:12.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78bc14f480 con 0x7f78bc14fa70 2023-05-24T04:00:12.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78a3fff640 1 -- 172.21.15.40:0/2374168428 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f78b4018080 con 0x7f78bc14fa70 2023-05-24T04:00:12.039 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:00:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f78a8066280 msgr2=0x7f78a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f78a8066280 0x7f78a8068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0af000 tx=0x7f78ac0a7000 comp rx=0 tx=0).stop 2023-05-24T04:00:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 msgr2=0x7f78bc1407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 0x7f78bc1407c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f78b400efc0 tx=0x7f78b400c490 comp rx=0 tx=0).stop 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 shutdown_connections 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f78a8066280 0x7f78a8068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc14fa70 0x7f78bc1407c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc145df0 0x7f78bc1e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 --2- 172.21.15.40:0/2374168428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78bc070b20 0x7f78bc1e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 >> 172.21.15.40:0/2374168428 conn(0x7f78bc0c0280 msgr2=0x7f78bc0bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 shutdown_connections 2023-05-24T04:00:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:12.034+0000 7f78c1ffc640 1 -- 172.21.15.40:0/2374168428 wait complete. 2023-05-24T04:00:12.057 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2023-05-24T04:00:12.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:12.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-24T04:00:12.150 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:ceph-fuse[32357]: fuse finished with error 0 and tester_r 0 2023-05-24T04:00:12.151 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:00:18.253 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2023-05-24T04:00:18.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:18.254 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-24T04:00:18.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:18.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.486+0000 7f97066b8640 1 Processor -- start 2023-05-24T04:00:18.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.486+0000 7f97066b8640 1 -- start start 2023-05-24T04:00:18.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f97066b8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 0x7f9700071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f97066b8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970014b240 con 0x7f97000a3290 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f97066b8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970006ea20 con 0x7f970014bfe0 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f97066b8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9700071d50 con 0x7f970014aa30 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96ff7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f97000a3290 0x7f9700071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43486/0 (socket says 172.21.15.40:43486) 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96ff7fe640 1 -- 172.21.15.40:0/3747550577 learned_addr learned my addr 172.21.15.40:0/3747550577 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 0x7f9700071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575499916 0 0) 0x7f970014b240 con 0x7f97000a3290 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e8003530 con 0x7f97000a3290 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250550426 0 0) 0x7f96e8003530 con 0x7f97000a3290 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 msgr2=0x7f9700071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 0x7f9700071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 >> v1:172.21.15.67:6789/0 conn(0x7f970014bfe0 legacy=0x7f970006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970006bfa0 con 0x7f97000a3290 2023-05-24T04:00:18.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f96f4001680 con 0x7f97000a3290 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 >> v1:172.21.15.40:6789/0 conn(0x7f97000a3290 legacy=0x7f9700071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f96e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 0x7f96e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96e8004d10 0x7f96e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9700071d50 con 0x7f96e80039b0 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e800ba40 con 0x7f96e8004d10 2023-05-24T04:00:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e800bbd0 con 0x7f970014aa30 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f96e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f9704c55640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96e8004d10 0x7f96e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 -- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 msgr2=0x7f96e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970014aa30 0x7f96e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 -- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96e8004d10 msgr2=0x7f96e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96e8004d10 0x7f96e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f96fffff640 1 -- 172.21.15.40:0/3747550577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8003530 con 0x7f96e80039b0 2023-05-24T04:00:18.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.490+0000 7f9704c55640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96e8004d10 0x7f96e8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:18.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f96e8003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009ae0 tx=0x7f96f001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38516959f074cfa server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:18.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f00a6470 con 0x7f96e80039b0 2023-05-24T04:00:18.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f00a65d0 con 0x7f96e80039b0 2023-05-24T04:00:18.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96feffd640 1 -- 172.21.15.40:0/3747550577 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f00a6980 con 0x7f96e80039b0 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- 172.21.15.40:0/3747550577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 msgr2=0x7f96e8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 --2- 172.21.15.40:0/3747550577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f96e8003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009ae0 tx=0x7f96f001ca90 comp rx=0 tx=0).stop 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f9704c55640 1 -- 172.21.15.40:0/3747550577 reap_dead start 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- 172.21.15.40:0/3747550577 shutdown_connections 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- 172.21.15.40:0/3747550577 >> 172.21.15.40:0/3747550577 conn(0x7f97000c0280 msgr2=0x7f97000c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- 172.21.15.40:0/3747550577 shutdown_connections 2023-05-24T04:00:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- 172.21.15.40:0/3747550577 wait complete. 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 Processor -- start 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- start start 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f970014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97001ea690 0x7f97001415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97001eaae0 0x7f9700141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970014cbc0 con 0x7f96e80039b0 2023-05-24T04:00:18.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97001eb370 con 0x7f97001ea690 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f97066b8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970014eb70 con 0x7f97001eaae0 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f970014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f970014ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39812/0 (socket says 172.21.15.40:39812) 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 -- 172.21.15.40:0/1521562720 learned_addr learned my addr 172.21.15.40:0/1521562720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f9704c55640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97001eaae0 0x7f9700141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96ff7fe640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97001ea690 0x7f97001415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 -- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97001eaae0 msgr2=0x7f9700141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97001eaae0 0x7f9700141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 -- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97001ea690 msgr2=0x7f97001415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97001ea690 0x7f97001415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 -- 172.21.15.40:0/1521562720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97001571f0 con 0x7f96e80039b0 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f9704c55640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97001eaae0 0x7f9700141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.494+0000 7f96fffff640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f970014ce70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009ae0 tx=0x7f96e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f00a6da0 con 0x7f96e80039b0 2023-05-24T04:00:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f00a7450 con 0x7f96e80039b0 2023-05-24T04:00:18.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f00a77c0 con 0x7f96e80039b0 2023-05-24T04:00:18.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970014b010 con 0x7f96e80039b0 2023-05-24T04:00:18.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9700157380 con 0x7f96e80039b0 2023-05-24T04:00:18.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970014cbc0 con 0x7f96e80039b0 2023-05-24T04:00:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96f00a7920 con 0x7f96e80039b0 2023-05-24T04:00:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96fcff9640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f96ec066280 0x7f96ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96f011dc20 con 0x7f96e80039b0 2023-05-24T04:00:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96ff7fe640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f96ec066280 0x7f96ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.498+0000 7f96ff7fe640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f96ec066280 0x7f96ec068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96f40017b0 tx=0x7f96f40015e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.502+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f96f00eadb0 con 0x7f96e80039b0 2023-05-24T04:00:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.658+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f970014ecb0 con 0x7f96e80039b0 2023-05-24T04:00:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f96fcff9640 1 -- 172.21.15.40:0/1521562720 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f96f00be020 con 0x7f96e80039b0 2023-05-24T04:00:18.667 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:18.667 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:18.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f96ec066280 msgr2=0x7f96ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f96ec066280 0x7f96ec068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96f40017b0 tx=0x7f96f40015e0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 msgr2=0x7f970014ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f970014ce70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009ae0 tx=0x7f96e8005800 comp rx=0 tx=0).stop 2023-05-24T04:00:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 shutdown_connections 2023-05-24T04:00:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f96ec066280 0x7f96ec068730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.662+0000 7f97066b8640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97001eaae0 0x7f9700141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.666+0000 7f97066b8640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97001ea690 0x7f97001415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.666+0000 7f97066b8640 1 --2- 172.21.15.40:0/1521562720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96e80039b0 0x7f970014ce70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.666+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 >> 172.21.15.40:0/1521562720 conn(0x7f97000c0280 msgr2=0x7f9700071620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.666+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 shutdown_connections 2023-05-24T04:00:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.666+0000 7f97066b8640 1 -- 172.21.15.40:0/1521562720 wait complete. 2023-05-24T04:00:18.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:18.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 Processor -- start 2023-05-24T04:00:18.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 -- start start 2023-05-24T04:00:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff18c151c70 0x7ff18c152040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 0x7ff18c06bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c152580 con 0x7ff18c06c000 2023-05-24T04:00:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c06ee00 con 0x7ff18c151c70 2023-05-24T04:00:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff193b7a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0a5140 con 0x7ff18c0a3690 2023-05-24T04:00:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff18c06c000 0x7ff18c0a4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43502/0 (socket says 172.21.15.40:43502) 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 -- 172.21.15.40:0/3916376085 learned_addr learned my addr 172.21.15.40:0/3916376085 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff191916640 1 --2- 172.21.15.40:0/3916376085 >> v2:172.21.15.67:3300/0 conn(0x7ff18c151c70 0x7ff18c152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff191115640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 0x7ff18c06bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884973876 0 0) 0x7ff18c152580 con 0x7ff18c06c000 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff174003530 con 0x7ff18c06c000 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3617683777 0 0) 0x7ff174003530 con 0x7ff18c06c000 2023-05-24T04:00:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 msgr2=0x7ff18c06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 0x7ff18c06bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 >> v2:172.21.15.67:3300/0 conn(0x7ff18c151c70 msgr2=0x7ff18c152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 --2- 172.21.15.40:0/3916376085 >> v2:172.21.15.67:3300/0 conn(0x7ff18c151c70 0x7ff18c152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c152820 con 0x7ff18c06c000 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7ff17c001680 con 0x7ff18c06c000 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 >> v1:172.21.15.40:6789/0 conn(0x7ff18c06c000 legacy=0x7ff18c0a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 0x7ff174003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff174003f00 0x7ff1740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff174004d10 0x7ff174005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c06ee00 con 0x7ff174004d10 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0a5140 con 0x7ff174003f00 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17400b990 con 0x7ff18c0a3690 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff174004d10 0x7ff174005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff191115640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff174003f00 0x7ff1740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff191916640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 0x7ff174003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 -- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 msgr2=0x7ff174003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff18c0a3690 0x7ff174003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 -- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff174003f00 msgr2=0x7ff1740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff174003f00 0x7ff1740047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.802+0000 7ff192117640 1 -- 172.21.15.40:0/3916376085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff174003530 con 0x7ff174004d10 2023-05-24T04:00:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff174004d10 0x7ff174005180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff18c071e80 tx=0x7ff17c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e92f6966aaca8cb server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0a5910 con 0x7ff174004d10 2023-05-24T04:00:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0a5a70 con 0x7ff174004d10 2023-05-24T04:00:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff190914640 1 -- 172.21.15.40:0/3916376085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0a5e20 con 0x7ff174004d10 2023-05-24T04:00:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- 172.21.15.40:0/3916376085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff174004d10 msgr2=0x7ff174005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 --2- 172.21.15.40:0/3916376085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff174004d10 0x7ff174005180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff18c071e80 tx=0x7ff17c01cca0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 -- 172.21.15.40:0/3916376085 reap_dead start 2023-05-24T04:00:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- 172.21.15.40:0/3916376085 shutdown_connections 2023-05-24T04:00:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- 172.21.15.40:0/3916376085 >> 172.21.15.40:0/3916376085 conn(0x7ff18c0c0280 msgr2=0x7ff18c0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- 172.21.15.40:0/3916376085 shutdown_connections 2023-05-24T04:00:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- 172.21.15.40:0/3916376085 wait complete. 2023-05-24T04:00:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 Processor -- start 2023-05-24T04:00:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- start start 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff174004d10 0x7ff18c0bb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0a2480 0x7ff18c151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 0x7ff18c0b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0bb9a0 con 0x7ff18c0b9510 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c1e7250 con 0x7ff18c0a2480 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff193b7a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c1516a0 con 0x7ff174004d10 2023-05-24T04:00:18.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 0x7ff18c0b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 0x7ff18c0b9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39838/0 (socket says 172.21.15.40:39838) 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 -- 172.21.15.40:0/1595937190 learned_addr learned my addr 172.21.15.40:0/1595937190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff191916640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff174004d10 0x7ff18c0bb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff191115640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0a2480 0x7ff18c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 -- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff174004d10 msgr2=0x7ff18c0bb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff174004d10 0x7ff18c0bb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 -- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0a2480 msgr2=0x7ff18c151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0a2480 0x7ff18c151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.806+0000 7ff192117640 1 -- 172.21.15.40:0/1595937190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0bc970 con 0x7ff18c0b9510 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff192117640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 0x7ff18c0b9980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff17c01cad0 tx=0x7ff174005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c004c00 con 0x7ff18c0b9510 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c001670 con 0x7ff18c0b9510 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c06ea20 con 0x7ff18c0b9510 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c001c90 con 0x7ff18c0b9510 2023-05-24T04:00:18.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c0bcb00 con 0x7ff18c0b9510 2023-05-24T04:00:18.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c04ddd0 con 0x7ff18c0b9510 2023-05-24T04:00:18.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff17c0070d0 con 0x7ff18c0b9510 2023-05-24T04:00:18.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff1827fc640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff178066280 0x7ff178068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:18.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff17c11d7f0 con 0x7ff18c0b9510 2023-05-24T04:00:18.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff191916640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff178066280 0x7ff178068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:18.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.810+0000 7ff191916640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff178066280 0x7ff178068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff184009ab0 tx=0x7ff184008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:18.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.814+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff17c0eaa10 con 0x7ff18c0b9510 2023-05-24T04:00:18.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.970+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff18c1e7390 con 0x7ff18c0b9510 2023-05-24T04:00:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.974+0000 7ff1827fc640 1 -- 172.21.15.40:0/1595937190 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7ff17c0ee030 con 0x7ff18c0b9510 2023-05-24T04:00:18.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:18.980 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff178066280 msgr2=0x7ff178068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff178066280 0x7ff178068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff184009ab0 tx=0x7ff184008040 comp rx=0 tx=0).stop 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 msgr2=0x7ff18c0b9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 0x7ff18c0b9980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff17c01cad0 tx=0x7ff174005800 comp rx=0 tx=0).stop 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 shutdown_connections 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff178066280 0x7ff178068730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b9510 0x7ff18c0b9980 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0a2480 0x7ff18c151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 --2- 172.21.15.40:0/1595937190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff174004d10 0x7ff18c0bb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:18.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 >> 172.21.15.40:0/1595937190 conn(0x7ff18c0c0280 msgr2=0x7ff18c152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:18.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 shutdown_connections 2023-05-24T04:00:18.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:18.978+0000 7ff193b7a640 1 -- 172.21.15.40:0/1595937190 wait complete. 2023-05-24T04:00:18.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-24T04:00:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 Processor -- start 2023-05-24T04:00:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 -- start start 2023-05-24T04:00:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c0bedc0 0x7f523c0bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0c4080 0x7f523c0c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f523c0c0e30 0x7f523c06ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0a37f0 con 0x7f523c0bedc0 2023-05-24T04:00:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0a3a90 con 0x7f523c0c0e30 2023-05-24T04:00:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f52418bb640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0aa610 con 0x7f523c0c4080 2023-05-24T04:00:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c0bedc0 0x7f523c0bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c0bedc0 0x7f523c0bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39850/0 (socket says 172.21.15.40:39850) 2023-05-24T04:00:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 -- 172.21.15.40:0/4088297220 learned_addr learned my addr 172.21.15.40:0/4088297220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523a7fc640 1 --2- 172.21.15.40:0/4088297220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0c4080 0x7f523c0c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523b7fe640 1 --2- 172.21.15.40:0/4088297220 >> v2:172.21.15.67:3300/0 conn(0x7f523c0c0e30 0x7f523c06ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 -- 172.21.15.40:0/4088297220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0c4080 msgr2=0x7f523c0c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:19.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 --2- 172.21.15.40:0/4088297220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0c4080 0x7f523c0c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 -- 172.21.15.40:0/4088297220 >> v2:172.21.15.67:3300/0 conn(0x7f523c0c0e30 msgr2=0x7f523c06ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:19.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 --2- 172.21.15.40:0/4088297220 >> v2:172.21.15.67:3300/0 conn(0x7f523c0c0e30 0x7f523c06ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523affd640 1 -- 172.21.15.40:0/4088297220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c0c44e0 con 0x7f523c0bedc0 2023-05-24T04:00:19.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.114+0000 7f523b7fe640 1 --2- 172.21.15.40:0/4088297220 >> v2:172.21.15.67:3300/0 conn(0x7f523c0c0e30 0x7f523c06ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:19.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523affd640 1 --2- 172.21.15.40:0/4088297220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0bedc0 0x7f523c0bf190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f523c0a73d0 tx=0x7f523401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548a313c27254ca8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f5239ffb640 1 -- 172.21.15.40:0/4088297220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340a5650 con 0x7f523c0bedc0 2023-05-24T04:00:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f5239ffb640 1 -- 172.21.15.40:0/4088297220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340a57b0 con 0x7f523c0bedc0 2023-05-24T04:00:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f5239ffb640 1 -- 172.21.15.40:0/4088297220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340a5b40 con 0x7f523c0bedc0 2023-05-24T04:00:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/4088297220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0bedc0 msgr2=0x7f523c0bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- 172.21.15.40:0/4088297220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0bedc0 0x7f523c0bf190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f523c0a73d0 tx=0x7f523401c9d0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/4088297220 shutdown_connections 2023-05-24T04:00:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- 172.21.15.40:0/4088297220 >> v2:172.21.15.67:3300/0 conn(0x7f523c0c0e30 0x7f523c06ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- 172.21.15.40:0/4088297220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0c4080 0x7f523c0c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- 172.21.15.40:0/4088297220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0bedc0 0x7f523c0bf190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/4088297220 >> 172.21.15.40:0/4088297220 conn(0x7f523c0a6340 msgr2=0x7f523c0a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/4088297220 shutdown_connections 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/4088297220 wait complete. 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 Processor -- start 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- start start 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0bedc0 0x7f523c0b9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 0x7f523c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f523c0c4080 0x7f523c0a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c14bcd0 con 0x7f523c0c0e30 2023-05-24T04:00:19.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0bc380 con 0x7f523c0c4080 2023-05-24T04:00:19.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0a4ce0 con 0x7f523c0bedc0 2023-05-24T04:00:19.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 0x7f523c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 0x7f523c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39852/0 (socket says 172.21.15.40:39852) 2023-05-24T04:00:19.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 -- 172.21.15.40:0/1890521498 learned_addr learned my addr 172.21.15.40:0/1890521498 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:19.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523b7fe640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f523c0c4080 0x7f523c0a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 -- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0bedc0 msgr2=0x7f523c0b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0bedc0 0x7f523c0b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 -- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f523c0c4080 msgr2=0x7f523c0a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f523c0c4080 0x7f523c0a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 -- 172.21.15.40:0/1890521498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009b30 con 0x7f523c0c0e30 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f523a7fc640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 0x7f523c14b790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f522400d800 tx=0x7f522400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400b6c0 con 0x7f523c0c0e30 2023-05-24T04:00:19.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400b820 con 0x7f523c0c0e30 2023-05-24T04:00:19.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c0a40f0 con 0x7f523c0c0e30 2023-05-24T04:00:19.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400bb90 con 0x7f523c0c0e30 2023-05-24T04:00:19.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.118+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c0a3f60 con 0x7f523c0c0e30 2023-05-24T04:00:19.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.122+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c151f90 con 0x7f523c0c0e30 2023-05-24T04:00:19.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.122+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f522400bcf0 con 0x7f523c0c0e30 2023-05-24T04:00:19.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.122+0000 7f5233fff640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5220066280 0x7f5220068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.122+0000 7f523affd640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5220066280 0x7f5220068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.122+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52240845a0 con 0x7f523c0c0e30 2023-05-24T04:00:19.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.122+0000 7f523affd640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5220066280 0x7f5220068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52340ae000 tx=0x7f5234004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.126+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f52240551b0 con 0x7f523c0c0e30 2023-05-24T04:00:19.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.314+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f523c04ddd0 con 0x7f523c0c0e30 2023-05-24T04:00:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.318+0000 7f5233fff640 1 -- 172.21.15.40:0/1890521498 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5224054d40 con 0x7f523c0c0e30 2023-05-24T04:00:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5220066280 msgr2=0x7f5220068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5220066280 0x7f5220068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52340ae000 tx=0x7f5234004ac0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 msgr2=0x7f523c14b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 0x7f523c14b790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f522400d800 tx=0x7f522400dcc0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 shutdown_connections 2023-05-24T04:00:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5220066280 0x7f5220068730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f523c0c4080 0x7f523c0a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0c0e30 0x7f523c14b790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 --2- 172.21.15.40:0/1890521498 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f523c0bedc0 0x7f523c0b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 >> 172.21.15.40:0/1890521498 conn(0x7f523c0a6340 msgr2=0x7f523c0a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 shutdown_connections 2023-05-24T04:00:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.322+0000 7f52418bb640 1 -- 172.21.15.40:0/1890521498 wait complete. 2023-05-24T04:00:19.341 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-24T04:00:19.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-24T04:00:19.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 Processor -- start 2023-05-24T04:00:19.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 -- start start 2023-05-24T04:00:19.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17c00bedc0 0x7f17c00bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17c00c1000 0x7f17c0151f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c00a3a90 con 0x7f17c00c4080 2023-05-24T04:00:19.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c00a37f0 con 0x7f17c00bedc0 2023-05-24T04:00:19.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c87c5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c00aa610 con 0x7f17c00c1000 2023-05-24T04:00:19.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17c00bedc0 0x7f17c00bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17c00bedc0 0x7f17c00bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39864/0 (socket says 172.21.15.40:39864) 2023-05-24T04:00:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 -- 172.21.15.40:0/2234176087 learned_addr learned my addr 172.21.15.40:0/2234176087 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6d62640 1 --2- 172.21.15.40:0/2234176087 >> v2:172.21.15.67:3300/0 conn(0x7f17c00c1000 0x7f17c0151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 -- 172.21.15.40:0/2234176087 >> v2:172.21.15.67:3300/0 conn(0x7f17c00c1000 msgr2=0x7f17c0151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 --2- 172.21.15.40:0/2234176087 >> v2:172.21.15.67:3300/0 conn(0x7f17c00c1000 0x7f17c0151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 -- 172.21.15.40:0/2234176087 >> v1:172.21.15.67:6789/0 conn(0x7f17c00c4080 legacy=0x7f17c00c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:19.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.466+0000 7f17c6561640 1 -- 172.21.15.40:0/2234176087 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c00c44e0 con 0x7f17c00bedc0 2023-05-24T04:00:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6561640 1 --2- 172.21.15.40:0/2234176087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00bedc0 0x7f17c00bf190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17c008a800 tx=0x7f17bc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327c39daa9843fbe server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c555f640 1 -- 172.21.15.40:0/2234176087 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0ab600 con 0x7f17c00bedc0 2023-05-24T04:00:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c555f640 1 -- 172.21.15.40:0/2234176087 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0a7050 con 0x7f17c00bedc0 2023-05-24T04:00:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c555f640 1 -- 172.21.15.40:0/2234176087 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0ab980 con 0x7f17c00bedc0 2023-05-24T04:00:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- 172.21.15.40:0/2234176087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00bedc0 msgr2=0x7f17c00bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 --2- 172.21.15.40:0/2234176087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00bedc0 0x7f17c00bf190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17c008a800 tx=0x7f17bc01c240 comp rx=0 tx=0).stop 2023-05-24T04:00:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- 172.21.15.40:0/2234176087 shutdown_connections 2023-05-24T04:00:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 --2- 172.21.15.40:0/2234176087 >> v2:172.21.15.67:3300/0 conn(0x7f17c00c1000 0x7f17c0151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 --2- 172.21.15.40:0/2234176087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00bedc0 0x7f17c00bf190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- 172.21.15.40:0/2234176087 >> 172.21.15.40:0/2234176087 conn(0x7f17c00a6340 msgr2=0x7f17c00a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- 172.21.15.40:0/2234176087 shutdown_connections 2023-05-24T04:00:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- 172.21.15.40:0/2234176087 wait complete. 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 Processor -- start 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- start start 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17c00bedc0 0x7f17c00bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17c00c1000 0x7f17c0154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 0x7f17c01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00a55a0 con 0x7f17c00c4080 2023-05-24T04:00:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01e6c10 con 0x7f17c00c1000 2023-05-24T04:00:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c87c5640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01547d0 con 0x7f17c00bedc0 2023-05-24T04:00:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 0x7f17c01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 0x7f17c01585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39870/0 (socket says 172.21.15.40:39870) 2023-05-24T04:00:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 -- 172.21.15.40:0/3273713528 learned_addr learned my addr 172.21.15.40:0/3273713528 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6561640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17c00bedc0 0x7f17c00bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c5d60640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17c00c1000 0x7f17c0154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 -- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17c00bedc0 msgr2=0x7f17c00bce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17c00bedc0 0x7f17c00bce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 -- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17c00c1000 msgr2=0x7f17c0154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17c00c1000 0x7f17c0154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 -- 172.21.15.40:0/3273713528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc0094d0 con 0x7f17c00c4080 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17c6d62640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 0x7f17c01585b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f17b8007e60 tx=0x7f17b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8014420 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80145a0 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.470+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8014950 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c00a40f0 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c00a3f60 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c00c13d0 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17b8014ab0 con 0x7f17c00c4080 2023-05-24T04:00:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17b6ffd640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f17a4066280 0x7f17a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17c6561640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f17a4066280 0x7f17a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17b80848b0 con 0x7f17c00c4080 2023-05-24T04:00:19.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.474+0000 7f17c6561640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f17a4066280 0x7f17a4068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ad000 tx=0x7f17bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.478+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f17b8055560 con 0x7f17c00c4080 2023-05-24T04:00:19.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.658+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f17c004ddd0 con 0x7f17c00c4080 2023-05-24T04:00:19.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17b6ffd640 1 -- 172.21.15.40:0/3273713528 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f17b80550f0 con 0x7f17c00c4080 2023-05-24T04:00:19.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f17a4066280 msgr2=0x7f17a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f17a4066280 0x7f17a4068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ad000 tx=0x7f17bc008040 comp rx=0 tx=0).stop 2023-05-24T04:00:19.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 msgr2=0x7f17c01585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 0x7f17c01585b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f17b8007e60 tx=0x7f17b800e4b0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 shutdown_connections 2023-05-24T04:00:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f17a4066280 0x7f17a4068730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c4080 0x7f17c01585b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17c00c1000 0x7f17c0154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 --2- 172.21.15.40:0/3273713528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17c00bedc0 0x7f17c00bce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 >> 172.21.15.40:0/3273713528 conn(0x7f17c00a6340 msgr2=0x7f17c0151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:19.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.666+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 shutdown_connections 2023-05-24T04:00:19.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.670+0000 7f17c87c5640 1 -- 172.21.15.40:0/3273713528 wait complete. 2023-05-24T04:00:19.688 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-24T04:00:19.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:00:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.798+0000 7fca4615c640 1 Processor -- start 2023-05-24T04:00:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.798+0000 7fca4615c640 1 -- start start 2023-05-24T04:00:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca4615c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca4014aa30 0x7fca40071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca4615c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fca400a3290 0x7fca40071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca4615c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4006ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca4615c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4006e810 con 0x7fca4014aa30 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca4615c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4014b240 con 0x7fca400a3290 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca4615c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4006ea20 con 0x7fca4014bfe0 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca4014aa30 0x7fca40071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca4014aa30 0x7fca40071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39880/0 (socket says 172.21.15.40:39880) 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 -- 172.21.15.40:0/2811372524 learned_addr learned my addr 172.21.15.40:0/2811372524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3effd640 1 --2- 172.21.15.40:0/2811372524 >> v2:172.21.15.67:3300/0 conn(0x7fca400a3290 0x7fca40071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3ffff640 1 --2- 172.21.15.40:0/2811372524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4006ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 -- 172.21.15.40:0/2811372524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 msgr2=0x7fca4006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 --2- 172.21.15.40:0/2811372524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4006ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 -- 172.21.15.40:0/2811372524 >> v2:172.21.15.67:3300/0 conn(0x7fca400a3290 msgr2=0x7fca40071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 --2- 172.21.15.40:0/2811372524 >> v2:172.21.15.67:3300/0 conn(0x7fca400a3290 0x7fca40071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 -- 172.21.15.40:0/2811372524 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4006bfa0 con 0x7fca4014aa30 2023-05-24T04:00:19.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3f7fe640 1 --2- 172.21.15.40:0/2811372524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca4014aa30 0x7fca40071100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca4006e2c0 tx=0x7fca3401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2543b47feaf014e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3e7fc640 1 -- 172.21.15.40:0/2811372524 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340ab600 con 0x7fca4014aa30 2023-05-24T04:00:19.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3e7fc640 1 -- 172.21.15.40:0/2811372524 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca340a7050 con 0x7fca4014aa30 2023-05-24T04:00:19.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.802+0000 7fca3e7fc640 1 -- 172.21.15.40:0/2811372524 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340ab980 con 0x7fca4014aa30 2023-05-24T04:00:19.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/2811372524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca4014aa30 msgr2=0x7fca40071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- 172.21.15.40:0/2811372524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca4014aa30 0x7fca40071100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca4006e2c0 tx=0x7fca3401c470 comp rx=0 tx=0).stop 2023-05-24T04:00:19.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/2811372524 shutdown_connections 2023-05-24T04:00:19.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- 172.21.15.40:0/2811372524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4006ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- 172.21.15.40:0/2811372524 >> v2:172.21.15.67:3300/0 conn(0x7fca400a3290 0x7fca40071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- 172.21.15.40:0/2811372524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca4014aa30 0x7fca40071100 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/2811372524 >> 172.21.15.40:0/2811372524 conn(0x7fca400c0280 msgr2=0x7fca400c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/2811372524 shutdown_connections 2023-05-24T04:00:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/2811372524 wait complete. 2023-05-24T04:00:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 Processor -- start 2023-05-24T04:00:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- start start 2023-05-24T04:00:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca4014aa30 0x7fca4013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 0x7fca4014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4014ff10 con 0x7fca401e7b20 2023-05-24T04:00:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40150330 con 0x7fca4014aa30 2023-05-24T04:00:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4014ca30 con 0x7fca4014bfe0 2023-05-24T04:00:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 0x7fca4014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 0x7fca4014cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39896/0 (socket says 172.21.15.40:39896) 2023-05-24T04:00:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 -- 172.21.15.40:0/1160645809 learned_addr learned my addr 172.21.15.40:0/1160645809 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3effd640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3f7fe640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca4014aa30 0x7fca4013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 -- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 msgr2=0x7fca4013f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4013f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 -- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca4014aa30 msgr2=0x7fca4013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca4014aa30 0x7fca4013ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 -- 172.21.15.40:0/1160645809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340094d0 con 0x7fca401e7b20 2023-05-24T04:00:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca3ffff640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 0x7fca4014cc20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fca38007e90 tx=0x7fca3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38014420 con 0x7fca401e7b20 2023-05-24T04:00:19.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca38014580 con 0x7fca401e7b20 2023-05-24T04:00:19.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4014e640 con 0x7fca401e7b20 2023-05-24T04:00:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38014930 con 0x7fca401e7b20 2023-05-24T04:00:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4014b010 con 0x7fca401e7b20 2023-05-24T04:00:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.806+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4014e7d0 con 0x7fca401e7b20 2023-05-24T04:00:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.810+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca38014a90 con 0x7fca401e7b20 2023-05-24T04:00:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.810+0000 7fca27fff640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fca2c0662b0 0x7fca2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.810+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fca380848c0 con 0x7fca401e7b20 2023-05-24T04:00:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.810+0000 7fca3f7fe640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fca2c0662b0 0x7fca2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.810+0000 7fca3f7fe640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fca2c0662b0 0x7fca2c068760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca400bdf10 tx=0x7fca34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:19.814+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fca380554d0 con 0x7fca401e7b20 2023-05-24T04:00:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.002+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca40150050 con 0x7fca401e7b20 2023-05-24T04:00:20.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.002+0000 7fca27fff640 1 -- 172.21.15.40:0/1160645809 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3291 (secure 0 0 0) 0x7fca40150050 con 0x7fca401e7b20 2023-05-24T04:00:20.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:20.007 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:19.661783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T04:00:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-05-24T04:00:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fca2c0662b0 msgr2=0x7fca2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fca2c0662b0 0x7fca2c068760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca400bdf10 tx=0x7fca34008040 comp rx=0 tx=0).stop 2023-05-24T04:00:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 msgr2=0x7fca4014cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 0x7fca4014cc20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fca38007e90 tx=0x7fca3800e4b0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 shutdown_connections 2023-05-24T04:00:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fca2c0662b0 0x7fca2c068760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca401e7b20 0x7fca4014cc20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca4014bfe0 0x7fca4013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 --2- 172.21.15.40:0/1160645809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca4014aa30 0x7fca4013ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 >> 172.21.15.40:0/1160645809 conn(0x7fca400c0280 msgr2=0x7fca4014ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 shutdown_connections 2023-05-24T04:00:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.006+0000 7fca4615c640 1 -- 172.21.15.40:0/1160645809 wait complete. 2023-05-24T04:00:20.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:20.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.138+0000 7f4bcaa97640 1 Processor -- start 2023-05-24T04:00:20.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.138+0000 7f4bcaa97640 1 -- start start 2023-05-24T04:00:20.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bcaa97640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4bc40be9b0 0x7f4bc41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bcaa97640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40bd630 con 0x7f4bc40c2690 2023-05-24T04:00:20.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bcaa97640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40bd070 con 0x7f4bc406e6d0 2023-05-24T04:00:20.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bcaa97640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc40bcb50 con 0x7f4bc40be9b0 2023-05-24T04:00:20.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc8833640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4bc40c2690 0x7f4bc406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43504/0 (socket says 172.21.15.40:43504) 2023-05-24T04:00:20.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc8833640 1 -- 172.21.15.40:0/3854977085 learned_addr learned my addr 172.21.15.40:0/3854977085 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:20.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701223790 0 0) 0x7f4bc40bd630 con 0x7f4bc40c2690 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb0003530 con 0x7f4bc40c2690 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc3fff640 1 --2- 172.21.15.40:0/3854977085 >> v2:172.21.15.67:3300/0 conn(0x7f4bc40be9b0 0x7f4bc41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2631463325 0 0) 0x7f4bb0003530 con 0x7f4bc40c2690 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 >> v2:172.21.15.67:3300/0 conn(0x7f4bc40be9b0 msgr2=0x7f4bc41505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 --2- 172.21.15.40:0/3854977085 >> v2:172.21.15.67:3300/0 conn(0x7f4bc40be9b0 0x7f4bc41505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 >> v1:172.21.15.67:6789/0 conn(0x7f4bc406e6d0 legacy=0x7f4bc414bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40bd2c0 con 0x7f4bc40c2690 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f4bb4001680 con 0x7f4bc40c2690 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 >> v1:172.21.15.40:6789/0 conn(0x7f4bc40c2690 legacy=0x7f4bc406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bb0003980 0x7f4bb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bb00047d0 0x7f4bb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40bcb50 con 0x7f4bb0005180 2023-05-24T04:00:20.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb000c090 con 0x7f4bb00047d0 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb000c250 con 0x7f4bb0003980 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc9034640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc8833640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bb0003980 0x7f4bb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc3fff640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bb00047d0 0x7f4bb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc9034640 1 -- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bb0003980 msgr2=0x7f4bb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc9034640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bb0003980 0x7f4bb0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc9034640 1 -- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bb00047d0 msgr2=0x7f4bb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:20.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc9034640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bb00047d0 0x7f4bb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.142+0000 7f4bc9034640 1 -- 172.21.15.40:0/3854977085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb0003530 con 0x7f4bb0005180 2023-05-24T04:00:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bc9034640 1 -- 172.21.15.40:0/3854977085 reap_dead start 2023-05-24T04:00:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bc9034640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bb000b990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001e70 tx=0x7f4bbc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b198e450932250c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc003b80 con 0x7f4bb0005180 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc003d20 con 0x7f4bb0005180 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bc37fe640 1 -- 172.21.15.40:0/3854977085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc005310 con 0x7f4bb0005180 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 -- 172.21.15.40:0/3854977085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 msgr2=0x7f4bb000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bb000b990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001e70 tx=0x7f4bbc01c760 comp rx=0 tx=0).stop 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 -- 172.21.15.40:0/3854977085 shutdown_connections 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/3854977085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bb000b990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 -- 172.21.15.40:0/3854977085 >> 172.21.15.40:0/3854977085 conn(0x7f4bc40726e0 msgr2=0x7f4bc40655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:20.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 -- 172.21.15.40:0/3854977085 shutdown_connections 2023-05-24T04:00:20.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.146+0000 7f4bcaa97640 1 -- 172.21.15.40:0/3854977085 wait complete. 2023-05-24T04:00:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 Processor -- start 2023-05-24T04:00:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- start start 2023-05-24T04:00:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bc40b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bc40b8320 0x7f4bc40c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bc40c0820 0x7f4bc41e4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4146c40 con 0x7f4bb0005180 2023-05-24T04:00:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4147140 con 0x7f4bc40b8320 2023-05-24T04:00:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40b7480 con 0x7f4bc40c0820 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bc40b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bc40b7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39916/0 (socket says 172.21.15.40:39916) 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 -- 172.21.15.40:0/212770588 learned_addr learned my addr 172.21.15.40:0/212770588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc9034640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bc40c0820 0x7f4bc41e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc3fff640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bc40b8320 0x7f4bc40c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 -- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bc40c0820 msgr2=0x7f4bc41e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bc40c0820 0x7f4bc41e4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 -- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bc40b8320 msgr2=0x7f4bc40c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bc40b8320 0x7f4bc40c02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 -- 172.21.15.40:0/212770588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40c2bf0 con 0x7f4bb0005180 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc8833640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bc40b7de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4012490 tx=0x7f4bb4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4014810 con 0x7f4bb0005180 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4014970 con 0x7f4bb0005180 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc40c2a60 con 0x7f4bb0005180 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4014d00 con 0x7f4bb0005180 2023-05-24T04:00:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc41505d0 con 0x7f4bb0005180 2023-05-24T04:00:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc4147380 con 0x7f4bb0005180 2023-05-24T04:00:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.150+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bb40153e0 con 0x7f4bb0005180 2023-05-24T04:00:20.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.154+0000 7f4bc17fa640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4ba4066280 0x7f4ba4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.154+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4bb4086aa0 con 0x7f4bb0005180 2023-05-24T04:00:20.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.154+0000 7f4bc3fff640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4ba4066280 0x7f4ba4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.154+0000 7f4bc3fff640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4ba4066280 0x7f4ba4068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40c0ea0 tx=0x7f4bac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.158+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4bb4053c20 con 0x7f4bb0005180 2023-05-24T04:00:20.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.306+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bc414bc90 con 0x7f4bb0005180 2023-05-24T04:00:20.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bc17fa640 1 -- 172.21.15.40:0/212770588 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f4bb401c090 con 0x7f4bb0005180 2023-05-24T04:00:20.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:20.315 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4ba4066280 msgr2=0x7f4ba4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4ba4066280 0x7f4ba4068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40c0ea0 tx=0x7f4bac008040 comp rx=0 tx=0).stop 2023-05-24T04:00:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 msgr2=0x7f4bc40b7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bc40b7de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4012490 tx=0x7f4bb4012950 comp rx=0 tx=0).stop 2023-05-24T04:00:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 shutdown_connections 2023-05-24T04:00:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4ba4066280 0x7f4ba4068730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4bc40c0820 0x7f4bc41e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bc40b8320 0x7f4bc40c02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 --2- 172.21.15.40:0/212770588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bb0005180 0x7f4bc40b7de0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 >> 172.21.15.40:0/212770588 conn(0x7f4bc40726e0 msgr2=0x7f4bc4148bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 shutdown_connections 2023-05-24T04:00:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.310+0000 7f4bcaa97640 1 -- 172.21.15.40:0/212770588 wait complete. 2023-05-24T04:00:20.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-24T04:00:20.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:00:20.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.438+0000 7f065e9c3640 1 Processor -- start 2023-05-24T04:00:20.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.438+0000 7f065e9c3640 1 -- start start 2023-05-24T04:00:20.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f065e9c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06580a3da0 0x7f06580c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f065e9c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580b8040 con 0x7f06580bef60 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f065e9c3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580b7df0 con 0x7f0658151e20 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f065e9c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580c4220 con 0x7f06580a3da0 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f0657fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f06580bef60 0x7f06580c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43508/0 (socket says 172.21.15.40:43508) 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f0657fff640 1 -- 172.21.15.40:0/2492540528 learned_addr learned my addr 172.21.15.40:0/2492540528 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f06577fe640 1 --2- 172.21.15.40:0/2492540528 >> v2:172.21.15.40:3300/0 conn(0x7f06580a3da0 0x7f06580c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f06577fe640 1 -- 172.21.15.40:0/2492540528 >> v1:172.21.15.67:6789/0 conn(0x7f0658151e20 legacy=0x7f06581522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f06577fe640 1 -- 172.21.15.40:0/2492540528 >> v1:172.21.15.40:6789/0 conn(0x7f06580bef60 legacy=0x7f06580c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f0656ffd640 1 -- 172.21.15.40:0/2492540528 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348397937 0 0) 0x7f0648001120 con 0x7f06580bef60 2023-05-24T04:00:20.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f06577fe640 1 -- 172.21.15.40:0/2492540528 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580a38d0 con 0x7f06580a3da0 2023-05-24T04:00:20.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f06577fe640 1 --2- 172.21.15.40:0/2492540528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06580c11c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0640009d90 tx=0x7f064001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d01ab719d41344 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f0656ffd640 1 -- 172.21.15.40:0/2492540528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06400a5880 con 0x7f06580a3da0 2023-05-24T04:00:20.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f0656ffd640 1 -- 172.21.15.40:0/2492540528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06400a59e0 con 0x7f06580a3da0 2023-05-24T04:00:20.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.442+0000 7f0656ffd640 1 -- 172.21.15.40:0/2492540528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06400a5d70 con 0x7f06580a3da0 2023-05-24T04:00:20.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2492540528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 msgr2=0x7f06580c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2492540528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06580c11c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0640009d90 tx=0x7f064001c860 comp rx=0 tx=0).stop 2023-05-24T04:00:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2492540528 shutdown_connections 2023-05-24T04:00:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2492540528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06580c11c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2492540528 >> 172.21.15.40:0/2492540528 conn(0x7f0658065bb0 msgr2=0x7f06580a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:20.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2492540528 shutdown_connections 2023-05-24T04:00:20.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2492540528 wait complete. 2023-05-24T04:00:20.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 Processor -- start 2023-05-24T04:00:20.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- start start 2023-05-24T04:00:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06581e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06580bef60 0x7f06580ba960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0658151e20 0x7f06580baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580b8580 con 0x7f06580a3da0 2023-05-24T04:00:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581eab20 con 0x7f06580bef60 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06581ea690 con 0x7f0658151e20 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06581e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06581e9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39940/0 (socket says 172.21.15.40:39940) 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 -- 172.21.15.40:0/2598425815 learned_addr learned my addr 172.21.15.40:0/2598425815 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f06577fe640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06580bef60 0x7f06580ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065cf60640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0658151e20 0x7f06580baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 -- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0658151e20 msgr2=0x7f06580baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0658151e20 0x7f06580baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 -- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06580bef60 msgr2=0x7f06580ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06580bef60 0x7f06580ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 -- 172.21.15.40:0/2598425815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640009a70 con 0x7f06580a3da0 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0657fff640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06581e9e40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f064800c7b0 tx=0x7f064800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480072d0 con 0x7f06580a3da0 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648007450 con 0x7f06580a3da0 2023-05-24T04:00:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06580bb5d0 con 0x7f06580a3da0 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480047f0 con 0x7f06580a3da0 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06580bb440 con 0x7f06580a3da0 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.446+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06580c3410 con 0x7f06580a3da0 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.450+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0648004950 con 0x7f06580a3da0 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.450+0000 7f0654ff9640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f063c066280 0x7f063c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.450+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0648083320 con 0x7f06580a3da0 2023-05-24T04:00:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.450+0000 7f06577fe640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f063c066280 0x7f063c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.450+0000 7f06577fe640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f063c066280 0x7f063c068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06400af000 tx=0x7f06400a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.454+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0648050540 con 0x7f06580a3da0 2023-05-24T04:00:20.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.602+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06580b8040 con 0x7f063c066280 2023-05-24T04:00:20.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.630+0000 7f0654ff9640 1 -- 172.21.15.40:0/2598425815 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367246 (secure 0 0 0) 0x7f06580b8040 con 0x7f063c066280 2023-05-24T04:00:20.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:20.644 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:00:20.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f063c066280 msgr2=0x7f063c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f063c066280 0x7f063c068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06400af000 tx=0x7f06400a7070 comp rx=0 tx=0).stop 2023-05-24T04:00:20.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 msgr2=0x7f06581e9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06581e9e40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f064800c7b0 tx=0x7f064800cc70 comp rx=0 tx=0).stop 2023-05-24T04:00:20.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 shutdown_connections 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f063c066280 0x7f063c068730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0658151e20 0x7f06580baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06580bef60 0x7f06580ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 --2- 172.21.15.40:0/2598425815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06580a3da0 0x7f06581e9e40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 >> 172.21.15.40:0/2598425815 conn(0x7f0658065bb0 msgr2=0x7f0658150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 shutdown_connections 2023-05-24T04:00:20.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.638+0000 7f065e9c3640 1 -- 172.21.15.40:0/2598425815 wait complete. 2023-05-24T04:00:20.663 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-05-24T04:00:20.527127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":146920,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827800,"statfs":{"total":773094113280,"available":772943667200,"internally_reserved":0,"allocated":3579904,"data_stored":2149222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005022"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672564+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:02.672564+0000","last_peered":"2023-05-24T04:00:02.672564+0000","last_clean":"2023-05-24T04:00:02.672564+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:02.672564+0000","last_undegraded":"2023-05-24T04:00:02.672564+0000","last_fullsized":"2023-05-24T04:00:02.672564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:48.464106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283617+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:03.283617+0000","last_peered":"2023-05-24T04:00:03.283617+0000","last_clean":"2023-05-24T04:00:03.283617+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:03.283617+0000","last_undegraded":"2023-05-24T04:00:03.283617+0000","last_fullsized":"2023-05-24T04:00:03.283617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328955+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:02.328955+0000","last_peered":"2023-05-24T04:00:02.328955+0000","last_clean":"2023-05-24T04:00:02.328955+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:02.328955+0000","last_undegraded":"2023-05-24T04:00:02.328955+0000","last_fullsized":"2023-05-24T04:00:02.328955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328599+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:02.328599+0000","last_peered":"2023-05-24T04:00:02.328599+0000","last_clean":"2023-05-24T04:00:02.328599+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:02.328599+0000","last_undegraded":"2023-05-24T04:00:02.328599+0000","last_fullsized":"2023-05-24T04:00:02.328599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363367+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:02.363367+0000","last_peered":"2023-05-24T04:00:02.363367+0000","last_clean":"2023-05-24T04:00:02.363367+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:02.363367+0000","last_undegraded":"2023-05-24T04:00:02.363367+0000","last_fullsized":"2023-05-24T04:00:02.363367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:34.290959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362509+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:02.362509+0000","last_peered":"2023-05-24T04:00:02.362509+0000","last_clean":"2023-05-24T04:00:02.362509+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:02.362509+0000","last_undegraded":"2023-05-24T04:00:02.362509+0000","last_fullsized":"2023-05-24T04:00:02.362509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284412+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:03.284412+0000","last_peered":"2023-05-24T04:00:03.284412+0000","last_clean":"2023-05-24T04:00:03.284412+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:03.284412+0000","last_undegraded":"2023-05-24T04:00:03.284412+0000","last_fullsized":"2023-05-24T04:00:03.284412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285038+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:03.285038+0000","last_peered":"2023-05-24T04:00:03.285038+0000","last_clean":"2023-05-24T04:00:03.285038+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:03.285038+0000","last_undegraded":"2023-05-24T04:00:03.285038+0000","last_fullsized":"2023-05-24T04:00:03.285038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329969+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:02.329969+0000","last_peered":"2023-05-24T04:00:02.329969+0000","last_clean":"2023-05-24T04:00:02.329969+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:02.329969+0000","last_undegraded":"2023-05-24T04:00:02.329969+0000","last_fullsized":"2023-05-24T04:00:02.329969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284437+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:03.284437+0000","last_peered":"2023-05-24T04:00:03.284437+0000","last_clean":"2023-05-24T04:00:03.284437+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:03.284437+0000","last_undegraded":"2023-05-24T04:00:03.284437+0000","last_fullsized":"2023-05-24T04:00:03.284437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:21.271231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283513+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:03.283513+0000","last_peered":"2023-05-24T04:00:03.283513+0000","last_clean":"2023-05-24T04:00:03.283513+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:03.283513+0000","last_undegraded":"2023-05-24T04:00:03.283513+0000","last_fullsized":"2023-05-24T04:00:03.283513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:26.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331682+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:02.331682+0000","last_peered":"2023-05-24T04:00:02.331682+0000","last_clean":"2023-05-24T04:00:02.331682+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:02.331682+0000","last_undegraded":"2023-05-24T04:00:02.331682+0000","last_fullsized":"2023-05-24T04:00:02.331682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:50.558794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673853+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:02.673853+0000","last_peered":"2023-05-24T04:00:02.673853+0000","last_clean":"2023-05-24T04:00:02.673853+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:02.673853+0000","last_undegraded":"2023-05-24T04:00:02.673853+0000","last_fullsized":"2023-05-24T04:00:02.673853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283535+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:03.283535+0000","last_peered":"2023-05-24T04:00:03.283535+0000","last_clean":"2023-05-24T04:00:03.283535+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:03.283535+0000","last_undegraded":"2023-05-24T04:00:03.283535+0000","last_fullsized":"2023-05-24T04:00:03.283535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:28.900435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326827+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:02.326827+0000","last_peered":"2023-05-24T04:00:02.326827+0000","last_clean":"2023-05-24T04:00:02.326827+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:02.326827+0000","last_undegraded":"2023-05-24T04:00:02.326827+0000","last_fullsized":"2023-05-24T04:00:02.326827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:49:51.893837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331409+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:02.331409+0000","last_peered":"2023-05-24T04:00:02.331409+0000","last_clean":"2023-05-24T04:00:02.331409+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:02.331409+0000","last_undegraded":"2023-05-24T04:00:02.331409+0000","last_fullsized":"2023-05-24T04:00:02.331409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330783+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:02.330783+0000","last_peered":"2023-05-24T04:00:02.330783+0000","last_clean":"2023-05-24T04:00:02.330783+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:02.330783+0000","last_undegraded":"2023-05-24T04:00:02.330783+0000","last_fullsized":"2023-05-24T04:00:02.330783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:54.808184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363065+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:02.363065+0000","last_peered":"2023-05-24T04:00:02.363065+0000","last_clean":"2023-05-24T04:00:02.363065+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:02.363065+0000","last_undegraded":"2023-05-24T04:00:02.363065+0000","last_fullsized":"2023-05-24T04:00:02.363065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:22.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333322+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:02.333322+0000","last_peered":"2023-05-24T04:00:02.333322+0000","last_clean":"2023-05-24T04:00:02.333322+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:02.333322+0000","last_undegraded":"2023-05-24T04:00:02.333322+0000","last_fullsized":"2023-05-24T04:00:02.333322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:00.634094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673332+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:02.673332+0000","last_peered":"2023-05-24T04:00:02.673332+0000","last_clean":"2023-05-24T04:00:02.673332+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:02.673332+0000","last_undegraded":"2023-05-24T04:00:02.673332+0000","last_fullsized":"2023-05-24T04:00:02.673332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282810+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:03.282810+0000","last_peered":"2023-05-24T04:00:03.282810+0000","last_clean":"2023-05-24T04:00:03.282810+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:03.282810+0000","last_undegraded":"2023-05-24T04:00:03.282810+0000","last_fullsized":"2023-05-24T04:00:03.282810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282862+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:03.282862+0000","last_peered":"2023-05-24T04:00:03.282862+0000","last_clean":"2023-05-24T04:00:03.282862+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:03.282862+0000","last_undegraded":"2023-05-24T04:00:03.282862+0000","last_fullsized":"2023-05-24T04:00:03.282862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:52.353037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362055+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:02.362055+0000","last_peered":"2023-05-24T04:00:02.362055+0000","last_clean":"2023-05-24T04:00:02.362055+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:02.362055+0000","last_undegraded":"2023-05-24T04:00:02.362055+0000","last_fullsized":"2023-05-24T04:00:02.362055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:20.968502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333722+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:02.333722+0000","last_peered":"2023-05-24T04:00:02.333722+0000","last_clean":"2023-05-24T04:00:02.333722+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:02.333722+0000","last_undegraded":"2023-05-24T04:00:02.333722+0000","last_fullsized":"2023-05-24T04:00:02.333722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:15:50.664698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362004+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:02.362004+0000","last_peered":"2023-05-24T04:00:02.362004+0000","last_clean":"2023-05-24T04:00:02.362004+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:02.362004+0000","last_undegraded":"2023-05-24T04:00:02.362004+0000","last_fullsized":"2023-05-24T04:00:02.362004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283773+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:03.283773+0000","last_peered":"2023-05-24T04:00:03.283773+0000","last_clean":"2023-05-24T04:00:03.283773+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:03.283773+0000","last_undegraded":"2023-05-24T04:00:03.283773+0000","last_fullsized":"2023-05-24T04:00:03.283773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330368+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:02.330368+0000","last_peered":"2023-05-24T04:00:02.330368+0000","last_clean":"2023-05-24T04:00:02.330368+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:02.330368+0000","last_undegraded":"2023-05-24T04:00:02.330368+0000","last_fullsized":"2023-05-24T04:00:02.330368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:48:28.342687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362251+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:02.362251+0000","last_peered":"2023-05-24T04:00:02.362251+0000","last_clean":"2023-05-24T04:00:02.362251+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:02.362251+0000","last_undegraded":"2023-05-24T04:00:02.362251+0000","last_fullsized":"2023-05-24T04:00:02.362251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285221+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:03.285221+0000","last_peered":"2023-05-24T04:00:03.285221+0000","last_clean":"2023-05-24T04:00:03.285221+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:03.285221+0000","last_undegraded":"2023-05-24T04:00:03.285221+0000","last_fullsized":"2023-05-24T04:00:03.285221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282396+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:03.282396+0000","last_peered":"2023-05-24T04:00:03.282396+0000","last_clean":"2023-05-24T04:00:03.282396+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:03.282396+0000","last_undegraded":"2023-05-24T04:00:03.282396+0000","last_fullsized":"2023-05-24T04:00:03.282396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:30.582812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285127+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:03.285127+0000","last_peered":"2023-05-24T04:00:03.285127+0000","last_clean":"2023-05-24T04:00:03.285127+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:03.285127+0000","last_undegraded":"2023-05-24T04:00:03.285127+0000","last_fullsized":"2023-05-24T04:00:03.285127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673675+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:02.673675+0000","last_peered":"2023-05-24T04:00:02.673675+0000","last_clean":"2023-05-24T04:00:02.673675+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:02.673675+0000","last_undegraded":"2023-05-24T04:00:02.673675+0000","last_fullsized":"2023-05-24T04:00:02.673675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:50:58.369856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362343+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:02.362343+0000","last_peered":"2023-05-24T04:00:02.362343+0000","last_clean":"2023-05-24T04:00:02.362343+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:02.362343+0000","last_undegraded":"2023-05-24T04:00:02.362343+0000","last_fullsized":"2023-05-24T04:00:02.362343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:07.609800+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:07.609800+0000","last_peered":"2023-05-24T04:00:07.609800+0000","last_clean":"2023-05-24T04:00:07.609800+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:07.609800+0000","last_undegraded":"2023-05-24T04:00:07.609800+0000","last_fullsized":"2023-05-24T04:00:07.609800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331855+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:02.331855+0000","last_peered":"2023-05-24T04:00:02.331855+0000","last_clean":"2023-05-24T04:00:02.331855+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:02.331855+0000","last_undegraded":"2023-05-24T04:00:02.331855+0000","last_fullsized":"2023-05-24T04:00:02.331855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:05:19.807337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672982+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:02.672982+0000","last_peered":"2023-05-24T04:00:02.672982+0000","last_clean":"2023-05-24T04:00:02.672982+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:02.672982+0000","last_undegraded":"2023-05-24T04:00:02.672982+0000","last_fullsized":"2023-05-24T04:00:02.672982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:15.871289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330236+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:02.330236+0000","last_peered":"2023-05-24T04:00:02.330236+0000","last_clean":"2023-05-24T04:00:02.330236+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:02.330236+0000","last_undegraded":"2023-05-24T04:00:02.330236+0000","last_fullsized":"2023-05-24T04:00:02.330236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333814+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:02.333814+0000","last_peered":"2023-05-24T04:00:02.333814+0000","last_clean":"2023-05-24T04:00:02.333814+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:02.333814+0000","last_undegraded":"2023-05-24T04:00:02.333814+0000","last_fullsized":"2023-05-24T04:00:02.333814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:44:04.775971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283220+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:03.283220+0000","last_peered":"2023-05-24T04:00:03.283220+0000","last_clean":"2023-05-24T04:00:03.283220+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:03.283220+0000","last_undegraded":"2023-05-24T04:00:03.283220+0000","last_fullsized":"2023-05-24T04:00:03.283220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.723109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361756+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:02.361756+0000","last_peered":"2023-05-24T04:00:02.361756+0000","last_clean":"2023-05-24T04:00:02.361756+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:02.361756+0000","last_undegraded":"2023-05-24T04:00:02.361756+0000","last_fullsized":"2023-05-24T04:00:02.361756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361923+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:02.361923+0000","last_peered":"2023-05-24T04:00:02.361923+0000","last_clean":"2023-05-24T04:00:02.361923+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:02.361923+0000","last_undegraded":"2023-05-24T04:00:02.361923+0000","last_fullsized":"2023-05-24T04:00:02.361923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674247+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:02.674247+0000","last_peered":"2023-05-24T04:00:02.674247+0000","last_clean":"2023-05-24T04:00:02.674247+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:02.674247+0000","last_undegraded":"2023-05-24T04:00:02.674247+0000","last_fullsized":"2023-05-24T04:00:02.674247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:16.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363505+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:02.363505+0000","last_peered":"2023-05-24T04:00:02.363505+0000","last_clean":"2023-05-24T04:00:02.363505+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:02.363505+0000","last_undegraded":"2023-05-24T04:00:02.363505+0000","last_fullsized":"2023-05-24T04:00:02.363505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:38.541927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329007+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:02.329007+0000","last_peered":"2023-05-24T04:00:02.329007+0000","last_clean":"2023-05-24T04:00:02.329007+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:02.329007+0000","last_undegraded":"2023-05-24T04:00:02.329007+0000","last_fullsized":"2023-05-24T04:00:02.329007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282793+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:03.282793+0000","last_peered":"2023-05-24T04:00:03.282793+0000","last_clean":"2023-05-24T04:00:03.282793+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:03.282793+0000","last_undegraded":"2023-05-24T04:00:03.282793+0000","last_fullsized":"2023-05-24T04:00:03.282793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285507+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:03.285507+0000","last_peered":"2023-05-24T04:00:03.285507+0000","last_clean":"2023-05-24T04:00:03.285507+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:03.285507+0000","last_undegraded":"2023-05-24T04:00:03.285507+0000","last_fullsized":"2023-05-24T04:00:03.285507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:08.607412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673339+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:02.673339+0000","last_peered":"2023-05-24T04:00:02.673339+0000","last_clean":"2023-05-24T04:00:02.673339+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:02.673339+0000","last_undegraded":"2023-05-24T04:00:02.673339+0000","last_fullsized":"2023-05-24T04:00:02.673339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:47:35.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331141+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:02.331141+0000","last_peered":"2023-05-24T04:00:02.331141+0000","last_clean":"2023-05-24T04:00:02.331141+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:02.331141+0000","last_undegraded":"2023-05-24T04:00:02.331141+0000","last_fullsized":"2023-05-24T04:00:02.331141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:23:57.729163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673806+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:02.673806+0000","last_peered":"2023-05-24T04:00:02.673806+0000","last_clean":"2023-05-24T04:00:02.673806+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:02.673806+0000","last_undegraded":"2023-05-24T04:00:02.673806+0000","last_fullsized":"2023-05-24T04:00:02.673806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673598+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:02.673598+0000","last_peered":"2023-05-24T04:00:02.673598+0000","last_clean":"2023-05-24T04:00:02.673598+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:02.673598+0000","last_undegraded":"2023-05-24T04:00:02.673598+0000","last_fullsized":"2023-05-24T04:00:02.673598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:07.555151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285023+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:03.285023+0000","last_peered":"2023-05-24T04:00:03.285023+0000","last_clean":"2023-05-24T04:00:03.285023+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:03.285023+0000","last_undegraded":"2023-05-24T04:00:03.285023+0000","last_fullsized":"2023-05-24T04:00:03.285023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282319+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:03.282319+0000","last_peered":"2023-05-24T04:00:03.282319+0000","last_clean":"2023-05-24T04:00:03.282319+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:03.282319+0000","last_undegraded":"2023-05-24T04:00:03.282319+0000","last_fullsized":"2023-05-24T04:00:03.282319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:51:01.780904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673177+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:02.673177+0000","last_peered":"2023-05-24T04:00:02.673177+0000","last_clean":"2023-05-24T04:00:02.673177+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:02.673177+0000","last_undegraded":"2023-05-24T04:00:02.673177+0000","last_fullsized":"2023-05-24T04:00:02.673177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:41.878236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332012+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:02.332012+0000","last_peered":"2023-05-24T04:00:02.332012+0000","last_clean":"2023-05-24T04:00:02.332012+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:02.332012+0000","last_undegraded":"2023-05-24T04:00:02.332012+0000","last_fullsized":"2023-05-24T04:00:02.332012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:09:21.966314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284283+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:03.284283+0000","last_peered":"2023-05-24T04:00:03.284283+0000","last_clean":"2023-05-24T04:00:03.284283+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:03.284283+0000","last_undegraded":"2023-05-24T04:00:03.284283+0000","last_fullsized":"2023-05-24T04:00:03.284283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:46.140598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282668+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:03.282668+0000","last_peered":"2023-05-24T04:00:03.282668+0000","last_clean":"2023-05-24T04:00:03.282668+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:03.282668+0000","last_undegraded":"2023-05-24T04:00:03.282668+0000","last_fullsized":"2023-05-24T04:00:03.282668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674153+0000","last_change":"2023-05-24T03:59:57.943601+0000","last_active":"2023-05-24T04:00:02.674153+0000","last_peered":"2023-05-24T04:00:02.674153+0000","last_clean":"2023-05-24T04:00:02.674153+0000","last_became_active":"2023-05-24T03:59:57.943293+0000","last_became_peered":"2023-05-24T03:59:57.943293+0000","last_unstale":"2023-05-24T04:00:02.674153+0000","last_undegraded":"2023-05-24T04:00:02.674153+0000","last_fullsized":"2023-05-24T04:00:02.674153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672507+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:02.672507+0000","last_peered":"2023-05-24T04:00:02.672507+0000","last_clean":"2023-05-24T04:00:02.672507+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:02.672507+0000","last_undegraded":"2023-05-24T04:00:02.672507+0000","last_fullsized":"2023-05-24T04:00:02.672507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:47:44.006595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326439+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:02.326439+0000","last_peered":"2023-05-24T04:00:02.326439+0000","last_clean":"2023-05-24T04:00:02.326439+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:02.326439+0000","last_undegraded":"2023-05-24T04:00:02.326439+0000","last_fullsized":"2023-05-24T04:00:02.326439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:21.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326937+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:02.326937+0000","last_peered":"2023-05-24T04:00:02.326937+0000","last_clean":"2023-05-24T04:00:02.326937+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:02.326937+0000","last_undegraded":"2023-05-24T04:00:02.326937+0000","last_fullsized":"2023-05-24T04:00:02.326937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:49.486454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282960+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:03.282960+0000","last_peered":"2023-05-24T04:00:03.282960+0000","last_clean":"2023-05-24T04:00:03.282960+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:03.282960+0000","last_undegraded":"2023-05-24T04:00:03.282960+0000","last_fullsized":"2023-05-24T04:00:03.282960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281634+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:03.281634+0000","last_peered":"2023-05-24T04:00:03.281634+0000","last_clean":"2023-05-24T04:00:03.281634+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:03.281634+0000","last_undegraded":"2023-05-24T04:00:03.281634+0000","last_fullsized":"2023-05-24T04:00:03.281634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282747+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:03.282747+0000","last_peered":"2023-05-24T04:00:03.282747+0000","last_clean":"2023-05-24T04:00:03.282747+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:03.282747+0000","last_undegraded":"2023-05-24T04:00:03.282747+0000","last_fullsized":"2023-05-24T04:00:03.282747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:43.884737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285575+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:03.285575+0000","last_peered":"2023-05-24T04:00:03.285575+0000","last_clean":"2023-05-24T04:00:03.285575+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:03.285575+0000","last_undegraded":"2023-05-24T04:00:03.285575+0000","last_fullsized":"2023-05-24T04:00:03.285575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333304+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:02.333304+0000","last_peered":"2023-05-24T04:00:02.333304+0000","last_clean":"2023-05-24T04:00:02.333304+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:02.333304+0000","last_undegraded":"2023-05-24T04:00:02.333304+0000","last_fullsized":"2023-05-24T04:00:02.333304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:28:34.017147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362742+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:02.362742+0000","last_peered":"2023-05-24T04:00:02.362742+0000","last_clean":"2023-05-24T04:00:02.362742+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:02.362742+0000","last_undegraded":"2023-05-24T04:00:02.362742+0000","last_fullsized":"2023-05-24T04:00:02.362742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284681+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:03.284681+0000","last_peered":"2023-05-24T04:00:03.284681+0000","last_clean":"2023-05-24T04:00:03.284681+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:03.284681+0000","last_undegraded":"2023-05-24T04:00:03.284681+0000","last_fullsized":"2023-05-24T04:00:03.284681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:24.858148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283099+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:03.283099+0000","last_peered":"2023-05-24T04:00:03.283099+0000","last_clean":"2023-05-24T04:00:03.283099+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:03.283099+0000","last_undegraded":"2023-05-24T04:00:03.283099+0000","last_fullsized":"2023-05-24T04:00:03.283099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.224030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283187+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:03.283187+0000","last_peered":"2023-05-24T04:00:03.283187+0000","last_clean":"2023-05-24T04:00:03.283187+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:03.283187+0000","last_undegraded":"2023-05-24T04:00:03.283187+0000","last_fullsized":"2023-05-24T04:00:03.283187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:31.149121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674192+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:02.674192+0000","last_peered":"2023-05-24T04:00:02.674192+0000","last_clean":"2023-05-24T04:00:02.674192+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:02.674192+0000","last_undegraded":"2023-05-24T04:00:02.674192+0000","last_fullsized":"2023-05-24T04:00:02.674192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362180+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:02.362180+0000","last_peered":"2023-05-24T04:00:02.362180+0000","last_clean":"2023-05-24T04:00:02.362180+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:02.362180+0000","last_undegraded":"2023-05-24T04:00:02.362180+0000","last_fullsized":"2023-05-24T04:00:02.362180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:50.182886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331311+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:02.331311+0000","last_peered":"2023-05-24T04:00:02.331311+0000","last_clean":"2023-05-24T04:00:02.331311+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:02.331311+0000","last_undegraded":"2023-05-24T04:00:02.331311+0000","last_fullsized":"2023-05-24T04:00:02.331311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:23.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331513+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:02.331513+0000","last_peered":"2023-05-24T04:00:02.331513+0000","last_clean":"2023-05-24T04:00:02.331513+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:02.331513+0000","last_undegraded":"2023-05-24T04:00:02.331513+0000","last_fullsized":"2023-05-24T04:00:02.331513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330561+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:02.330561+0000","last_peered":"2023-05-24T04:00:02.330561+0000","last_clean":"2023-05-24T04:00:02.330561+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:02.330561+0000","last_undegraded":"2023-05-24T04:00:02.330561+0000","last_fullsized":"2023-05-24T04:00:02.330561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:31.974554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285241+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:03.285241+0000","last_peered":"2023-05-24T04:00:03.285241+0000","last_clean":"2023-05-24T04:00:03.285241+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:03.285241+0000","last_undegraded":"2023-05-24T04:00:03.285241+0000","last_fullsized":"2023-05-24T04:00:03.285241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:17.075712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330946+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:02.330946+0000","last_peered":"2023-05-24T04:00:02.330946+0000","last_clean":"2023-05-24T04:00:02.330946+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:02.330946+0000","last_undegraded":"2023-05-24T04:00:02.330946+0000","last_fullsized":"2023-05-24T04:00:02.330946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332083+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:02.332083+0000","last_peered":"2023-05-24T04:00:02.332083+0000","last_clean":"2023-05-24T04:00:02.332083+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:02.332083+0000","last_undegraded":"2023-05-24T04:00:02.332083+0000","last_fullsized":"2023-05-24T04:00:02.332083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:42.657478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672804+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:02.672804+0000","last_peered":"2023-05-24T04:00:02.672804+0000","last_clean":"2023-05-24T04:00:02.672804+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:02.672804+0000","last_undegraded":"2023-05-24T04:00:02.672804+0000","last_fullsized":"2023-05-24T04:00:02.672804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:29.691457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332202+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:02.332202+0000","last_peered":"2023-05-24T04:00:02.332202+0000","last_clean":"2023-05-24T04:00:02.332202+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:02.332202+0000","last_undegraded":"2023-05-24T04:00:02.332202+0000","last_fullsized":"2023-05-24T04:00:02.332202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:53.899808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362667+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:02.362667+0000","last_peered":"2023-05-24T04:00:02.362667+0000","last_clean":"2023-05-24T04:00:02.362667+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:02.362667+0000","last_undegraded":"2023-05-24T04:00:02.362667+0000","last_fullsized":"2023-05-24T04:00:02.362667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326499+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:02.326499+0000","last_peered":"2023-05-24T04:00:02.326499+0000","last_clean":"2023-05-24T04:00:02.326499+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:02.326499+0000","last_undegraded":"2023-05-24T04:00:02.326499+0000","last_fullsized":"2023-05-24T04:00:02.326499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:58.397535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282498+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:03.282498+0000","last_peered":"2023-05-24T04:00:03.282498+0000","last_clean":"2023-05-24T04:00:03.282498+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:03.282498+0000","last_undegraded":"2023-05-24T04:00:03.282498+0000","last_fullsized":"2023-05-24T04:00:03.282498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283868+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:03.283868+0000","last_peered":"2023-05-24T04:00:03.283868+0000","last_clean":"2023-05-24T04:00:03.283868+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:03.283868+0000","last_undegraded":"2023-05-24T04:00:03.283868+0000","last_fullsized":"2023-05-24T04:00:03.283868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:47.927025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326480+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:02.326480+0000","last_peered":"2023-05-24T04:00:02.326480+0000","last_clean":"2023-05-24T04:00:02.326480+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:02.326480+0000","last_undegraded":"2023-05-24T04:00:02.326480+0000","last_fullsized":"2023-05-24T04:00:02.326480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:28:04.663781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331449+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:02.331449+0000","last_peered":"2023-05-24T04:00:02.331449+0000","last_clean":"2023-05-24T04:00:02.331449+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:02.331449+0000","last_undegraded":"2023-05-24T04:00:02.331449+0000","last_fullsized":"2023-05-24T04:00:02.331449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:51:07.300738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285444+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:03.285444+0000","last_peered":"2023-05-24T04:00:03.285444+0000","last_clean":"2023-05-24T04:00:03.285444+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:03.285444+0000","last_undegraded":"2023-05-24T04:00:03.285444+0000","last_fullsized":"2023-05-24T04:00:03.285444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326235+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:02.326235+0000","last_peered":"2023-05-24T04:00:02.326235+0000","last_clean":"2023-05-24T04:00:02.326235+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:02.326235+0000","last_undegraded":"2023-05-24T04:00:02.326235+0000","last_fullsized":"2023-05-24T04:00:02.326235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:37.831392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329749+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:02.329749+0000","last_peered":"2023-05-24T04:00:02.329749+0000","last_clean":"2023-05-24T04:00:02.329749+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:02.329749+0000","last_undegraded":"2023-05-24T04:00:02.329749+0000","last_fullsized":"2023-05-24T04:00:02.329749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:46.939599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285009+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:03.285009+0000","last_peered":"2023-05-24T04:00:03.285009+0000","last_clean":"2023-05-24T04:00:03.285009+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:03.285009+0000","last_undegraded":"2023-05-24T04:00:03.285009+0000","last_fullsized":"2023-05-24T04:00:03.285009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326958+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:02.326958+0000","last_peered":"2023-05-24T04:00:02.326958+0000","last_clean":"2023-05-24T04:00:02.326958+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:02.326958+0000","last_undegraded":"2023-05-24T04:00:02.326958+0000","last_fullsized":"2023-05-24T04:00:02.326958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:18:48.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282592+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:03.282592+0000","last_peered":"2023-05-24T04:00:03.282592+0000","last_clean":"2023-05-24T04:00:03.282592+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:03.282592+0000","last_undegraded":"2023-05-24T04:00:03.282592+0000","last_fullsized":"2023-05-24T04:00:03.282592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:24.952669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285821+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:03.285821+0000","last_peered":"2023-05-24T04:00:03.285821+0000","last_clean":"2023-05-24T04:00:03.285821+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:03.285821+0000","last_undegraded":"2023-05-24T04:00:03.285821+0000","last_fullsized":"2023-05-24T04:00:03.285821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:20.609741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283124+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:03.283124+0000","last_peered":"2023-05-24T04:00:03.283124+0000","last_clean":"2023-05-24T04:00:03.283124+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:03.283124+0000","last_undegraded":"2023-05-24T04:00:03.283124+0000","last_fullsized":"2023-05-24T04:00:03.283124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283719+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:03.283719+0000","last_peered":"2023-05-24T04:00:03.283719+0000","last_clean":"2023-05-24T04:00:03.283719+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:03.283719+0000","last_undegraded":"2023-05-24T04:00:03.283719+0000","last_fullsized":"2023-05-24T04:00:03.283719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:43.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329762+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:02.329762+0000","last_peered":"2023-05-24T04:00:02.329762+0000","last_clean":"2023-05-24T04:00:02.329762+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:02.329762+0000","last_undegraded":"2023-05-24T04:00:02.329762+0000","last_fullsized":"2023-05-24T04:00:02.329762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:56:59.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363323+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:02.363323+0000","last_peered":"2023-05-24T04:00:02.363323+0000","last_clean":"2023-05-24T04:00:02.363323+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:02.363323+0000","last_undegraded":"2023-05-24T04:00:02.363323+0000","last_fullsized":"2023-05-24T04:00:02.363323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:13.664663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363303+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:02.363303+0000","last_peered":"2023-05-24T04:00:02.363303+0000","last_clean":"2023-05-24T04:00:02.363303+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:02.363303+0000","last_undegraded":"2023-05-24T04:00:02.363303+0000","last_fullsized":"2023-05-24T04:00:02.363303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283798+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:03.283798+0000","last_peered":"2023-05-24T04:00:03.283798+0000","last_clean":"2023-05-24T04:00:03.283798+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:03.283798+0000","last_undegraded":"2023-05-24T04:00:03.283798+0000","last_fullsized":"2023-05-24T04:00:03.283798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283107+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:03.283107+0000","last_peered":"2023-05-24T04:00:03.283107+0000","last_clean":"2023-05-24T04:00:03.283107+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:03.283107+0000","last_undegraded":"2023-05-24T04:00:03.283107+0000","last_fullsized":"2023-05-24T04:00:03.283107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281988+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:03.281988+0000","last_peered":"2023-05-24T04:00:03.281988+0000","last_clean":"2023-05-24T04:00:03.281988+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:03.281988+0000","last_undegraded":"2023-05-24T04:00:03.281988+0000","last_fullsized":"2023-05-24T04:00:03.281988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:12.761189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284815+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:03.284815+0000","last_peered":"2023-05-24T04:00:03.284815+0000","last_clean":"2023-05-24T04:00:03.284815+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:03.284815+0000","last_undegraded":"2023-05-24T04:00:03.284815+0000","last_fullsized":"2023-05-24T04:00:03.284815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:31.585428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362908+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:02.362908+0000","last_peered":"2023-05-24T04:00:02.362908+0000","last_clean":"2023-05-24T04:00:02.362908+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:02.362908+0000","last_undegraded":"2023-05-24T04:00:02.362908+0000","last_fullsized":"2023-05-24T04:00:02.362908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:39.263590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283473+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:03.283473+0000","last_peered":"2023-05-24T04:00:03.283473+0000","last_clean":"2023-05-24T04:00:03.283473+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:03.283473+0000","last_undegraded":"2023-05-24T04:00:03.283473+0000","last_fullsized":"2023-05-24T04:00:03.283473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:48.939524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363256+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:02.363256+0000","last_peered":"2023-05-24T04:00:02.363256+0000","last_clean":"2023-05-24T04:00:02.363256+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:02.363256+0000","last_undegraded":"2023-05-24T04:00:02.363256+0000","last_fullsized":"2023-05-24T04:00:02.363256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:29.382612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283979+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:03.283979+0000","last_peered":"2023-05-24T04:00:03.283979+0000","last_clean":"2023-05-24T04:00:03.283979+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:03.283979+0000","last_undegraded":"2023-05-24T04:00:03.283979+0000","last_fullsized":"2023-05-24T04:00:03.283979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329457+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:02.329457+0000","last_peered":"2023-05-24T04:00:02.329457+0000","last_clean":"2023-05-24T04:00:02.329457+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:02.329457+0000","last_undegraded":"2023-05-24T04:00:02.329457+0000","last_fullsized":"2023-05-24T04:00:02.329457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:06:39.129747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362046+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:02.362046+0000","last_peered":"2023-05-24T04:00:02.362046+0000","last_clean":"2023-05-24T04:00:02.362046+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:02.362046+0000","last_undegraded":"2023-05-24T04:00:02.362046+0000","last_fullsized":"2023-05-24T04:00:02.362046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330454+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:02.330454+0000","last_peered":"2023-05-24T04:00:02.330454+0000","last_clean":"2023-05-24T04:00:02.330454+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:02.330454+0000","last_undegraded":"2023-05-24T04:00:02.330454+0000","last_fullsized":"2023-05-24T04:00:02.330454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:26.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362536+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:02.362536+0000","last_peered":"2023-05-24T04:00:02.362536+0000","last_clean":"2023-05-24T04:00:02.362536+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:02.362536+0000","last_undegraded":"2023-05-24T04:00:02.362536+0000","last_fullsized":"2023-05-24T04:00:02.362536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673473+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:02.673473+0000","last_peered":"2023-05-24T04:00:02.673473+0000","last_clean":"2023-05-24T04:00:02.673473+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:02.673473+0000","last_undegraded":"2023-05-24T04:00:02.673473+0000","last_fullsized":"2023-05-24T04:00:02.673473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:13.776152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284495+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:03.284495+0000","last_peered":"2023-05-24T04:00:03.284495+0000","last_clean":"2023-05-24T04:00:03.284495+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:03.284495+0000","last_undegraded":"2023-05-24T04:00:03.284495+0000","last_fullsized":"2023-05-24T04:00:03.284495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673918+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:02.673918+0000","last_peered":"2023-05-24T04:00:02.673918+0000","last_clean":"2023-05-24T04:00:02.673918+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:02.673918+0000","last_undegraded":"2023-05-24T04:00:02.673918+0000","last_fullsized":"2023-05-24T04:00:02.673918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674024+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:02.674024+0000","last_peered":"2023-05-24T04:00:02.674024+0000","last_clean":"2023-05-24T04:00:02.674024+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:02.674024+0000","last_undegraded":"2023-05-24T04:00:02.674024+0000","last_fullsized":"2023-05-24T04:00:02.674024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282709+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:03.282709+0000","last_peered":"2023-05-24T04:00:03.282709+0000","last_clean":"2023-05-24T04:00:03.282709+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:03.282709+0000","last_undegraded":"2023-05-24T04:00:03.282709+0000","last_fullsized":"2023-05-24T04:00:03.282709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361920+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:02.361920+0000","last_peered":"2023-05-24T04:00:02.361920+0000","last_clean":"2023-05-24T04:00:02.361920+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:02.361920+0000","last_undegraded":"2023-05-24T04:00:02.361920+0000","last_fullsized":"2023-05-24T04:00:02.361920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282020+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:03.282020+0000","last_peered":"2023-05-24T04:00:03.282020+0000","last_clean":"2023-05-24T04:00:03.282020+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:03.282020+0000","last_undegraded":"2023-05-24T04:00:03.282020+0000","last_fullsized":"2023-05-24T04:00:03.282020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:12.612403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283275+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:03.283275+0000","last_peered":"2023-05-24T04:00:03.283275+0000","last_clean":"2023-05-24T04:00:03.283275+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:03.283275+0000","last_undegraded":"2023-05-24T04:00:03.283275+0000","last_fullsized":"2023-05-24T04:00:03.283275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331904+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:02.331904+0000","last_peered":"2023-05-24T04:00:02.331904+0000","last_clean":"2023-05-24T04:00:02.331904+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:02.331904+0000","last_undegraded":"2023-05-24T04:00:02.331904+0000","last_fullsized":"2023-05-24T04:00:02.331904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:26:07.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326634+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:02.326634+0000","last_peered":"2023-05-24T04:00:02.326634+0000","last_clean":"2023-05-24T04:00:02.326634+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:02.326634+0000","last_undegraded":"2023-05-24T04:00:02.326634+0000","last_fullsized":"2023-05-24T04:00:02.326634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:23:41.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331187+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:02.331187+0000","last_peered":"2023-05-24T04:00:02.331187+0000","last_clean":"2023-05-24T04:00:02.331187+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:02.331187+0000","last_undegraded":"2023-05-24T04:00:02.331187+0000","last_fullsized":"2023-05-24T04:00:02.331187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:20.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283457+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:03.283457+0000","last_peered":"2023-05-24T04:00:03.283457+0000","last_clean":"2023-05-24T04:00:03.283457+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:03.283457+0000","last_undegraded":"2023-05-24T04:00:03.283457+0000","last_fullsized":"2023-05-24T04:00:03.283457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328836+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:02.328836+0000","last_peered":"2023-05-24T04:00:02.328836+0000","last_clean":"2023-05-24T04:00:02.328836+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:02.328836+0000","last_undegraded":"2023-05-24T04:00:02.328836+0000","last_fullsized":"2023-05-24T04:00:02.328836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:22.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283484+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:03.283484+0000","last_peered":"2023-05-24T04:00:03.283484+0000","last_clean":"2023-05-24T04:00:03.283484+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:03.283484+0000","last_undegraded":"2023-05-24T04:00:03.283484+0000","last_fullsized":"2023-05-24T04:00:03.283484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283949+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:03.283949+0000","last_peered":"2023-05-24T04:00:03.283949+0000","last_clean":"2023-05-24T04:00:03.283949+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:03.283949+0000","last_undegraded":"2023-05-24T04:00:03.283949+0000","last_fullsized":"2023-05-24T04:00:03.283949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326231+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:02.326231+0000","last_peered":"2023-05-24T04:00:02.326231+0000","last_clean":"2023-05-24T04:00:02.326231+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:02.326231+0000","last_undegraded":"2023-05-24T04:00:02.326231+0000","last_fullsized":"2023-05-24T04:00:02.326231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:08:53.915635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326785+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:02.326785+0000","last_peered":"2023-05-24T04:00:02.326785+0000","last_clean":"2023-05-24T04:00:02.326785+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:02.326785+0000","last_undegraded":"2023-05-24T04:00:02.326785+0000","last_fullsized":"2023-05-24T04:00:02.326785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:35:05.345944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330585+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:02.330585+0000","last_peered":"2023-05-24T04:00:02.330585+0000","last_clean":"2023-05-24T04:00:02.330585+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:02.330585+0000","last_undegraded":"2023-05-24T04:00:02.330585+0000","last_fullsized":"2023-05-24T04:00:02.330585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284900+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:03.284900+0000","last_peered":"2023-05-24T04:00:03.284900+0000","last_clean":"2023-05-24T04:00:03.284900+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:03.284900+0000","last_undegraded":"2023-05-24T04:00:03.284900+0000","last_fullsized":"2023-05-24T04:00:03.284900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:17.860183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283198+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:03.283198+0000","last_peered":"2023-05-24T04:00:03.283198+0000","last_clean":"2023-05-24T04:00:03.283198+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:03.283198+0000","last_undegraded":"2023-05-24T04:00:03.283198+0000","last_fullsized":"2023-05-24T04:00:03.283198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282366+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:03.282366+0000","last_peered":"2023-05-24T04:00:03.282366+0000","last_clean":"2023-05-24T04:00:03.282366+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:03.282366+0000","last_undegraded":"2023-05-24T04:00:03.282366+0000","last_fullsized":"2023-05-24T04:00:03.282366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283141+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:03.283141+0000","last_peered":"2023-05-24T04:00:03.283141+0000","last_clean":"2023-05-24T04:00:03.283141+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:03.283141+0000","last_undegraded":"2023-05-24T04:00:03.283141+0000","last_fullsized":"2023-05-24T04:00:03.283141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329420+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:02.329420+0000","last_peered":"2023-05-24T04:00:02.329420+0000","last_clean":"2023-05-24T04:00:02.329420+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:02.329420+0000","last_undegraded":"2023-05-24T04:00:02.329420+0000","last_fullsized":"2023-05-24T04:00:02.329420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283341+0000","last_change":"2023-05-24T03:59:57.913975+0000","last_active":"2023-05-24T04:00:03.283341+0000","last_peered":"2023-05-24T04:00:03.283341+0000","last_clean":"2023-05-24T04:00:03.283341+0000","last_became_active":"2023-05-24T03:59:57.913528+0000","last_became_peered":"2023-05-24T03:59:57.913528+0000","last_unstale":"2023-05-24T04:00:03.283341+0000","last_undegraded":"2023-05-24T04:00:03.283341+0000","last_fullsized":"2023-05-24T04:00:03.283341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333140+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:02.333140+0000","last_peered":"2023-05-24T04:00:02.333140+0000","last_clean":"2023-05-24T04:00:02.333140+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:02.333140+0000","last_undegraded":"2023-05-24T04:00:02.333140+0000","last_fullsized":"2023-05-24T04:00:02.333140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:29.390853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330279+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:02.330279+0000","last_peered":"2023-05-24T04:00:02.330279+0000","last_clean":"2023-05-24T04:00:02.330279+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:02.330279+0000","last_undegraded":"2023-05-24T04:00:02.330279+0000","last_fullsized":"2023-05-24T04:00:02.330279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284322+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:03.284322+0000","last_peered":"2023-05-24T04:00:03.284322+0000","last_clean":"2023-05-24T04:00:03.284322+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:03.284322+0000","last_undegraded":"2023-05-24T04:00:03.284322+0000","last_fullsized":"2023-05-24T04:00:03.284322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326738+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:02.326738+0000","last_peered":"2023-05-24T04:00:02.326738+0000","last_clean":"2023-05-24T04:00:02.326738+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:02.326738+0000","last_undegraded":"2023-05-24T04:00:02.326738+0000","last_fullsized":"2023-05-24T04:00:02.326738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:18:29.367916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":714326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18220,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353620,"statfs":{"total":96636764160,"available":96618106880,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":123798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18216,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353624,"statfs":{"total":96636764160,"available":96618110976,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18796,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353044,"statfs":{"total":96636764160,"available":96617517056,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:00:20.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:00:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.822+0000 7f241b84b640 1 Processor -- start 2023-05-24T04:00:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.822+0000 7f241b84b640 1 -- start start 2023-05-24T04:00:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241414aa30 0x7f2414071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24140a3290 0x7f2414071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241414b240 con 0x7f241414bfe0 2023-05-24T04:00:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241406e810 con 0x7f24140a3290 2023-05-24T04:00:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241406ea20 con 0x7f241414aa30 2023-05-24T04:00:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24140a3290 0x7f2414071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24140a3290 0x7f2414071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39950/0 (socket says 172.21.15.40:39950) 2023-05-24T04:00:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 -- 172.21.15.40:0/214300868 learned_addr learned my addr 172.21.15.40:0/214300868 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f24195e7640 1 --2- 172.21.15.40:0/214300868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241414aa30 0x7f2414071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f240bfff640 1 -- 172.21.15.40:0/214300868 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469402980 0 0) 0x7f241414b240 con 0x7f241414bfe0 2023-05-24T04:00:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f240bfff640 1 -- 172.21.15.40:0/214300868 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2400003530 con 0x7f241414bfe0 2023-05-24T04:00:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 -- 172.21.15.40:0/214300868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241414aa30 msgr2=0x7f2414071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 --2- 172.21.15.40:0/214300868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241414aa30 0x7f2414071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 -- 172.21.15.40:0/214300868 >> v1:172.21.15.40:6789/0 conn(0x7f241414bfe0 legacy=0x7f241406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 -- 172.21.15.40:0/214300868 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241406bfa0 con 0x7f24140a3290 2023-05-24T04:00:20.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f2418de6640 1 --2- 172.21.15.40:0/214300868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24140a3290 0x7f2414071640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2404009870 tx=0x7f240401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec57f6f3550bc33 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f240bfff640 1 -- 172.21.15.40:0/214300868 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24040ab650 con 0x7f24140a3290 2023-05-24T04:00:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f240bfff640 1 -- 172.21.15.40:0/214300868 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24040ab7b0 con 0x7f24140a3290 2023-05-24T04:00:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f240bfff640 1 -- 172.21.15.40:0/214300868 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24040abb20 con 0x7f24140a3290 2023-05-24T04:00:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- 172.21.15.40:0/214300868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24140a3290 msgr2=0x7f2414071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 --2- 172.21.15.40:0/214300868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24140a3290 0x7f2414071640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2404009870 tx=0x7f240401c540 comp rx=0 tx=0).stop 2023-05-24T04:00:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- 172.21.15.40:0/214300868 shutdown_connections 2023-05-24T04:00:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 --2- 172.21.15.40:0/214300868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24140a3290 0x7f2414071640 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 --2- 172.21.15.40:0/214300868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241414aa30 0x7f2414071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- 172.21.15.40:0/214300868 >> 172.21.15.40:0/214300868 conn(0x7f24140c0280 msgr2=0x7f24140c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- 172.21.15.40:0/214300868 shutdown_connections 2023-05-24T04:00:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.826+0000 7f241b84b640 1 -- 172.21.15.40:0/214300868 wait complete. 2023-05-24T04:00:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 Processor -- start 2023-05-24T04:00:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- start start 2023-05-24T04:00:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 0x7f241413ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241414bfe0 0x7f241413d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241413c6c0 0x7f241413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241414cc90 con 0x7f241414aa30 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241413c170 con 0x7f241414bfe0 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241413f210 con 0x7f241413c6c0 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 0x7f241413ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 0x7f241413ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39964/0 (socket says 172.21.15.40:39964) 2023-05-24T04:00:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 -- 172.21.15.40:0/1361050830 learned_addr learned my addr 172.21.15.40:0/1361050830 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f2419de8640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241413c6c0 0x7f241413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 -- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241413c6c0 msgr2=0x7f241413d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241413c6c0 0x7f241413d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 -- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241414bfe0 msgr2=0x7f241413d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241414bfe0 0x7f241413d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 -- 172.21.15.40:0/1361050830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040094d0 con 0x7f241414aa30 2023-05-24T04:00:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f24195e7640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 0x7f241413ecd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f241000d830 tx=0x7f241000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000b6c0 con 0x7f241414aa30 2023-05-24T04:00:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000b820 con 0x7f241414aa30 2023-05-24T04:00:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241414af90 con 0x7f241414aa30 2023-05-24T04:00:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000bbb0 con 0x7f241414aa30 2023-05-24T04:00:20.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241414ae00 con 0x7f241414aa30 2023-05-24T04:00:20.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.830+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24141561e0 con 0x7f241414aa30 2023-05-24T04:00:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.834+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f241001e460 con 0x7f241414aa30 2023-05-24T04:00:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.834+0000 7f2409ffb640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f80662b0 0x7f23f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.834+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2410084780 con 0x7f241414aa30 2023-05-24T04:00:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.834+0000 7f2418de6640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f80662b0 0x7f23f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.834+0000 7f2418de6640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f80662b0 0x7f23f8068760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24040af000 tx=0x7f2404008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.838+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2410051910 con 0x7f241414aa30 2023-05-24T04:00:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:20.982+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f241404ddd0 con 0x7f23f80662b0 2023-05-24T04:00:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.002+0000 7f2409ffb640 1 -- 172.21.15.40:0/1361050830 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367246 (secure 0 0 0) 0x7f241404ddd0 con 0x7f23f80662b0 2023-05-24T04:00:21.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:21.011 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:00:21.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f80662b0 msgr2=0x7f23f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f80662b0 0x7f23f8068760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24040af000 tx=0x7f2404008040 comp rx=0 tx=0).stop 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 msgr2=0x7f241413ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 0x7f241413ecd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f241000d830 tx=0x7f241000dcf0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 shutdown_connections 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f80662b0 0x7f23f8068760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f241413c6c0 0x7f241413d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241414bfe0 0x7f241413d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 --2- 172.21.15.40:0/1361050830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f241414aa30 0x7f241413ecd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 >> 172.21.15.40:0/1361050830 conn(0x7f24140c0280 msgr2=0x7f24141433f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 shutdown_connections 2023-05-24T04:00:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.006+0000 7f241b84b640 1 -- 172.21.15.40:0/1361050830 wait complete. 2023-05-24T04:00:21.028 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-05-24T04:00:20.527127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":146920,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827800,"statfs":{"total":773094113280,"available":772943667200,"internally_reserved":0,"allocated":3579904,"data_stored":2149222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005022"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672564+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:02.672564+0000","last_peered":"2023-05-24T04:00:02.672564+0000","last_clean":"2023-05-24T04:00:02.672564+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:02.672564+0000","last_undegraded":"2023-05-24T04:00:02.672564+0000","last_fullsized":"2023-05-24T04:00:02.672564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:48.464106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283617+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:03.283617+0000","last_peered":"2023-05-24T04:00:03.283617+0000","last_clean":"2023-05-24T04:00:03.283617+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:03.283617+0000","last_undegraded":"2023-05-24T04:00:03.283617+0000","last_fullsized":"2023-05-24T04:00:03.283617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328955+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:02.328955+0000","last_peered":"2023-05-24T04:00:02.328955+0000","last_clean":"2023-05-24T04:00:02.328955+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:02.328955+0000","last_undegraded":"2023-05-24T04:00:02.328955+0000","last_fullsized":"2023-05-24T04:00:02.328955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328599+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:02.328599+0000","last_peered":"2023-05-24T04:00:02.328599+0000","last_clean":"2023-05-24T04:00:02.328599+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:02.328599+0000","last_undegraded":"2023-05-24T04:00:02.328599+0000","last_fullsized":"2023-05-24T04:00:02.328599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363367+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:02.363367+0000","last_peered":"2023-05-24T04:00:02.363367+0000","last_clean":"2023-05-24T04:00:02.363367+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:02.363367+0000","last_undegraded":"2023-05-24T04:00:02.363367+0000","last_fullsized":"2023-05-24T04:00:02.363367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:34.290959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362509+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:02.362509+0000","last_peered":"2023-05-24T04:00:02.362509+0000","last_clean":"2023-05-24T04:00:02.362509+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:02.362509+0000","last_undegraded":"2023-05-24T04:00:02.362509+0000","last_fullsized":"2023-05-24T04:00:02.362509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284412+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:03.284412+0000","last_peered":"2023-05-24T04:00:03.284412+0000","last_clean":"2023-05-24T04:00:03.284412+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:03.284412+0000","last_undegraded":"2023-05-24T04:00:03.284412+0000","last_fullsized":"2023-05-24T04:00:03.284412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285038+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:03.285038+0000","last_peered":"2023-05-24T04:00:03.285038+0000","last_clean":"2023-05-24T04:00:03.285038+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:03.285038+0000","last_undegraded":"2023-05-24T04:00:03.285038+0000","last_fullsized":"2023-05-24T04:00:03.285038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329969+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:02.329969+0000","last_peered":"2023-05-24T04:00:02.329969+0000","last_clean":"2023-05-24T04:00:02.329969+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:02.329969+0000","last_undegraded":"2023-05-24T04:00:02.329969+0000","last_fullsized":"2023-05-24T04:00:02.329969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284437+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:03.284437+0000","last_peered":"2023-05-24T04:00:03.284437+0000","last_clean":"2023-05-24T04:00:03.284437+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:03.284437+0000","last_undegraded":"2023-05-24T04:00:03.284437+0000","last_fullsized":"2023-05-24T04:00:03.284437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:21.271231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283513+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:03.283513+0000","last_peered":"2023-05-24T04:00:03.283513+0000","last_clean":"2023-05-24T04:00:03.283513+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:03.283513+0000","last_undegraded":"2023-05-24T04:00:03.283513+0000","last_fullsized":"2023-05-24T04:00:03.283513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:26.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331682+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:02.331682+0000","last_peered":"2023-05-24T04:00:02.331682+0000","last_clean":"2023-05-24T04:00:02.331682+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:02.331682+0000","last_undegraded":"2023-05-24T04:00:02.331682+0000","last_fullsized":"2023-05-24T04:00:02.331682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:50.558794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673853+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:02.673853+0000","last_peered":"2023-05-24T04:00:02.673853+0000","last_clean":"2023-05-24T04:00:02.673853+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:02.673853+0000","last_undegraded":"2023-05-24T04:00:02.673853+0000","last_fullsized":"2023-05-24T04:00:02.673853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283535+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:03.283535+0000","last_peered":"2023-05-24T04:00:03.283535+0000","last_clean":"2023-05-24T04:00:03.283535+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:03.283535+0000","last_undegraded":"2023-05-24T04:00:03.283535+0000","last_fullsized":"2023-05-24T04:00:03.283535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:28.900435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326827+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:02.326827+0000","last_peered":"2023-05-24T04:00:02.326827+0000","last_clean":"2023-05-24T04:00:02.326827+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:02.326827+0000","last_undegraded":"2023-05-24T04:00:02.326827+0000","last_fullsized":"2023-05-24T04:00:02.326827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:49:51.893837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331409+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:02.331409+0000","last_peered":"2023-05-24T04:00:02.331409+0000","last_clean":"2023-05-24T04:00:02.331409+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:02.331409+0000","last_undegraded":"2023-05-24T04:00:02.331409+0000","last_fullsized":"2023-05-24T04:00:02.331409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330783+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:02.330783+0000","last_peered":"2023-05-24T04:00:02.330783+0000","last_clean":"2023-05-24T04:00:02.330783+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:02.330783+0000","last_undegraded":"2023-05-24T04:00:02.330783+0000","last_fullsized":"2023-05-24T04:00:02.330783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:54.808184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363065+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:02.363065+0000","last_peered":"2023-05-24T04:00:02.363065+0000","last_clean":"2023-05-24T04:00:02.363065+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:02.363065+0000","last_undegraded":"2023-05-24T04:00:02.363065+0000","last_fullsized":"2023-05-24T04:00:02.363065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:22.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333322+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:02.333322+0000","last_peered":"2023-05-24T04:00:02.333322+0000","last_clean":"2023-05-24T04:00:02.333322+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:02.333322+0000","last_undegraded":"2023-05-24T04:00:02.333322+0000","last_fullsized":"2023-05-24T04:00:02.333322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:00.634094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673332+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:02.673332+0000","last_peered":"2023-05-24T04:00:02.673332+0000","last_clean":"2023-05-24T04:00:02.673332+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:02.673332+0000","last_undegraded":"2023-05-24T04:00:02.673332+0000","last_fullsized":"2023-05-24T04:00:02.673332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282810+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:03.282810+0000","last_peered":"2023-05-24T04:00:03.282810+0000","last_clean":"2023-05-24T04:00:03.282810+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:03.282810+0000","last_undegraded":"2023-05-24T04:00:03.282810+0000","last_fullsized":"2023-05-24T04:00:03.282810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282862+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:03.282862+0000","last_peered":"2023-05-24T04:00:03.282862+0000","last_clean":"2023-05-24T04:00:03.282862+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:03.282862+0000","last_undegraded":"2023-05-24T04:00:03.282862+0000","last_fullsized":"2023-05-24T04:00:03.282862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:52.353037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362055+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:02.362055+0000","last_peered":"2023-05-24T04:00:02.362055+0000","last_clean":"2023-05-24T04:00:02.362055+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:02.362055+0000","last_undegraded":"2023-05-24T04:00:02.362055+0000","last_fullsized":"2023-05-24T04:00:02.362055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:20.968502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333722+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:02.333722+0000","last_peered":"2023-05-24T04:00:02.333722+0000","last_clean":"2023-05-24T04:00:02.333722+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:02.333722+0000","last_undegraded":"2023-05-24T04:00:02.333722+0000","last_fullsized":"2023-05-24T04:00:02.333722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:15:50.664698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362004+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:02.362004+0000","last_peered":"2023-05-24T04:00:02.362004+0000","last_clean":"2023-05-24T04:00:02.362004+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:02.362004+0000","last_undegraded":"2023-05-24T04:00:02.362004+0000","last_fullsized":"2023-05-24T04:00:02.362004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283773+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:03.283773+0000","last_peered":"2023-05-24T04:00:03.283773+0000","last_clean":"2023-05-24T04:00:03.283773+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:03.283773+0000","last_undegraded":"2023-05-24T04:00:03.283773+0000","last_fullsized":"2023-05-24T04:00:03.283773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330368+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:02.330368+0000","last_peered":"2023-05-24T04:00:02.330368+0000","last_clean":"2023-05-24T04:00:02.330368+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:02.330368+0000","last_undegraded":"2023-05-24T04:00:02.330368+0000","last_fullsized":"2023-05-24T04:00:02.330368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:48:28.342687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362251+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:02.362251+0000","last_peered":"2023-05-24T04:00:02.362251+0000","last_clean":"2023-05-24T04:00:02.362251+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:02.362251+0000","last_undegraded":"2023-05-24T04:00:02.362251+0000","last_fullsized":"2023-05-24T04:00:02.362251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285221+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:03.285221+0000","last_peered":"2023-05-24T04:00:03.285221+0000","last_clean":"2023-05-24T04:00:03.285221+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:03.285221+0000","last_undegraded":"2023-05-24T04:00:03.285221+0000","last_fullsized":"2023-05-24T04:00:03.285221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282396+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:03.282396+0000","last_peered":"2023-05-24T04:00:03.282396+0000","last_clean":"2023-05-24T04:00:03.282396+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:03.282396+0000","last_undegraded":"2023-05-24T04:00:03.282396+0000","last_fullsized":"2023-05-24T04:00:03.282396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:30.582812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285127+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:03.285127+0000","last_peered":"2023-05-24T04:00:03.285127+0000","last_clean":"2023-05-24T04:00:03.285127+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:03.285127+0000","last_undegraded":"2023-05-24T04:00:03.285127+0000","last_fullsized":"2023-05-24T04:00:03.285127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673675+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:02.673675+0000","last_peered":"2023-05-24T04:00:02.673675+0000","last_clean":"2023-05-24T04:00:02.673675+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:02.673675+0000","last_undegraded":"2023-05-24T04:00:02.673675+0000","last_fullsized":"2023-05-24T04:00:02.673675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:50:58.369856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362343+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:02.362343+0000","last_peered":"2023-05-24T04:00:02.362343+0000","last_clean":"2023-05-24T04:00:02.362343+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:02.362343+0000","last_undegraded":"2023-05-24T04:00:02.362343+0000","last_fullsized":"2023-05-24T04:00:02.362343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:07.609800+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:07.609800+0000","last_peered":"2023-05-24T04:00:07.609800+0000","last_clean":"2023-05-24T04:00:07.609800+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:07.609800+0000","last_undegraded":"2023-05-24T04:00:07.609800+0000","last_fullsized":"2023-05-24T04:00:07.609800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331855+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:02.331855+0000","last_peered":"2023-05-24T04:00:02.331855+0000","last_clean":"2023-05-24T04:00:02.331855+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:02.331855+0000","last_undegraded":"2023-05-24T04:00:02.331855+0000","last_fullsized":"2023-05-24T04:00:02.331855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:05:19.807337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672982+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:02.672982+0000","last_peered":"2023-05-24T04:00:02.672982+0000","last_clean":"2023-05-24T04:00:02.672982+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:02.672982+0000","last_undegraded":"2023-05-24T04:00:02.672982+0000","last_fullsized":"2023-05-24T04:00:02.672982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:15.871289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330236+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:02.330236+0000","last_peered":"2023-05-24T04:00:02.330236+0000","last_clean":"2023-05-24T04:00:02.330236+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:02.330236+0000","last_undegraded":"2023-05-24T04:00:02.330236+0000","last_fullsized":"2023-05-24T04:00:02.330236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333814+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:02.333814+0000","last_peered":"2023-05-24T04:00:02.333814+0000","last_clean":"2023-05-24T04:00:02.333814+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:02.333814+0000","last_undegraded":"2023-05-24T04:00:02.333814+0000","last_fullsized":"2023-05-24T04:00:02.333814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:44:04.775971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283220+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:03.283220+0000","last_peered":"2023-05-24T04:00:03.283220+0000","last_clean":"2023-05-24T04:00:03.283220+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:03.283220+0000","last_undegraded":"2023-05-24T04:00:03.283220+0000","last_fullsized":"2023-05-24T04:00:03.283220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.723109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361756+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:02.361756+0000","last_peered":"2023-05-24T04:00:02.361756+0000","last_clean":"2023-05-24T04:00:02.361756+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:02.361756+0000","last_undegraded":"2023-05-24T04:00:02.361756+0000","last_fullsized":"2023-05-24T04:00:02.361756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361923+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:02.361923+0000","last_peered":"2023-05-24T04:00:02.361923+0000","last_clean":"2023-05-24T04:00:02.361923+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:02.361923+0000","last_undegraded":"2023-05-24T04:00:02.361923+0000","last_fullsized":"2023-05-24T04:00:02.361923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674247+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:02.674247+0000","last_peered":"2023-05-24T04:00:02.674247+0000","last_clean":"2023-05-24T04:00:02.674247+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:02.674247+0000","last_undegraded":"2023-05-24T04:00:02.674247+0000","last_fullsized":"2023-05-24T04:00:02.674247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:16.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363505+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:02.363505+0000","last_peered":"2023-05-24T04:00:02.363505+0000","last_clean":"2023-05-24T04:00:02.363505+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:02.363505+0000","last_undegraded":"2023-05-24T04:00:02.363505+0000","last_fullsized":"2023-05-24T04:00:02.363505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:38.541927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329007+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:02.329007+0000","last_peered":"2023-05-24T04:00:02.329007+0000","last_clean":"2023-05-24T04:00:02.329007+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:02.329007+0000","last_undegraded":"2023-05-24T04:00:02.329007+0000","last_fullsized":"2023-05-24T04:00:02.329007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282793+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:03.282793+0000","last_peered":"2023-05-24T04:00:03.282793+0000","last_clean":"2023-05-24T04:00:03.282793+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:03.282793+0000","last_undegraded":"2023-05-24T04:00:03.282793+0000","last_fullsized":"2023-05-24T04:00:03.282793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285507+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:03.285507+0000","last_peered":"2023-05-24T04:00:03.285507+0000","last_clean":"2023-05-24T04:00:03.285507+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:03.285507+0000","last_undegraded":"2023-05-24T04:00:03.285507+0000","last_fullsized":"2023-05-24T04:00:03.285507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:08.607412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673339+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:02.673339+0000","last_peered":"2023-05-24T04:00:02.673339+0000","last_clean":"2023-05-24T04:00:02.673339+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:02.673339+0000","last_undegraded":"2023-05-24T04:00:02.673339+0000","last_fullsized":"2023-05-24T04:00:02.673339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:47:35.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331141+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:02.331141+0000","last_peered":"2023-05-24T04:00:02.331141+0000","last_clean":"2023-05-24T04:00:02.331141+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:02.331141+0000","last_undegraded":"2023-05-24T04:00:02.331141+0000","last_fullsized":"2023-05-24T04:00:02.331141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:23:57.729163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673806+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:02.673806+0000","last_peered":"2023-05-24T04:00:02.673806+0000","last_clean":"2023-05-24T04:00:02.673806+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:02.673806+0000","last_undegraded":"2023-05-24T04:00:02.673806+0000","last_fullsized":"2023-05-24T04:00:02.673806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673598+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:02.673598+0000","last_peered":"2023-05-24T04:00:02.673598+0000","last_clean":"2023-05-24T04:00:02.673598+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:02.673598+0000","last_undegraded":"2023-05-24T04:00:02.673598+0000","last_fullsized":"2023-05-24T04:00:02.673598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:07.555151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285023+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:03.285023+0000","last_peered":"2023-05-24T04:00:03.285023+0000","last_clean":"2023-05-24T04:00:03.285023+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:03.285023+0000","last_undegraded":"2023-05-24T04:00:03.285023+0000","last_fullsized":"2023-05-24T04:00:03.285023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282319+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:03.282319+0000","last_peered":"2023-05-24T04:00:03.282319+0000","last_clean":"2023-05-24T04:00:03.282319+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:03.282319+0000","last_undegraded":"2023-05-24T04:00:03.282319+0000","last_fullsized":"2023-05-24T04:00:03.282319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:51:01.780904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673177+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:02.673177+0000","last_peered":"2023-05-24T04:00:02.673177+0000","last_clean":"2023-05-24T04:00:02.673177+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:02.673177+0000","last_undegraded":"2023-05-24T04:00:02.673177+0000","last_fullsized":"2023-05-24T04:00:02.673177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:41.878236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332012+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:02.332012+0000","last_peered":"2023-05-24T04:00:02.332012+0000","last_clean":"2023-05-24T04:00:02.332012+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:02.332012+0000","last_undegraded":"2023-05-24T04:00:02.332012+0000","last_fullsized":"2023-05-24T04:00:02.332012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:09:21.966314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284283+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:03.284283+0000","last_peered":"2023-05-24T04:00:03.284283+0000","last_clean":"2023-05-24T04:00:03.284283+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:03.284283+0000","last_undegraded":"2023-05-24T04:00:03.284283+0000","last_fullsized":"2023-05-24T04:00:03.284283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:46.140598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282668+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:03.282668+0000","last_peered":"2023-05-24T04:00:03.282668+0000","last_clean":"2023-05-24T04:00:03.282668+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:03.282668+0000","last_undegraded":"2023-05-24T04:00:03.282668+0000","last_fullsized":"2023-05-24T04:00:03.282668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674153+0000","last_change":"2023-05-24T03:59:57.943601+0000","last_active":"2023-05-24T04:00:02.674153+0000","last_peered":"2023-05-24T04:00:02.674153+0000","last_clean":"2023-05-24T04:00:02.674153+0000","last_became_active":"2023-05-24T03:59:57.943293+0000","last_became_peered":"2023-05-24T03:59:57.943293+0000","last_unstale":"2023-05-24T04:00:02.674153+0000","last_undegraded":"2023-05-24T04:00:02.674153+0000","last_fullsized":"2023-05-24T04:00:02.674153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672507+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:02.672507+0000","last_peered":"2023-05-24T04:00:02.672507+0000","last_clean":"2023-05-24T04:00:02.672507+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:02.672507+0000","last_undegraded":"2023-05-24T04:00:02.672507+0000","last_fullsized":"2023-05-24T04:00:02.672507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:47:44.006595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326439+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:02.326439+0000","last_peered":"2023-05-24T04:00:02.326439+0000","last_clean":"2023-05-24T04:00:02.326439+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:02.326439+0000","last_undegraded":"2023-05-24T04:00:02.326439+0000","last_fullsized":"2023-05-24T04:00:02.326439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:21.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326937+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:02.326937+0000","last_peered":"2023-05-24T04:00:02.326937+0000","last_clean":"2023-05-24T04:00:02.326937+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:02.326937+0000","last_undegraded":"2023-05-24T04:00:02.326937+0000","last_fullsized":"2023-05-24T04:00:02.326937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:49.486454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282960+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:03.282960+0000","last_peered":"2023-05-24T04:00:03.282960+0000","last_clean":"2023-05-24T04:00:03.282960+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:03.282960+0000","last_undegraded":"2023-05-24T04:00:03.282960+0000","last_fullsized":"2023-05-24T04:00:03.282960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281634+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:03.281634+0000","last_peered":"2023-05-24T04:00:03.281634+0000","last_clean":"2023-05-24T04:00:03.281634+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:03.281634+0000","last_undegraded":"2023-05-24T04:00:03.281634+0000","last_fullsized":"2023-05-24T04:00:03.281634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282747+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:03.282747+0000","last_peered":"2023-05-24T04:00:03.282747+0000","last_clean":"2023-05-24T04:00:03.282747+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:03.282747+0000","last_undegraded":"2023-05-24T04:00:03.282747+0000","last_fullsized":"2023-05-24T04:00:03.282747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:43.884737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285575+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:03.285575+0000","last_peered":"2023-05-24T04:00:03.285575+0000","last_clean":"2023-05-24T04:00:03.285575+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:03.285575+0000","last_undegraded":"2023-05-24T04:00:03.285575+0000","last_fullsized":"2023-05-24T04:00:03.285575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333304+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:02.333304+0000","last_peered":"2023-05-24T04:00:02.333304+0000","last_clean":"2023-05-24T04:00:02.333304+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:02.333304+0000","last_undegraded":"2023-05-24T04:00:02.333304+0000","last_fullsized":"2023-05-24T04:00:02.333304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:28:34.017147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362742+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:02.362742+0000","last_peered":"2023-05-24T04:00:02.362742+0000","last_clean":"2023-05-24T04:00:02.362742+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:02.362742+0000","last_undegraded":"2023-05-24T04:00:02.362742+0000","last_fullsized":"2023-05-24T04:00:02.362742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284681+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:03.284681+0000","last_peered":"2023-05-24T04:00:03.284681+0000","last_clean":"2023-05-24T04:00:03.284681+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:03.284681+0000","last_undegraded":"2023-05-24T04:00:03.284681+0000","last_fullsized":"2023-05-24T04:00:03.284681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:24.858148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283099+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:03.283099+0000","last_peered":"2023-05-24T04:00:03.283099+0000","last_clean":"2023-05-24T04:00:03.283099+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:03.283099+0000","last_undegraded":"2023-05-24T04:00:03.283099+0000","last_fullsized":"2023-05-24T04:00:03.283099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.224030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283187+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:03.283187+0000","last_peered":"2023-05-24T04:00:03.283187+0000","last_clean":"2023-05-24T04:00:03.283187+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:03.283187+0000","last_undegraded":"2023-05-24T04:00:03.283187+0000","last_fullsized":"2023-05-24T04:00:03.283187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:31.149121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674192+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:02.674192+0000","last_peered":"2023-05-24T04:00:02.674192+0000","last_clean":"2023-05-24T04:00:02.674192+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:02.674192+0000","last_undegraded":"2023-05-24T04:00:02.674192+0000","last_fullsized":"2023-05-24T04:00:02.674192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362180+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:02.362180+0000","last_peered":"2023-05-24T04:00:02.362180+0000","last_clean":"2023-05-24T04:00:02.362180+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:02.362180+0000","last_undegraded":"2023-05-24T04:00:02.362180+0000","last_fullsized":"2023-05-24T04:00:02.362180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:50.182886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331311+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:02.331311+0000","last_peered":"2023-05-24T04:00:02.331311+0000","last_clean":"2023-05-24T04:00:02.331311+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:02.331311+0000","last_undegraded":"2023-05-24T04:00:02.331311+0000","last_fullsized":"2023-05-24T04:00:02.331311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:23.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331513+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:02.331513+0000","last_peered":"2023-05-24T04:00:02.331513+0000","last_clean":"2023-05-24T04:00:02.331513+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:02.331513+0000","last_undegraded":"2023-05-24T04:00:02.331513+0000","last_fullsized":"2023-05-24T04:00:02.331513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330561+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:02.330561+0000","last_peered":"2023-05-24T04:00:02.330561+0000","last_clean":"2023-05-24T04:00:02.330561+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:02.330561+0000","last_undegraded":"2023-05-24T04:00:02.330561+0000","last_fullsized":"2023-05-24T04:00:02.330561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:31.974554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285241+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:03.285241+0000","last_peered":"2023-05-24T04:00:03.285241+0000","last_clean":"2023-05-24T04:00:03.285241+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:03.285241+0000","last_undegraded":"2023-05-24T04:00:03.285241+0000","last_fullsized":"2023-05-24T04:00:03.285241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:17.075712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330946+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:02.330946+0000","last_peered":"2023-05-24T04:00:02.330946+0000","last_clean":"2023-05-24T04:00:02.330946+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:02.330946+0000","last_undegraded":"2023-05-24T04:00:02.330946+0000","last_fullsized":"2023-05-24T04:00:02.330946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332083+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:02.332083+0000","last_peered":"2023-05-24T04:00:02.332083+0000","last_clean":"2023-05-24T04:00:02.332083+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:02.332083+0000","last_undegraded":"2023-05-24T04:00:02.332083+0000","last_fullsized":"2023-05-24T04:00:02.332083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:42.657478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672804+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:02.672804+0000","last_peered":"2023-05-24T04:00:02.672804+0000","last_clean":"2023-05-24T04:00:02.672804+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:02.672804+0000","last_undegraded":"2023-05-24T04:00:02.672804+0000","last_fullsized":"2023-05-24T04:00:02.672804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:29.691457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332202+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:02.332202+0000","last_peered":"2023-05-24T04:00:02.332202+0000","last_clean":"2023-05-24T04:00:02.332202+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:02.332202+0000","last_undegraded":"2023-05-24T04:00:02.332202+0000","last_fullsized":"2023-05-24T04:00:02.332202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:53.899808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362667+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:02.362667+0000","last_peered":"2023-05-24T04:00:02.362667+0000","last_clean":"2023-05-24T04:00:02.362667+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:02.362667+0000","last_undegraded":"2023-05-24T04:00:02.362667+0000","last_fullsized":"2023-05-24T04:00:02.362667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326499+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:02.326499+0000","last_peered":"2023-05-24T04:00:02.326499+0000","last_clean":"2023-05-24T04:00:02.326499+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:02.326499+0000","last_undegraded":"2023-05-24T04:00:02.326499+0000","last_fullsized":"2023-05-24T04:00:02.326499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:58.397535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282498+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:03.282498+0000","last_peered":"2023-05-24T04:00:03.282498+0000","last_clean":"2023-05-24T04:00:03.282498+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:03.282498+0000","last_undegraded":"2023-05-24T04:00:03.282498+0000","last_fullsized":"2023-05-24T04:00:03.282498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283868+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:03.283868+0000","last_peered":"2023-05-24T04:00:03.283868+0000","last_clean":"2023-05-24T04:00:03.283868+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:03.283868+0000","last_undegraded":"2023-05-24T04:00:03.283868+0000","last_fullsized":"2023-05-24T04:00:03.283868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:47.927025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326480+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:02.326480+0000","last_peered":"2023-05-24T04:00:02.326480+0000","last_clean":"2023-05-24T04:00:02.326480+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:02.326480+0000","last_undegraded":"2023-05-24T04:00:02.326480+0000","last_fullsized":"2023-05-24T04:00:02.326480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:28:04.663781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331449+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:02.331449+0000","last_peered":"2023-05-24T04:00:02.331449+0000","last_clean":"2023-05-24T04:00:02.331449+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:02.331449+0000","last_undegraded":"2023-05-24T04:00:02.331449+0000","last_fullsized":"2023-05-24T04:00:02.331449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:51:07.300738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285444+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:03.285444+0000","last_peered":"2023-05-24T04:00:03.285444+0000","last_clean":"2023-05-24T04:00:03.285444+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:03.285444+0000","last_undegraded":"2023-05-24T04:00:03.285444+0000","last_fullsized":"2023-05-24T04:00:03.285444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326235+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:02.326235+0000","last_peered":"2023-05-24T04:00:02.326235+0000","last_clean":"2023-05-24T04:00:02.326235+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:02.326235+0000","last_undegraded":"2023-05-24T04:00:02.326235+0000","last_fullsized":"2023-05-24T04:00:02.326235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:37.831392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329749+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:02.329749+0000","last_peered":"2023-05-24T04:00:02.329749+0000","last_clean":"2023-05-24T04:00:02.329749+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:02.329749+0000","last_undegraded":"2023-05-24T04:00:02.329749+0000","last_fullsized":"2023-05-24T04:00:02.329749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:46.939599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285009+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:03.285009+0000","last_peered":"2023-05-24T04:00:03.285009+0000","last_clean":"2023-05-24T04:00:03.285009+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:03.285009+0000","last_undegraded":"2023-05-24T04:00:03.285009+0000","last_fullsized":"2023-05-24T04:00:03.285009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326958+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:02.326958+0000","last_peered":"2023-05-24T04:00:02.326958+0000","last_clean":"2023-05-24T04:00:02.326958+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:02.326958+0000","last_undegraded":"2023-05-24T04:00:02.326958+0000","last_fullsized":"2023-05-24T04:00:02.326958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:18:48.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282592+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:03.282592+0000","last_peered":"2023-05-24T04:00:03.282592+0000","last_clean":"2023-05-24T04:00:03.282592+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:03.282592+0000","last_undegraded":"2023-05-24T04:00:03.282592+0000","last_fullsized":"2023-05-24T04:00:03.282592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:24.952669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285821+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:03.285821+0000","last_peered":"2023-05-24T04:00:03.285821+0000","last_clean":"2023-05-24T04:00:03.285821+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:03.285821+0000","last_undegraded":"2023-05-24T04:00:03.285821+0000","last_fullsized":"2023-05-24T04:00:03.285821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:20.609741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283124+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:03.283124+0000","last_peered":"2023-05-24T04:00:03.283124+0000","last_clean":"2023-05-24T04:00:03.283124+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:03.283124+0000","last_undegraded":"2023-05-24T04:00:03.283124+0000","last_fullsized":"2023-05-24T04:00:03.283124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283719+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:03.283719+0000","last_peered":"2023-05-24T04:00:03.283719+0000","last_clean":"2023-05-24T04:00:03.283719+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:03.283719+0000","last_undegraded":"2023-05-24T04:00:03.283719+0000","last_fullsized":"2023-05-24T04:00:03.283719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:43.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329762+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:02.329762+0000","last_peered":"2023-05-24T04:00:02.329762+0000","last_clean":"2023-05-24T04:00:02.329762+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:02.329762+0000","last_undegraded":"2023-05-24T04:00:02.329762+0000","last_fullsized":"2023-05-24T04:00:02.329762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:56:59.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363323+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:02.363323+0000","last_peered":"2023-05-24T04:00:02.363323+0000","last_clean":"2023-05-24T04:00:02.363323+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:02.363323+0000","last_undegraded":"2023-05-24T04:00:02.363323+0000","last_fullsized":"2023-05-24T04:00:02.363323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:13.664663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363303+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:02.363303+0000","last_peered":"2023-05-24T04:00:02.363303+0000","last_clean":"2023-05-24T04:00:02.363303+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:02.363303+0000","last_undegraded":"2023-05-24T04:00:02.363303+0000","last_fullsized":"2023-05-24T04:00:02.363303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283798+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:03.283798+0000","last_peered":"2023-05-24T04:00:03.283798+0000","last_clean":"2023-05-24T04:00:03.283798+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:03.283798+0000","last_undegraded":"2023-05-24T04:00:03.283798+0000","last_fullsized":"2023-05-24T04:00:03.283798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283107+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:03.283107+0000","last_peered":"2023-05-24T04:00:03.283107+0000","last_clean":"2023-05-24T04:00:03.283107+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:03.283107+0000","last_undegraded":"2023-05-24T04:00:03.283107+0000","last_fullsized":"2023-05-24T04:00:03.283107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281988+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:03.281988+0000","last_peered":"2023-05-24T04:00:03.281988+0000","last_clean":"2023-05-24T04:00:03.281988+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:03.281988+0000","last_undegraded":"2023-05-24T04:00:03.281988+0000","last_fullsized":"2023-05-24T04:00:03.281988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:12.761189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284815+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:03.284815+0000","last_peered":"2023-05-24T04:00:03.284815+0000","last_clean":"2023-05-24T04:00:03.284815+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:03.284815+0000","last_undegraded":"2023-05-24T04:00:03.284815+0000","last_fullsized":"2023-05-24T04:00:03.284815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:31.585428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362908+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:02.362908+0000","last_peered":"2023-05-24T04:00:02.362908+0000","last_clean":"2023-05-24T04:00:02.362908+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:02.362908+0000","last_undegraded":"2023-05-24T04:00:02.362908+0000","last_fullsized":"2023-05-24T04:00:02.362908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:39.263590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283473+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:03.283473+0000","last_peered":"2023-05-24T04:00:03.283473+0000","last_clean":"2023-05-24T04:00:03.283473+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:03.283473+0000","last_undegraded":"2023-05-24T04:00:03.283473+0000","last_fullsized":"2023-05-24T04:00:03.283473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:48.939524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363256+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:02.363256+0000","last_peered":"2023-05-24T04:00:02.363256+0000","last_clean":"2023-05-24T04:00:02.363256+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:02.363256+0000","last_undegraded":"2023-05-24T04:00:02.363256+0000","last_fullsized":"2023-05-24T04:00:02.363256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:29.382612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283979+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:03.283979+0000","last_peered":"2023-05-24T04:00:03.283979+0000","last_clean":"2023-05-24T04:00:03.283979+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:03.283979+0000","last_undegraded":"2023-05-24T04:00:03.283979+0000","last_fullsized":"2023-05-24T04:00:03.283979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329457+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:02.329457+0000","last_peered":"2023-05-24T04:00:02.329457+0000","last_clean":"2023-05-24T04:00:02.329457+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:02.329457+0000","last_undegraded":"2023-05-24T04:00:02.329457+0000","last_fullsized":"2023-05-24T04:00:02.329457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:06:39.129747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362046+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:02.362046+0000","last_peered":"2023-05-24T04:00:02.362046+0000","last_clean":"2023-05-24T04:00:02.362046+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:02.362046+0000","last_undegraded":"2023-05-24T04:00:02.362046+0000","last_fullsized":"2023-05-24T04:00:02.362046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330454+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:02.330454+0000","last_peered":"2023-05-24T04:00:02.330454+0000","last_clean":"2023-05-24T04:00:02.330454+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:02.330454+0000","last_undegraded":"2023-05-24T04:00:02.330454+0000","last_fullsized":"2023-05-24T04:00:02.330454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:26.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362536+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:02.362536+0000","last_peered":"2023-05-24T04:00:02.362536+0000","last_clean":"2023-05-24T04:00:02.362536+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:02.362536+0000","last_undegraded":"2023-05-24T04:00:02.362536+0000","last_fullsized":"2023-05-24T04:00:02.362536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673473+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:02.673473+0000","last_peered":"2023-05-24T04:00:02.673473+0000","last_clean":"2023-05-24T04:00:02.673473+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:02.673473+0000","last_undegraded":"2023-05-24T04:00:02.673473+0000","last_fullsized":"2023-05-24T04:00:02.673473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:13.776152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284495+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:03.284495+0000","last_peered":"2023-05-24T04:00:03.284495+0000","last_clean":"2023-05-24T04:00:03.284495+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:03.284495+0000","last_undegraded":"2023-05-24T04:00:03.284495+0000","last_fullsized":"2023-05-24T04:00:03.284495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673918+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:02.673918+0000","last_peered":"2023-05-24T04:00:02.673918+0000","last_clean":"2023-05-24T04:00:02.673918+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:02.673918+0000","last_undegraded":"2023-05-24T04:00:02.673918+0000","last_fullsized":"2023-05-24T04:00:02.673918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674024+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:02.674024+0000","last_peered":"2023-05-24T04:00:02.674024+0000","last_clean":"2023-05-24T04:00:02.674024+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:02.674024+0000","last_undegraded":"2023-05-24T04:00:02.674024+0000","last_fullsized":"2023-05-24T04:00:02.674024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282709+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:03.282709+0000","last_peered":"2023-05-24T04:00:03.282709+0000","last_clean":"2023-05-24T04:00:03.282709+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:03.282709+0000","last_undegraded":"2023-05-24T04:00:03.282709+0000","last_fullsized":"2023-05-24T04:00:03.282709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361920+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:02.361920+0000","last_peered":"2023-05-24T04:00:02.361920+0000","last_clean":"2023-05-24T04:00:02.361920+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:02.361920+0000","last_undegraded":"2023-05-24T04:00:02.361920+0000","last_fullsized":"2023-05-24T04:00:02.361920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282020+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:03.282020+0000","last_peered":"2023-05-24T04:00:03.282020+0000","last_clean":"2023-05-24T04:00:03.282020+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:03.282020+0000","last_undegraded":"2023-05-24T04:00:03.282020+0000","last_fullsized":"2023-05-24T04:00:03.282020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:12.612403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283275+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:03.283275+0000","last_peered":"2023-05-24T04:00:03.283275+0000","last_clean":"2023-05-24T04:00:03.283275+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:03.283275+0000","last_undegraded":"2023-05-24T04:00:03.283275+0000","last_fullsized":"2023-05-24T04:00:03.283275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331904+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:02.331904+0000","last_peered":"2023-05-24T04:00:02.331904+0000","last_clean":"2023-05-24T04:00:02.331904+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:02.331904+0000","last_undegraded":"2023-05-24T04:00:02.331904+0000","last_fullsized":"2023-05-24T04:00:02.331904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:26:07.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326634+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:02.326634+0000","last_peered":"2023-05-24T04:00:02.326634+0000","last_clean":"2023-05-24T04:00:02.326634+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:02.326634+0000","last_undegraded":"2023-05-24T04:00:02.326634+0000","last_fullsized":"2023-05-24T04:00:02.326634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:23:41.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331187+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:02.331187+0000","last_peered":"2023-05-24T04:00:02.331187+0000","last_clean":"2023-05-24T04:00:02.331187+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:02.331187+0000","last_undegraded":"2023-05-24T04:00:02.331187+0000","last_fullsized":"2023-05-24T04:00:02.331187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:20.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283457+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:03.283457+0000","last_peered":"2023-05-24T04:00:03.283457+0000","last_clean":"2023-05-24T04:00:03.283457+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:03.283457+0000","last_undegraded":"2023-05-24T04:00:03.283457+0000","last_fullsized":"2023-05-24T04:00:03.283457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328836+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:02.328836+0000","last_peered":"2023-05-24T04:00:02.328836+0000","last_clean":"2023-05-24T04:00:02.328836+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:02.328836+0000","last_undegraded":"2023-05-24T04:00:02.328836+0000","last_fullsized":"2023-05-24T04:00:02.328836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:22.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283484+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:03.283484+0000","last_peered":"2023-05-24T04:00:03.283484+0000","last_clean":"2023-05-24T04:00:03.283484+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:03.283484+0000","last_undegraded":"2023-05-24T04:00:03.283484+0000","last_fullsized":"2023-05-24T04:00:03.283484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283949+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:03.283949+0000","last_peered":"2023-05-24T04:00:03.283949+0000","last_clean":"2023-05-24T04:00:03.283949+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:03.283949+0000","last_undegraded":"2023-05-24T04:00:03.283949+0000","last_fullsized":"2023-05-24T04:00:03.283949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326231+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:02.326231+0000","last_peered":"2023-05-24T04:00:02.326231+0000","last_clean":"2023-05-24T04:00:02.326231+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:02.326231+0000","last_undegraded":"2023-05-24T04:00:02.326231+0000","last_fullsized":"2023-05-24T04:00:02.326231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:08:53.915635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326785+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:02.326785+0000","last_peered":"2023-05-24T04:00:02.326785+0000","last_clean":"2023-05-24T04:00:02.326785+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:02.326785+0000","last_undegraded":"2023-05-24T04:00:02.326785+0000","last_fullsized":"2023-05-24T04:00:02.326785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:35:05.345944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330585+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:02.330585+0000","last_peered":"2023-05-24T04:00:02.330585+0000","last_clean":"2023-05-24T04:00:02.330585+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:02.330585+0000","last_undegraded":"2023-05-24T04:00:02.330585+0000","last_fullsized":"2023-05-24T04:00:02.330585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284900+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:03.284900+0000","last_peered":"2023-05-24T04:00:03.284900+0000","last_clean":"2023-05-24T04:00:03.284900+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:03.284900+0000","last_undegraded":"2023-05-24T04:00:03.284900+0000","last_fullsized":"2023-05-24T04:00:03.284900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:17.860183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283198+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:03.283198+0000","last_peered":"2023-05-24T04:00:03.283198+0000","last_clean":"2023-05-24T04:00:03.283198+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:03.283198+0000","last_undegraded":"2023-05-24T04:00:03.283198+0000","last_fullsized":"2023-05-24T04:00:03.283198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282366+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:03.282366+0000","last_peered":"2023-05-24T04:00:03.282366+0000","last_clean":"2023-05-24T04:00:03.282366+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:03.282366+0000","last_undegraded":"2023-05-24T04:00:03.282366+0000","last_fullsized":"2023-05-24T04:00:03.282366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283141+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:03.283141+0000","last_peered":"2023-05-24T04:00:03.283141+0000","last_clean":"2023-05-24T04:00:03.283141+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:03.283141+0000","last_undegraded":"2023-05-24T04:00:03.283141+0000","last_fullsized":"2023-05-24T04:00:03.283141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329420+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:02.329420+0000","last_peered":"2023-05-24T04:00:02.329420+0000","last_clean":"2023-05-24T04:00:02.329420+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:02.329420+0000","last_undegraded":"2023-05-24T04:00:02.329420+0000","last_fullsized":"2023-05-24T04:00:02.329420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283341+0000","last_change":"2023-05-24T03:59:57.913975+0000","last_active":"2023-05-24T04:00:03.283341+0000","last_peered":"2023-05-24T04:00:03.283341+0000","last_clean":"2023-05-24T04:00:03.283341+0000","last_became_active":"2023-05-24T03:59:57.913528+0000","last_became_peered":"2023-05-24T03:59:57.913528+0000","last_unstale":"2023-05-24T04:00:03.283341+0000","last_undegraded":"2023-05-24T04:00:03.283341+0000","last_fullsized":"2023-05-24T04:00:03.283341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333140+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:02.333140+0000","last_peered":"2023-05-24T04:00:02.333140+0000","last_clean":"2023-05-24T04:00:02.333140+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:02.333140+0000","last_undegraded":"2023-05-24T04:00:02.333140+0000","last_fullsized":"2023-05-24T04:00:02.333140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:29.390853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330279+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:02.330279+0000","last_peered":"2023-05-24T04:00:02.330279+0000","last_clean":"2023-05-24T04:00:02.330279+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:02.330279+0000","last_undegraded":"2023-05-24T04:00:02.330279+0000","last_fullsized":"2023-05-24T04:00:02.330279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284322+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:03.284322+0000","last_peered":"2023-05-24T04:00:03.284322+0000","last_clean":"2023-05-24T04:00:03.284322+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:03.284322+0000","last_undegraded":"2023-05-24T04:00:03.284322+0000","last_fullsized":"2023-05-24T04:00:03.284322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326738+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:02.326738+0000","last_peered":"2023-05-24T04:00:02.326738+0000","last_clean":"2023-05-24T04:00:02.326738+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:02.326738+0000","last_undegraded":"2023-05-24T04:00:02.326738+0000","last_fullsized":"2023-05-24T04:00:02.326738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:18:29.367916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":714326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18220,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353620,"statfs":{"total":96636764160,"available":96618106880,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":123798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18216,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353624,"statfs":{"total":96636764160,"available":96618110976,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18796,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353044,"statfs":{"total":96636764160,"available":96617517056,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:00:21.036 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-24T04:00:21.037 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-24T04:00:21.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-24T04:00:21.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-24T04:00:21.038 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-24T04:00:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.186+0000 7f16b4094640 1 Processor -- start 2023-05-24T04:00:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.186+0000 7f16b4094640 1 -- start start 2023-05-24T04:00:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b4094640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 0x7f16ac14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b4094640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac14f5a0 con 0x7f16ac0c1500 2023-05-24T04:00:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b4094640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac14b270 con 0x7f16ac14e650 2023-05-24T04:00:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b4094640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14b550 con 0x7f16ac0bd120 2023-05-24T04:00:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b1e30640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16ac0c1500 0x7f16ac06f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43536/0 (socket says 172.21.15.40:43536) 2023-05-24T04:00:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b1e30640 1 -- 172.21.15.40:0/3347276145 learned_addr learned my addr 172.21.15.40:0/3347276145 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b2631640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 0x7f16ac14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639014503 0 0) 0x7f16ac14f5a0 con 0x7f16ac0c1500 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1698003530 con 0x7f16ac0c1500 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2885008406 0 0) 0x7f1698003530 con 0x7f16ac0c1500 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 msgr2=0x7f16ac14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 0x7f16ac14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 >> v1:172.21.15.67:6789/0 conn(0x7f16ac14e650 legacy=0x7f16ac14a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac14b830 con 0x7f16ac0c1500 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f16a8001800 con 0x7f16ac0c1500 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 >> v1:172.21.15.40:6789/0 conn(0x7f16ac0c1500 legacy=0x7f16ac06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 0x7f16980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698003f30 0x7f16980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1698004d10 0x7f1698005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14b550 con 0x7f1698003f30 2023-05-24T04:00:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169800dc80 con 0x7f1698004d10 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169800de40 con 0x7f16ac0bd120 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698003f30 0x7f16980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b1e30640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 0x7f16980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 -- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 msgr2=0x7f16980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b2631640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1698004d10 0x7f1698005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0bd120 0x7f16980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 -- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1698004d10 msgr2=0x7f1698005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1698004d10 0x7f1698005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 -- 172.21.15.40:0/3347276145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698003530 con 0x7f1698003f30 2023-05-24T04:00:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.190+0000 7f16b162f640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698003f30 0x7f16980047d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f169c001750 tx=0x7f169c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9999695ae7446e67 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0052d0 con 0x7f1698003f30 2023-05-24T04:00:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c0a7050 con 0x7f1698003f30 2023-05-24T04:00:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b0e2e640 1 -- 172.21.15.40:0/3347276145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c003600 con 0x7f1698003f30 2023-05-24T04:00:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3347276145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698003f30 msgr2=0x7f16980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 --2- 172.21.15.40:0/3347276145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698003f30 0x7f16980047d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f169c001750 tx=0x7f169c01c3c0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b2631640 1 -- 172.21.15.40:0/3347276145 reap_dead start 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3347276145 shutdown_connections 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3347276145 >> 172.21.15.40:0/3347276145 conn(0x7f16ac06a600 msgr2=0x7f16ac0c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3347276145 shutdown_connections 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3347276145 wait complete. 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 Processor -- start 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- start start 2023-05-24T04:00:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698003f30 0x7f16ac13f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 0x7f16ac0c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16ac0c0a50 0x7f16ac0b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac13f7e0 con 0x7f16ac0bcad0 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac1416e0 con 0x7f16ac0c0a50 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0bb3a0 con 0x7f1698003f30 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 0x7f16ac0c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 0x7f16ac0c0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39990/0 (socket says 172.21.15.40:39990) 2023-05-24T04:00:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 -- 172.21.15.40:0/3665357765 learned_addr learned my addr 172.21.15.40:0/3665357765 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b1e30640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698003f30 0x7f16ac13f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b2631640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16ac0c0a50 0x7f16ac0b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 -- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698003f30 msgr2=0x7f16ac13f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698003f30 0x7f16ac13f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 -- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16ac0c0a50 msgr2=0x7f16ac0b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16ac0c0a50 0x7f16ac0b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 -- 172.21.15.40:0/3665357765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0c1a60 con 0x7f16ac0bcad0 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b2631640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16ac0c0a50 0x7f16ac0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b1e30640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698003f30 0x7f16ac13f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b162f640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 0x7f16ac0c0510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f169c005040 tx=0x7f1698005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c007a40 con 0x7f16ac0bcad0 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c007680 con 0x7f16ac0bcad0 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac0c18d0 con 0x7f16ac0bcad0 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c006a00 con 0x7f16ac0bcad0 2023-05-24T04:00:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.194+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac06f810 con 0x7f16ac0bcad0 2023-05-24T04:00:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.198+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac0674e0 con 0x7f16ac0bcad0 2023-05-24T04:00:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.198+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f169c006b60 con 0x7f16ac0bcad0 2023-05-24T04:00:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.198+0000 7f16a27fc640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1690066280 0x7f1690068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.198+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f169c11e730 con 0x7f16ac0bcad0 2023-05-24T04:00:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.198+0000 7f16b1e30640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1690066280 0x7f1690068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.198+0000 7f16b1e30640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1690066280 0x7f1690068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16a80011e0 tx=0x7f16a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.202+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f169c0eb8b0 con 0x7f16ac0bcad0 2023-05-24T04:00:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.394+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f16ac13fee0 con 0x7f16ac0bcad0 2023-05-24T04:00:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16a27fc640 1 -- 172.21.15.40:0/3665357765 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164240 (secure 0 0 0) 0x7f169c0eeed0 con 0x7f16ac0bcad0 2023-05-24T04:00:21.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1690066280 msgr2=0x7f1690068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1690066280 0x7f1690068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16a80011e0 tx=0x7f16a8009040 comp rx=0 tx=0).stop 2023-05-24T04:00:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 msgr2=0x7f16ac0c0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 0x7f16ac0c0510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f169c005040 tx=0x7f1698005800 comp rx=0 tx=0).stop 2023-05-24T04:00:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 shutdown_connections 2023-05-24T04:00:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1690066280 0x7f1690068730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16ac0c0a50 0x7f16ac0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ac0bcad0 0x7f16ac0c0510 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 --2- 172.21.15.40:0/3665357765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698003f30 0x7f16ac13f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 >> 172.21.15.40:0/3665357765 conn(0x7f16ac06a600 msgr2=0x7f16ac1498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 shutdown_connections 2023-05-24T04:00:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.402+0000 7f16b4094640 1 -- 172.21.15.40:0/3665357765 wait complete. 2023-05-24T04:00:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1050561817},{"type":"v1","addr":"172.21.15.40:6833","nonce":1050561817}]},"active_addr":"172.21.15.40:6833/1050561817","active_change":"2023-05-24T03:59:38.501546+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":328168012}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":428985170}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1026907401}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3529386973}]}]} 2023-05-24T04:00:21.431 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-24T04:00:21.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-24T04:00:21.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:21.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 Processor -- start 2023-05-24T04:00:21.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 -- start start 2023-05-24T04:00:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc0bef60 0x7fd1fc0c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd1fc0a3da0 0x7fd1fc0c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1fc06aa70 0x7fd1fc06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc0c4220 con 0x7fd1fc06aa70 2023-05-24T04:00:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc0b8040 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd201512640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0b7df0 con 0x7fd1fc0bef60 2023-05-24T04:00:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1fc06aa70 0x7fd1fc06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1fc06aa70 0x7fd1fc06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47592/0 (socket says 172.21.15.40:47592) 2023-05-24T04:00:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 -- 172.21.15.40:0/3470530393 learned_addr learned my addr 172.21.15.40:0/3470530393 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1f3fff640 1 --2- 172.21.15.40:0/3470530393 >> v2:172.21.15.67:3300/0 conn(0x7fd1fc0a3da0 0x7fd1fc0c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1faffd640 1 --2- 172.21.15.40:0/3470530393 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc0bef60 0x7fd1fc0c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 -- 172.21.15.40:0/3470530393 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc0bef60 msgr2=0x7fd1fc0c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 --2- 172.21.15.40:0/3470530393 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc0bef60 0x7fd1fc0c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 -- 172.21.15.40:0/3470530393 >> v2:172.21.15.67:3300/0 conn(0x7fd1fc0a3da0 msgr2=0x7fd1fc0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 --2- 172.21.15.40:0/3470530393 >> v2:172.21.15.67:3300/0 conn(0x7fd1fc0a3da0 0x7fd1fc0c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.546+0000 7fd1fb7fe640 1 -- 172.21.15.40:0/3470530393 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0a38d0 con 0x7fd1fc06aa70 2023-05-24T04:00:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1fb7fe640 1 --2- 172.21.15.40:0/3470530393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc06aa70 0x7fd1fc06af10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009e50 tx=0x7fd1f401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497ac58910938692 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1fa7fc640 1 -- 172.21.15.40:0/3470530393 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40a57c0 con 0x7fd1fc06aa70 2023-05-24T04:00:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1fa7fc640 1 -- 172.21.15.40:0/3470530393 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f40a5920 con 0x7fd1fc06aa70 2023-05-24T04:00:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1fa7fc640 1 -- 172.21.15.40:0/3470530393 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40a5cb0 con 0x7fd1fc06aa70 2023-05-24T04:00:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- 172.21.15.40:0/3470530393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc06aa70 msgr2=0x7fd1fc06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- 172.21.15.40:0/3470530393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc06aa70 0x7fd1fc06af10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009e50 tx=0x7fd1f401c920 comp rx=0 tx=0).stop 2023-05-24T04:00:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- 172.21.15.40:0/3470530393 shutdown_connections 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- 172.21.15.40:0/3470530393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc06aa70 0x7fd1fc06af10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- 172.21.15.40:0/3470530393 >> v2:172.21.15.67:3300/0 conn(0x7fd1fc0a3da0 0x7fd1fc0c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- 172.21.15.40:0/3470530393 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc0bef60 0x7fd1fc0c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- 172.21.15.40:0/3470530393 >> 172.21.15.40:0/3470530393 conn(0x7fd1fc065bb0 msgr2=0x7fd1fc0a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- 172.21.15.40:0/3470530393 shutdown_connections 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- 172.21.15.40:0/3470530393 wait complete. 2023-05-24T04:00:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 Processor -- start 2023-05-24T04:00:21.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- start start 2023-05-24T04:00:21.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc06aa70 0x7fd1fc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 0x7fd1fc0a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1fc0bef60 0x7fd1fc148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc150410 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0a7f90 con 0x7fd1fc0bef60 2023-05-24T04:00:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd201512640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0a8270 con 0x7fd1fc06aa70 2023-05-24T04:00:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1f3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 0x7fd1fc0a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1f3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 0x7fd1fc0a9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47604/0 (socket says 172.21.15.40:47604) 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1f3fff640 1 -- 172.21.15.40:0/3271915369 learned_addr learned my addr 172.21.15.40:0/3271915369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1fb7fe640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1fc0bef60 0x7fd1fc148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.550+0000 7fd1faffd640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc06aa70 0x7fd1fc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f3fff640 1 -- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc06aa70 msgr2=0x7fd1fc14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f3fff640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc06aa70 0x7fd1fc14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f3fff640 1 -- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1fc0bef60 msgr2=0x7fd1fc148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f3fff640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1fc0bef60 0x7fd1fc148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f3fff640 1 -- 172.21.15.40:0/3271915369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009b30 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1faffd640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc06aa70 0x7fd1fc14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f3fff640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 0x7fd1fc0a9030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400d7d0 tx=0x7fd1e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400b6c0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400b820 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc0c3eb0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400bbd0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc0c2d00 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc0bb3e0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1e400bd30 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f37fe640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd1dc066280 0x7fd1dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1faffd640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd1dc066280 0x7fd1dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1e40845d0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.554+0000 7fd1faffd640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd1dc066280 0x7fd1dc068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc1506d0 tx=0x7fd1ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.558+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd1e40551f0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.714+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1fc04ddd0 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.718+0000 7fd1f37fe640 1 -- 172.21.15.40:0/3271915369 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7fd1e4054d80 con 0x7fd1fc0a3da0 2023-05-24T04:00:21.723 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:21.724 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd1dc066280 msgr2=0x7fd1dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd1dc066280 0x7fd1dc068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc1506d0 tx=0x7fd1ec008040 comp rx=0 tx=0).stop 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 msgr2=0x7fd1fc0a9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 0x7fd1fc0a9030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400d7d0 tx=0x7fd1e400dc90 comp rx=0 tx=0).stop 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 shutdown_connections 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd1dc066280 0x7fd1dc068730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1fc0bef60 0x7fd1fc148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1fc0a3da0 0x7fd1fc0a9030 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 --2- 172.21.15.40:0/3271915369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1fc06aa70 0x7fd1fc14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 >> 172.21.15.40:0/3271915369 conn(0x7fd1fc065bb0 msgr2=0x7fd1fc1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 shutdown_connections 2023-05-24T04:00:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.722+0000 7fd201512640 1 -- 172.21.15.40:0/3271915369 wait complete. 2023-05-24T04:00:21.742 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-24T04:00:21.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8213505640 1 Processor -- start 2023-05-24T04:00:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8213505640 1 -- start start 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8213505640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f820c0bef60 0x7f820c0c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8213505640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0b8040 con 0x7f820c0a3da0 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8213505640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0b7df0 con 0x7f820c151e20 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8213505640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c0c4220 con 0x7f820c0bef60 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f82112a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f820c0bef60 0x7f820c0c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8210aa0640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f820c0a3da0 0x7f820c0c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45008/0 (socket says 172.21.15.40:45008) 2023-05-24T04:00:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f82112a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f820c0bef60 0x7f820c0c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47606/0 (socket says 172.21.15.40:47606) 2023-05-24T04:00:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8210aa0640 1 -- 172.21.15.40:0/569385078 learned_addr learned my addr 172.21.15.40:0/569385078 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f82112a1640 1 -- 172.21.15.40:0/569385078 >> v1:172.21.15.67:6789/0 conn(0x7f820c151e20 legacy=0x7f820c1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f82112a1640 1 -- 172.21.15.40:0/569385078 >> v1:172.21.15.40:6789/0 conn(0x7f820c0a3da0 legacy=0x7f820c0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f82112a1640 1 -- 172.21.15.40:0/569385078 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0a38d0 con 0x7f820c0bef60 2023-05-24T04:00:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.862+0000 7f8203fff640 1 -- 172.21.15.40:0/569385078 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405652694 0 0) 0x7f81fc001120 con 0x7f820c0a3da0 2023-05-24T04:00:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f82112a1640 1 --2- 172.21.15.40:0/569385078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0c11c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82080097c0 tx=0x7f820801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114ac73ac3911b72 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8203fff640 1 -- 172.21.15.40:0/569385078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080ab600 con 0x7f820c0bef60 2023-05-24T04:00:21.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8203fff640 1 -- 172.21.15.40:0/569385078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080a7050 con 0x7f820c0bef60 2023-05-24T04:00:21.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8203fff640 1 -- 172.21.15.40:0/569385078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080ab980 con 0x7f820c0bef60 2023-05-24T04:00:21.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- 172.21.15.40:0/569385078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 msgr2=0x7f820c0c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 --2- 172.21.15.40:0/569385078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0c11c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82080097c0 tx=0x7f820801c390 comp rx=0 tx=0).stop 2023-05-24T04:00:21.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- 172.21.15.40:0/569385078 shutdown_connections 2023-05-24T04:00:21.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 --2- 172.21.15.40:0/569385078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0c11c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- 172.21.15.40:0/569385078 >> 172.21.15.40:0/569385078 conn(0x7f820c065bb0 msgr2=0x7f820c0a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:21.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- 172.21.15.40:0/569385078 shutdown_connections 2023-05-24T04:00:21.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- 172.21.15.40:0/569385078 wait complete. 2023-05-24T04:00:21.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 Processor -- start 2023-05-24T04:00:21.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- start start 2023-05-24T04:00:21.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f820c0a3da0 0x7f820c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f820c151e20 0x7f820c0a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0ba320 con 0x7f820c0bef60 2023-05-24T04:00:21.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0a5600 con 0x7f820c151e20 2023-05-24T04:00:21.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8213505640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c149d10 con 0x7f820c0a3da0 2023-05-24T04:00:21.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8210aa0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8210aa0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47608/0 (socket says 172.21.15.40:47608) 2023-05-24T04:00:21.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.866+0000 7f8210aa0640 1 -- 172.21.15.40:0/1105495011 learned_addr learned my addr 172.21.15.40:0/1105495011 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:21.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f82112a1640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f820c0a3da0 0x7f820c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8211aa2640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f820c151e20 0x7f820c0a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8210aa0640 1 -- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f820c0a3da0 msgr2=0x7f820c0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8210aa0640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f820c0a3da0 0x7f820c0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8210aa0640 1 -- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f820c151e20 msgr2=0x7f820c0a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:21.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8210aa0640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f820c151e20 0x7f820c0a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:21.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8210aa0640 1 -- 172.21.15.40:0/1105495011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009420 con 0x7f820c0bef60 2023-05-24T04:00:21.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8211aa2640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f820c151e20 0x7f820c0a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:21.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8210aa0640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0b7340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c780 tx=0x7f81fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0072d0 con 0x7f820c0bef60 2023-05-24T04:00:21.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc007430 con 0x7f820c0bef60 2023-05-24T04:00:21.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c0bb5d0 con 0x7f820c0bef60 2023-05-24T04:00:21.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0047f0 con 0x7f820c0bef60 2023-05-24T04:00:21.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0bb440 con 0x7f820c0bef60 2023-05-24T04:00:21.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c0c3410 con 0x7f820c0bef60 2023-05-24T04:00:21.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81fc004950 con 0x7f820c0bef60 2023-05-24T04:00:21.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8201ffb640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f81f0066280 0x7f81f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:21.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f82112a1640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f81f0066280 0x7f81f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:21.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81fc083490 con 0x7f820c0bef60 2023-05-24T04:00:21.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.870+0000 7f82112a1640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f81f0066280 0x7f81f0068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82080ad000 tx=0x7f8208008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:21.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:21.874+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f81fc050590 con 0x7f820c0bef60 2023-05-24T04:00:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.034+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f820c0b8040 con 0x7f820c0bef60 2023-05-24T04:00:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8201ffb640 1 -- 172.21.15.40:0/1105495011 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f820c0b8040 con 0x7f820c0bef60 2023-05-24T04:00:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:22.042 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f81f0066280 msgr2=0x7f81f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f81f0066280 0x7f81f0068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82080ad000 tx=0x7f8208008040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 msgr2=0x7f820c0b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0b7340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c780 tx=0x7f81fc00cc40 comp rx=0 tx=0).stop 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 shutdown_connections 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f81f0066280 0x7f81f0068730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f820c151e20 0x7f820c0a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f820c0bef60 0x7f820c0b7340 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 --2- 172.21.15.40:0/1105495011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f820c0a3da0 0x7f820c0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 >> 172.21.15.40:0/1105495011 conn(0x7f820c065bb0 msgr2=0x7f820c0c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 shutdown_connections 2023-05-24T04:00:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.038+0000 7f8213505640 1 -- 172.21.15.40:0/1105495011 wait complete. 2023-05-24T04:00:22.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-24T04:00:22.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-24T04:00:22.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-24T04:00:22.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-24T04:00:22.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-24T04:00:22.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-24T04:00:22.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-24T04:00:22.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-24T04:00:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf97877640 1 Processor -- start 2023-05-24T04:00:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf97877640 1 -- start start 2023-05-24T04:00:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf97877640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcf8800b9b0 0x7fcf880468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf97877640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf88046450 con 0x7fcf880424f0 2023-05-24T04:00:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf97877640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf88045e40 con 0x7fcf880273a0 2023-05-24T04:00:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf97877640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf88046e20 con 0x7fcf8800b9b0 2023-05-24T04:00:22.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf94e12640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcf880424f0 0x7fcf88026c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45024/0 (socket says 172.21.15.40:45024) 2023-05-24T04:00:22.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf94e12640 1 -- 172.21.15.40:0/2015021082 learned_addr learned my addr 172.21.15.40:0/2015021082 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7f16f548c640 1 Processor -- start 2023-05-24T04:00:22.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7f16f548c640 1 -- start start 2023-05-24T04:00:22.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf95613640 1 --2- 172.21.15.40:0/2015021082 >> v2:172.21.15.67:3300/0 conn(0x7fcf8800b9b0 0x7fcf880468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732389827 0 0) 0x7fcf88045e40 con 0x7fcf880273a0 2023-05-24T04:00:22.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.238+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf7c003530 con 0x7fcf880273a0 2023-05-24T04:00:22.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144037878 0 0) 0x7fcf88046450 con 0x7fcf880424f0 2023-05-24T04:00:22.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf88045e40 con 0x7fcf880424f0 2023-05-24T04:00:22.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8831317640 1 Processor -- start 2023-05-24T04:00:22.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8831317640 1 -- start start 2023-05-24T04:00:22.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856952409 0 0) 0x7fcf7c003530 con 0x7fcf880273a0 2023-05-24T04:00:22.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf95613640 1 -- 172.21.15.40:0/2015021082 >> v1:172.21.15.67:6789/0 conn(0x7fcf880273a0 legacy=0x7fcf88007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f548c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f014ba20 0x7f16f0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f548c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f16f006ce40 0x7f16f00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f548c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16f0070dc0 0x7f16f00b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f548c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00a55e0 con 0x7f16f0070dc0 2023-05-24T04:00:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f548c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f006b920 con 0x7f16f006ce40 2023-05-24T04:00:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f548c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0150570 con 0x7f16f014ba20 2023-05-24T04:00:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf95613640 1 -- 172.21.15.40:0/2015021082 >> v1:172.21.15.40:6789/0 conn(0x7fcf880424f0 legacy=0x7fcf88026c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf95613640 1 -- 172.21.15.40:0/2015021082 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880460e0 con 0x7fcf8800b9b0 2023-05-24T04:00:22.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16effff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f014ba20 0x7f16f0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16effff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f014ba20 0x7f16f0070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:57966/0 (socket says 172.21.15.40:57966) 2023-05-24T04:00:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16effff640 1 -- 172.21.15.40:0/3271139797 learned_addr learned my addr 172.21.15.40:0/3271139797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8831317640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f882c071470 0x7f882c14a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8831317640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c14b270 con 0x7f882c06e670 2023-05-24T04:00:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8831317640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c14b7e0 con 0x7f882c06cd30 2023-05-24T04:00:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8831317640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c14ac20 con 0x7f882c071470 2023-05-24T04:00:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 Processor -- start 2023-05-24T04:00:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb25131640 1 Processor -- start 2023-05-24T04:00:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb25131640 1 -- start start 2023-05-24T04:00:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/3271139797 >> v2:172.21.15.40:3300/0 conn(0x7f16f0070dc0 0x7f16f00b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f882b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f882c06e670 0x7f882c06eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45036/0 (socket says 172.21.15.40:45036) 2023-05-24T04:00:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f882b7fe640 1 -- 172.21.15.40:0/4070230707 learned_addr learned my addr 172.21.15.40:0/4070230707 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 -- start start 2023-05-24T04:00:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f4c8b640 1 -- 172.21.15.40:0/3271139797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f014ba20 msgr2=0x7f16f0070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/3271139797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f014ba20 0x7f16f0070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f4c8b640 1 -- 172.21.15.40:0/3271139797 >> v2:172.21.15.67:3300/0 conn(0x7f16f006ce40 msgr2=0x7f16f00b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/3271139797 >> v2:172.21.15.67:3300/0 conn(0x7f16f006ce40 0x7f16f00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f16f4c8b640 1 -- 172.21.15.40:0/3271139797 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0150200 con 0x7f16f0070dc0 2023-05-24T04:00:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb25131640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcb1802a090 0x7fcb1802c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb24930640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcb180d71d0 0x7fcb180dd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45040/0 (socket says 172.21.15.40:45040) 2023-05-24T04:00:22.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb24930640 1 -- 172.21.15.40:0/2016607512 learned_addr learned my addr 172.21.15.40:0/2016607512 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371450549 0 0) 0x7f882c14b7e0 con 0x7f882c06cd30 2023-05-24T04:00:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8814003450 con 0x7f882c06cd30 2023-05-24T04:00:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb1ffff640 1 --2- 172.21.15.40:0/2016607512 >> v2:172.21.15.67:3300/0 conn(0x7fcb1802a090 0x7fcb1802c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e54041640 0x7f5e54042cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5e5402ca50 0x7f5e540064d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e54046ba0 con 0x7f5e54043200 2023-05-24T04:00:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54045350 con 0x7f5e54041640 2023-05-24T04:00:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e64215640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e540266d0 con 0x7f5e5402ca50 2023-05-24T04:00:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e617b0640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e54043200 0x7f5e54005dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45052/0 (socket says 172.21.15.40:45052) 2023-05-24T04:00:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e617b0640 1 -- 172.21.15.40:0/3614178756 learned_addr learned my addr 172.21.15.40:0/3614178756 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e61fb1640 1 --2- 172.21.15.40:0/3614178756 >> v2:172.21.15.40:3300/0 conn(0x7f5e54041640 0x7f5e54042cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb18045a00 con 0x7fcb180d71d0 2023-05-24T04:00:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb18044fd0 con 0x7fcb180068b0 2023-05-24T04:00:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb18045c50 con 0x7fcb1802a090 2023-05-24T04:00:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f882affd640 1 --2- 172.21.15.40:0/4070230707 >> v2:172.21.15.67:3300/0 conn(0x7f882c071470 0x7f882c14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e627b2640 1 --2- 172.21.15.40:0/3614178756 >> v2:172.21.15.67:3300/0 conn(0x7f5e5402ca50 0x7f5e540064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb1effd640 1 -- 172.21.15.40:0/2016607512 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103635507 0 0) 0x7fcb18044fd0 con 0x7fcb180068b0 2023-05-24T04:00:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb1effd640 1 -- 172.21.15.40:0/2016607512 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb10003530 con 0x7fcb180068b0 2023-05-24T04:00:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e61fb1640 1 -- 172.21.15.40:0/3614178756 >> v2:172.21.15.67:3300/0 conn(0x7f5e5402ca50 msgr2=0x7f5e540064d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e61fb1640 1 --2- 172.21.15.40:0/3614178756 >> v2:172.21.15.67:3300/0 conn(0x7f5e5402ca50 0x7f5e540064d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e61fb1640 1 -- 172.21.15.40:0/3614178756 >> v1:172.21.15.40:6789/0 conn(0x7f5e54043200 legacy=0x7f5e54005dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f5e61fb1640 1 -- 172.21.15.40:0/3614178756 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5403a6b0 con 0x7f5e54041640 2023-05-24T04:00:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb1ffff640 1 -- 172.21.15.40:0/2016607512 >> v1:172.21.15.67:6789/0 conn(0x7fcb180068b0 legacy=0x7fcb180d6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb1ffff640 1 -- 172.21.15.40:0/2016607512 >> v1:172.21.15.40:6789/0 conn(0x7fcb180d71d0 legacy=0x7fcb180dd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcb1ffff640 1 -- 172.21.15.40:0/2016607512 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1802cdf0 con 0x7fcb1802a090 2023-05-24T04:00:22.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011284985 0 0) 0x7f8814003450 con 0x7f882c06cd30 2023-05-24T04:00:22.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 >> v2:172.21.15.67:3300/0 conn(0x7f882c071470 msgr2=0x7f882c14a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 --2- 172.21.15.40:0/4070230707 >> v2:172.21.15.67:3300/0 conn(0x7f882c071470 0x7f882c14a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 >> v1:172.21.15.40:6789/0 conn(0x7f882c06e670 legacy=0x7f882c06eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c14af00 con 0x7f882c06cd30 2023-05-24T04:00:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f8820001680 con 0x7f882c06cd30 2023-05-24T04:00:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 >> v1:172.21.15.67:6789/0 conn(0x7f882c06cd30 legacy=0x7f882c1477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8814003ac0 0x7f8814003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8814008910 0x7f881400ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881400b570 0x7f881400da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c14ac20 con 0x7f881400b570 2023-05-24T04:00:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881400e300 con 0x7f8814003ac0 2023-05-24T04:00:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881400e4c0 con 0x7f8814008910 2023-05-24T04:00:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7fcf95613640 1 --2- 172.21.15.40:0/2015021082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880468e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009740 tx=0x7fcf8001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90f3700af8b66468 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881400b570 0x7f881400da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.242+0000 7f7e0dd73640 1 Processor -- start 2023-05-24T04:00:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882affd640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8814003ac0 0x7f8814003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e0dd73640 1 -- start start 2023-05-24T04:00:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 -- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8814008910 msgr2=0x7f881400ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-24T04:00:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8814008910 0x7f881400ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 -- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8814003ac0 msgr2=0x7f8814003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8814003ac0 0x7f8814003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 -- 172.21.15.40:0/4070230707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c14af00 con 0x7f881400b570 2023-05-24T04:00:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/3271139797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f0070dc0 0x7f16f00b54d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f16f00c11d0 tx=0x7f16e801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39d5d0e921eaad5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f16eeffd640 1 -- 172.21.15.40:0/3271139797 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80a58f0 con 0x7f16f0070dc0 2023-05-24T04:00:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f16eeffd640 1 -- 172.21.15.40:0/3271139797 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80a5a50 con 0x7f16f0070dc0 2023-05-24T04:00:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f16eeffd640 1 -- 172.21.15.40:0/3271139797 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80a5de0 con 0x7f16f0070dc0 2023-05-24T04:00:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e0dd73640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e0814de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e0dd73640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080be8f0 con 0x7f7e080bf9e0 2023-05-24T04:00:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e0dd73640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080bf150 con 0x7f7e0814ac00 2023-05-24T04:00:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90061630 con 0x7fcf8800b9b0 2023-05-24T04:00:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf800ac440 con 0x7fcf8800b9b0 2023-05-24T04:00:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7fcf87fff640 1 -- 172.21.15.40:0/2015021082 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800ac7d0 con 0x7fcf8800b9b0 2023-05-24T04:00:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e0814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e0814de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:57988/0 (socket says 172.21.15.40:57988) 2023-05-24T04:00:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e077fe640 1 -- 172.21.15.40:0/40512207 learned_addr learned my addr 172.21.15.40:0/40512207 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e0dd73640 1 -- 172.21.15.40:0/40512207 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080bebd0 con 0x7f7e0806a350 2023-05-24T04:00:22.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 -- 172.21.15.40:0/4070230707 reap_dead start 2023-05-24T04:00:22.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e067fc640 1 -- 172.21.15.40:0/40512207 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187586212 0 0) 0x7f7e080bf150 con 0x7f7e0814ac00 2023-05-24T04:00:22.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e067fc640 1 -- 172.21.15.40:0/40512207 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df8005740 con 0x7f7e0814ac00 2023-05-24T04:00:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f5e61fb1640 1 --2- 172.21.15.40:0/3614178756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e54041640 0x7f5e54042cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b540 tx=0x7f5e5801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08ee58208c3960e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f882b7fe640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881400b570 0x7f881400da20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88240021e0 tx=0x7f882401cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173d7ebfafa33cfe server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f5e60faf640 1 -- 172.21.15.40:0/3614178756 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580ab600 con 0x7f5e54041640 2023-05-24T04:00:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f5e60faf640 1 -- 172.21.15.40:0/3614178756 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580a7050 con 0x7f5e54041640 2023-05-24T04:00:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f5e60faf640 1 -- 172.21.15.40:0/3614178756 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580ab980 con 0x7f5e54041640 2023-05-24T04:00:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e077fe640 1 -- 172.21.15.40:0/40512207 >> v1:172.21.15.67:6789/0 conn(0x7f7e0814ac00 legacy=0x7f7e0814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e077fe640 1 -- 172.21.15.40:0/40512207 >> v1:172.21.15.40:6789/0 conn(0x7f7e080bf9e0 legacy=0x7f7e0814e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240a59e0 con 0x7f881400b570 2023-05-24T04:00:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f7e077fe640 1 -- 172.21.15.40:0/40512207 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080bff30 con 0x7f7e0806a350 2023-05-24T04:00:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f16f548c640 1 -- 172.21.15.40:0/3271139797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f0070dc0 msgr2=0x7f16f00b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f16f548c640 1 --2- 172.21.15.40:0/3271139797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f0070dc0 0x7f16f00b54d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f16f00c11d0 tx=0x7f16e801c870 comp rx=0 tx=0).stop 2023-05-24T04:00:22.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7fcf97877640 1 -- 172.21.15.40:0/2015021082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 msgr2=0x7fcf880468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7fcf97877640 1 --2- 172.21.15.40:0/2015021082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880468e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009740 tx=0x7fcf8001c370 comp rx=0 tx=0).stop 2023-05-24T04:00:22.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88240a5b60 con 0x7f881400b570 2023-05-24T04:00:22.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.246+0000 7f8829ffb640 1 -- 172.21.15.40:0/4070230707 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240070d0 con 0x7f881400b570 2023-05-24T04:00:22.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcf97877640 1 -- 172.21.15.40:0/2015021082 shutdown_connections 2023-05-24T04:00:22.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcf97877640 1 --2- 172.21.15.40:0/2015021082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880468e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcf97877640 1 -- 172.21.15.40:0/2015021082 >> 172.21.15.40:0/2015021082 conn(0x7fcf88048070 msgr2=0x7fcf88048470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- 172.21.15.40:0/4070230707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881400b570 msgr2=0x7f881400da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881400b570 0x7f881400da20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88240021e0 tx=0x7f882401cb00 comp rx=0 tx=0).stop 2023-05-24T04:00:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- 172.21.15.40:0/4070230707 shutdown_connections 2023-05-24T04:00:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 --2- 172.21.15.40:0/4070230707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881400b570 0x7f881400da20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- 172.21.15.40:0/4070230707 >> 172.21.15.40:0/4070230707 conn(0x7f882c0c00d0 msgr2=0x7f882c0c04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- 172.21.15.40:0/3614178756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e54041640 msgr2=0x7f5e54042cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 --2- 172.21.15.40:0/3614178756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e54041640 0x7f5e54042cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b540 tx=0x7f5e5801c310 comp rx=0 tx=0).stop 2023-05-24T04:00:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb1ffff640 1 --2- 172.21.15.40:0/2016607512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1802a090 0x7fcb1802c8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb140097c0 tx=0x7fcb1401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a93306e8054e85a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcf97877640 1 -- 172.21.15.40:0/2015021082 shutdown_connections 2023-05-24T04:00:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- 172.21.15.40:0/3614178756 shutdown_connections 2023-05-24T04:00:22.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 --2- 172.21.15.40:0/3614178756 >> v2:172.21.15.67:3300/0 conn(0x7f5e5402ca50 0x7f5e540064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 --2- 172.21.15.40:0/3614178756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e54041640 0x7f5e54042cc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- 172.21.15.40:0/3614178756 >> 172.21.15.40:0/3614178756 conn(0x7f5e54043810 msgr2=0x7f5e54043be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 -- 172.21.15.40:0/3271139797 shutdown_connections 2023-05-24T04:00:22.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 --2- 172.21.15.40:0/3271139797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f0070dc0 0x7f16f00b54d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 --2- 172.21.15.40:0/3271139797 >> v2:172.21.15.67:3300/0 conn(0x7f16f006ce40 0x7f16f00b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 --2- 172.21.15.40:0/3271139797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f014ba20 0x7f16f0070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 -- 172.21.15.40:0/3271139797 >> 172.21.15.40:0/3271139797 conn(0x7f16f00c00d0 msgr2=0x7f16f00c04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- 172.21.15.40:0/3614178756 shutdown_connections 2023-05-24T04:00:22.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- 172.21.15.40:0/4070230707 shutdown_connections 2023-05-24T04:00:22.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- 172.21.15.40:0/4070230707 wait complete. 2023-05-24T04:00:22.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 Processor -- start 2023-05-24T04:00:22.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcf97877640 1 -- 172.21.15.40:0/2015021082 wait complete. 2023-05-24T04:00:22.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- 172.21.15.40:0/3614178756 wait complete. 2023-05-24T04:00:22.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 Processor -- start 2023-05-24T04:00:22.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 -- start start 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540a3b30 0x7fbd5406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd540bc170 0x7fbd540bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5406ea20 con 0x7fbd5414dd80 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5414e860 con 0x7fbd540bc170 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd5947a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540bcb10 con 0x7fbd540a3b30 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd52ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbd5414dd80 0x7fbd5414e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:52818/0 (socket says 172.21.15.40:52818) 2023-05-24T04:00:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd52ffd640 1 -- 172.21.15.40:0/2572230062 learned_addr learned my addr 172.21.15.40:0/2572230062 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 -- 172.21.15.40:0/3271139797 shutdown_connections 2023-05-24T04:00:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 -- 172.21.15.40:0/3271139797 wait complete. 2023-05-24T04:00:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 Processor -- start 2023-05-24T04:00:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcf97877640 1 Processor -- start 2023-05-24T04:00:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd527fc640 1 --2- 172.21.15.40:0/2572230062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540a3b30 0x7fbd5406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb1effd640 1 -- 172.21.15.40:0/2016607512 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140ab600 con 0x7fcb1802a090 2023-05-24T04:00:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb1effd640 1 -- 172.21.15.40:0/2016607512 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb140a7050 con 0x7fcb1802a090 2023-05-24T04:00:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb1effd640 1 -- 172.21.15.40:0/2016607512 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140ab980 con 0x7fcb1802a090 2023-05-24T04:00:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f7e077fe640 1 --2- 172.21.15.40:0/40512207 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e0814de20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00aa40 tx=0x7f7dfc01c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76aff48ad901932b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- start start 2023-05-24T04:00:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1802a090 msgr2=0x7fcb1802c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb25131640 1 --2- 172.21.15.40:0/2016607512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1802a090 0x7fcb1802c8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb140097c0 tx=0x7fcb1401c3f0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd51ffb640 1 -- 172.21.15.40:0/2572230062 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941467118 0 0) 0x7fbd5406ea20 con 0x7fbd5414dd80 2023-05-24T04:00:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd51ffb640 1 -- 172.21.15.40:0/2572230062 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd3c003530 con 0x7fbd5414dd80 2023-05-24T04:00:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 shutdown_connections 2023-05-24T04:00:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb25131640 1 --2- 172.21.15.40:0/2016607512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1802a090 0x7fcb1802c8b0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb140097c0 tx=0x7fcb1401c3f0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 >> 172.21.15.40:0/2016607512 conn(0x7fcb18043920 msgr2=0x7fcb18043cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f7e067fc640 1 -- 172.21.15.40:0/40512207 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0a5800 con 0x7f7e0806a350 2023-05-24T04:00:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd537fe640 1 --2- 172.21.15.40:0/2572230062 >> v2:172.21.15.40:3300/0 conn(0x7fbd540bc170 0x7fbd540bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f7e067fc640 1 -- 172.21.15.40:0/40512207 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc0a5960 con 0x7f7e0806a350 2023-05-24T04:00:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd527fc640 1 -- 172.21.15.40:0/2572230062 >> v2:172.21.15.40:3300/0 conn(0x7fbd540bc170 msgr2=0x7fbd540bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd527fc640 1 --2- 172.21.15.40:0/2572230062 >> v2:172.21.15.40:3300/0 conn(0x7fbd540bc170 0x7fbd540bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd527fc640 1 -- 172.21.15.40:0/2572230062 >> v1:172.21.15.67:6789/0 conn(0x7fbd5414dd80 legacy=0x7fbd5414e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd527fc640 1 -- 172.21.15.40:0/2572230062 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5414a430 con 0x7fbd540a3b30 2023-05-24T04:00:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7fbd537fe640 1 --2- 172.21.15.40:0/2572230062 >> v2:172.21.15.40:3300/0 conn(0x7fbd540bc170 0x7fbd540bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5402ca50 0x7f5e541799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- start start 2023-05-24T04:00:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f881400b570 0x7f882c1496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e54041640 0x7f5e540df820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e54043200 0x7f5e540db640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5417ac70 con 0x7f5e5402ca50 2023-05-24T04:00:22.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54179f10 con 0x7f5e54043200 2023-05-24T04:00:22.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e64215640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540dfd60 con 0x7f5e54041640 2023-05-24T04:00:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f882c142eb0 0x7f882c1e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f882c0bc0f0 0x7f882c1e6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c1d3b50 con 0x7f882c142eb0 2023-05-24T04:00:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c1e7490 con 0x7f881400b570 2023-05-24T04:00:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f8831317640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c149bf0 con 0x7f882c0bc0f0 2023-05-24T04:00:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f7e067fc640 1 -- 172.21.15.40:0/40512207 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0a5cd0 con 0x7f7e0806a350 2023-05-24T04:00:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f882c142eb0 0x7f882c1e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f882c142eb0 0x7f882c1e61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47642/0 (socket says 172.21.15.40:47642) 2023-05-24T04:00:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 -- 172.21.15.40:0/3085446636 learned_addr learned my addr 172.21.15.40:0/3085446636 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882affd640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f881400b570 0x7f882c1496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e627b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e54043200 0x7f5e540db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e627b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e54043200 0x7f5e540db640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53194/0 (socket says 172.21.15.40:53194) 2023-05-24T04:00:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f5e627b2640 1 -- 172.21.15.40:0/185039721 learned_addr learned my addr 172.21.15.40:0/185039721 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f7e0dd73640 1 -- 172.21.15.40:0/40512207 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 msgr2=0x7f7e0814de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f7e0dd73640 1 --2- 172.21.15.40:0/40512207 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e0814de20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00aa40 tx=0x7f7dfc01c7a0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f16f548c640 1 Processor -- start 2023-05-24T04:00:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 -- start start 2023-05-24T04:00:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 -- 172.21.15.40:0/3085446636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f882c0bc0f0 msgr2=0x7f882c1e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f882c0bc0f0 0x7f882c1e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 -- 172.21.15.40:0/3085446636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f881400b570 msgr2=0x7f882c1496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f881400b570 0x7f882c1496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.250+0000 7f882a7fc640 1 -- 172.21.15.40:0/3085446636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0719d0 con 0x7f882c142eb0 2023-05-24T04:00:22.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e617b0640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e54041640 0x7f5e540df820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f882a7fc640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f882c142eb0 0x7f882c1e61f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f882000c7b0 tx=0x7f882000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e627b2640 1 -- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e54041640 msgr2=0x7f5e540df820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e627b2640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e54041640 0x7f5e540df820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e627b2640 1 -- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5402ca50 msgr2=0x7f5e541799d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-24T04:00:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e627b2640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5402ca50 0x7f5e541799d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e627b2640 1 -- 172.21.15.40:0/185039721 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009420 con 0x7f5e54043200 2023-05-24T04:00:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820005280 con 0x7f882c142eb0 2023-05-24T04:00:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820005400 con 0x7f882c142eb0 2023-05-24T04:00:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000a880 con 0x7f882c142eb0 2023-05-24T04:00:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f8831317640 1 -- 172.21.15.40:0/3085446636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c071840 con 0x7f882c142eb0 2023-05-24T04:00:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f8831317640 1 -- 172.21.15.40:0/3085446636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c14a580 con 0x7f882c142eb0 2023-05-24T04:00:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 -- start start 2023-05-24T04:00:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f006ce40 0x7f16f006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f0070dc0 0x7f16f01475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f014ba20 0x7f16f0147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0148070 con 0x7f16f006ce40 2023-05-24T04:00:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00b9ca0 con 0x7f16f014ba20 2023-05-24T04:00:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00a4320 con 0x7f16f0070dc0 2023-05-24T04:00:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f7e0dd73640 1 -- 172.21.15.40:0/40512207 shutdown_connections 2023-05-24T04:00:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f7e0dd73640 1 --2- 172.21.15.40:0/40512207 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e0814de20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f7e0dd73640 1 -- 172.21.15.40:0/40512207 >> 172.21.15.40:0/40512207 conn(0x7f7e080a3270 msgr2=0x7f7e080699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf880273a0 0x7fcf88176130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf880424f0 0x7fcf88043180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8803c490 con 0x7fcf880273a0 2023-05-24T04:00:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8803bf70 con 0x7fcf8800b9b0 2023-05-24T04:00:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8803b920 con 0x7fcf880424f0 2023-05-24T04:00:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf94e12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf880273a0 0x7fcf88176130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf94e12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf880273a0 0x7fcf88176130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47648/0 (socket says 172.21.15.40:47648) 2023-05-24T04:00:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf94e12640 1 -- 172.21.15.40:0/695742816 learned_addr learned my addr 172.21.15.40:0/695742816 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f0070dc0 0x7f16f01475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f0070dc0 0x7f16f01475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58026/0 (socket says 172.21.15.40:58026) 2023-05-24T04:00:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 -- 172.21.15.40:0/1515318326 learned_addr learned my addr 172.21.15.40:0/1515318326 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f014ba20 0x7f16f0147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95e14640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf880424f0 0x7fcf88043180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e627b2640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e54043200 0x7f5e540db640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c02c880 tx=0x7f5e5c066920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 shutdown_connections 2023-05-24T04:00:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f8831317640 1 -- 172.21.15.40:0/3085446636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f882c073a30 con 0x7f882c142eb0 2023-05-24T04:00:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 -- 172.21.15.40:0/1515318326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f014ba20 msgr2=0x7f16f0147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f014ba20 0x7f16f0147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 -- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f006ce40 msgr2=0x7f16f006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fbd527fc640 1 --2- 172.21.15.40:0/2572230062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540a3b30 0x7fbd5406eeb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097c0 tx=0x7fbd480209b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23bd90ad55d500f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f006ce40 0x7f16f006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 -- 172.21.15.40:0/1515318326 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8009a70 con 0x7f16f0070dc0 2023-05-24T04:00:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c067d00 con 0x7f5e54043200 2023-05-24T04:00:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 -- 172.21.15.40:0/695742816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf880424f0 msgr2=0x7fcf88043180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf880424f0 0x7fcf88043180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 -- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf880273a0 msgr2=0x7fcf88176130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf880273a0 0x7fcf88176130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 -- 172.21.15.40:0/695742816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009420 con 0x7fcf8800b9b0 2023-05-24T04:00:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c067e60 con 0x7f5e54043200 2023-05-24T04:00:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0724e0 con 0x7f5e54043200 2023-05-24T04:00:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5403dcb0 con 0x7f5e54043200 2023-05-24T04:00:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ef7fe640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f0070dc0 0x7f16f01475f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b580 tx=0x7f16e000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fbd51ffb640 1 -- 172.21.15.40:0/2572230062 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480a9970 con 0x7fbd540a3b30 2023-05-24T04:00:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5403db20 con 0x7f5e54043200 2023-05-24T04:00:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf95613640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880ce200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c660 tx=0x7fcf80019110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0010870 con 0x7f16f0070dc0 2023-05-24T04:00:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f014cd90 con 0x7f16f0070dc0 2023-05-24T04:00:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcb25131640 1 -- 172.21.15.40:0/2016607512 wait complete. 2023-05-24T04:00:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcb25131640 1 Processor -- start 2023-05-24T04:00:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800b5810 con 0x7fcf8800b9b0 2023-05-24T04:00:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf800b5970 con 0x7fcf8800b9b0 2023-05-24T04:00:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800b5ce0 con 0x7fcf8800b9b0 2023-05-24T04:00:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8803b440 con 0x7fcf8800b9b0 2023-05-24T04:00:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8803b2b0 con 0x7fcf8800b9b0 2023-05-24T04:00:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00109f0 con 0x7f16f0070dc0 2023-05-24T04:00:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f014cc00 con 0x7f16f0070dc0 2023-05-24T04:00:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0010d60 con 0x7f16f0070dc0 2023-05-24T04:00:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16f014cf20 con 0x7f16f0070dc0 2023-05-24T04:00:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f882000a9e0 con 0x7f882c142eb0 2023-05-24T04:00:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f88137fe640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8818066300 0x7f88180687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8820083e10 con 0x7f882c142eb0 2023-05-24T04:00:22.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f88137fe640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f881806ff50 0x7f8818072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 --> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8818072a50 con 0x7f881806ff50 2023-05-24T04:00:22.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f7e0dd73640 1 -- 172.21.15.40:0/40512207 shutdown_connections 2023-05-24T04:00:22.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fbd51ffb640 1 -- 172.21.15.40:0/2572230062 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd480a9ad0 con 0x7fbd540a3b30 2023-05-24T04:00:22.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fbd51ffb640 1 -- 172.21.15.40:0/2572230062 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480a9e40 con 0x7fbd540a3b30 2023-05-24T04:00:22.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- 172.21.15.40:0/2572230062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540a3b30 msgr2=0x7fbd5406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 --2- 172.21.15.40:0/2572230062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540a3b30 0x7fbd5406eeb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097c0 tx=0x7fbd480209b0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f882affd640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8818066300 0x7f88180687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e54044c90 con 0x7f5e54043200 2023-05-24T04:00:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7fcb25131640 1 -- start start 2023-05-24T04:00:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb180068b0 0x7fcb1803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180d71d0 0x7fcb180ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb18025a20 0x7fcb180408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18171240 con 0x7fcb18025a20 2023-05-24T04:00:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180251e0 con 0x7fcb180068b0 2023-05-24T04:00:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181714c0 con 0x7fcb180d71d0 2023-05-24T04:00:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- 172.21.15.40:0/2572230062 shutdown_connections 2023-05-24T04:00:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 --2- 172.21.15.40:0/2572230062 >> v2:172.21.15.40:3300/0 conn(0x7fbd540bc170 0x7fbd540bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 --2- 172.21.15.40:0/2572230062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540a3b30 0x7fbd5406eeb0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097c0 tx=0x7fbd480209b0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- 172.21.15.40:0/2572230062 >> 172.21.15.40:0/2572230062 conn(0x7fbd540c0280 msgr2=0x7fbd540c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf8803b5d0 con 0x7fcf8800b9b0 2023-05-24T04:00:22.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1f7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180d71d0 0x7fcb180ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb180068b0 0x7fcb1803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- 172.21.15.40:0/2572230062 shutdown_connections 2023-05-24T04:00:22.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f882b7fe640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f881806ff50 0x7f8818072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f882affd640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8818066300 0x7f88180687b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f881c003670 tx=0x7f881c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.254+0000 7f7e0dd73640 1 -- 172.21.15.40:0/40512207 wait complete. 2023-05-24T04:00:22.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f7e0dd73640 1 Processor -- start 2023-05-24T04:00:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb180068b0 0x7fcb1803bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53218/0 (socket says 172.21.15.40:53218) 2023-05-24T04:00:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 -- 172.21.15.40:0/573828731 learned_addr learned my addr 172.21.15.40:0/573828731 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb24930640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb18025a20 0x7fcb180408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f882b7fe640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f881806ff50 0x7f8818072380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 -- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180d71d0 msgr2=0x7fcb180ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180d71d0 0x7fcb180ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 -- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb18025a20 msgr2=0x7fcb180408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb18025a20 0x7fcb180408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 -- 172.21.15.40:0/573828731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14009420 con 0x7fcb180068b0 2023-05-24T04:00:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- 172.21.15.40:0/2572230062 wait complete. 2023-05-24T04:00:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 Processor -- start 2023-05-24T04:00:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1ffff640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb180068b0 0x7fcb1803bb20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb14019000 tx=0x7fcb14019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16e000f3c0 con 0x7f16f0070dc0 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f16dc066280 0x7f16dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f16e0084600 con 0x7f16f0070dc0 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7f16dc06fed0 0x7f16dc072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 --> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16dc0729d0 con 0x7f16dc06fed0 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e00849b0 con 0x7f16f0070dc0 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16effff640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f16dc066280 0x7f16dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7f16dc06fed0 0x7f16dc072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f16f4c8b640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7f16dc06fed0 0x7f16dc072300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== osd.3 v2:172.21.15.40:6824/3065273304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8818072a50 con 0x7f881806ff50 2023-05-24T04:00:22.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8820082340 con 0x7f882c142eb0 2023-05-24T04:00:22.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e5c061020 con 0x7f5e54043200 2023-05-24T04:00:22.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e527fc640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5e40066280 0x7f5e40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e5c0fcd60 con 0x7f5e54043200 2023-05-24T04:00:22.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e61fb1640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5e40066280 0x7f5e40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e527fc640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f5e4006fed0 0x7f5e40072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 --> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e400729d0 con 0x7f5e4006fed0 2023-05-24T04:00:22.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5c0fd0d0 con 0x7f5e54043200 2023-05-24T04:00:22.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- start start 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd540bc170 0x7fbd540bf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd5414dd80 0x7fbd54138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540bf880 0x7fbd54139510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541eaa20 con 0x7fbd540bc170 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54139a50 con 0x7fbd5414dd80 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd5947a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541eea20 con 0x7fbd540bf880 2023-05-24T04:00:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd527fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd5414dd80 0x7fbd54138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540bf880 0x7fbd54139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd527fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd5414dd80 0x7fbd54138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53222/0 (socket says 172.21.15.40:53222) 2023-05-24T04:00:22.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd527fc640 1 -- 172.21.15.40:0/3200704836 learned_addr learned my addr 172.21.15.40:0/3200704836 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fbd52ffd640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd540bc170 0x7fbd540bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140b4400 con 0x7fcb180068b0 2023-05-24T04:00:22.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb140b45a0 con 0x7fcb180068b0 2023-05-24T04:00:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140b4950 con 0x7fcb180068b0 2023-05-24T04:00:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1803dc30 con 0x7fcb180068b0 2023-05-24T04:00:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb18045410 con 0x7fcb180068b0 2023-05-24T04:00:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb1803ddc0 con 0x7fcb180068b0 2023-05-24T04:00:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd537fe640 1 -- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd5414dd80 msgr2=0x7fbd54138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd537fe640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd5414dd80 0x7fbd54138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd537fe640 1 -- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd540bc170 msgr2=0x7fbd540bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd537fe640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd540bc170 0x7fbd540bf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd537fe640 1 -- 172.21.15.40:0/3200704836 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48009420 con 0x7fbd540bf880 2023-05-24T04:00:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f7e0dd73640 1 -- start start 2023-05-24T04:00:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e081ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e080bf9e0 0x7f7e0814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0814ac00 0x7f7e08140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080badb0 con 0x7f7e0814ac00 2023-05-24T04:00:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081ea270 con 0x7f7e080bf9e0 2023-05-24T04:00:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080a38e0 con 0x7f7e0806a350 2023-05-24T04:00:22.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== osd.2 v2:172.21.15.40:6816/307115548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f16dc0729d0 con 0x7f16dc06fed0 2023-05-24T04:00:22.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e06ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e080bf9e0 0x7f7e0814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e081ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e06ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e080bf9e0 0x7f7e0814d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53224/0 (socket says 172.21.15.40:53224) 2023-05-24T04:00:22.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e06ffd640 1 -- 172.21.15.40:0/3151349711 learned_addr learned my addr 172.21.15.40:0/3151349711 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd537fe640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540bf880 0x7fbd54139510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00cdf0 tx=0x7fbd4c00a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00d840 con 0x7fbd540bf880 2023-05-24T04:00:22.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540a4d40 con 0x7fbd540bf880 2023-05-24T04:00:22.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd540a4bb0 con 0x7fbd540bf880 2023-05-24T04:00:22.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c00d9a0 con 0x7fbd540bf880 2023-05-24T04:00:22.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00dd90 con 0x7fbd540bf880 2023-05-24T04:00:22.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 -- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e080bf9e0 msgr2=0x7f7e0814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e080bf9e0 0x7f7e0814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 -- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0814ac00 msgr2=0x7f7e08140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0814ac00 0x7f7e08140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 -- 172.21.15.40:0/3151349711 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc00a670 con 0x7f7e0806a350 2023-05-24T04:00:22.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e077fe640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e081ee250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0ac000 tx=0x7f7dfc019540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f3ded0de640 1 Processor -- start 2023-05-24T04:00:22.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f3ded0de640 1 -- start start 2023-05-24T04:00:22.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f16effff640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f16dc066280 0x7f16dc068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16e4006f50 tx=0x7f16e4006ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.258+0000 7f5e617b0640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f5e4006fed0 0x7f5e40072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f5e61fb1640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5e40066280 0x7f5e40068730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ad000 tx=0x7f5e580a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd34000fd0 con 0x7fbd540bf880 2023-05-24T04:00:22.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb140b2040 con 0x7fcb180068b0 2023-05-24T04:00:22.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1cff9640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcb04066280 0x7fcb04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcb1411e160 con 0x7fcb180068b0 2023-05-24T04:00:22.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0a5800 con 0x7f7e0806a350 2023-05-24T04:00:22.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc0ad850 con 0x7f7e0806a350 2023-05-24T04:00:22.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0adbe0 con 0x7f7e0806a350 2023-05-24T04:00:22.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f3ded0de640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3de814aad0 0x7f3de80a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f3ded0de640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de806cb80 0x7f3de806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f3ded0de640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80a4790 con 0x7f3de814e650 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3ded0de640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80a44b0 con 0x7f3de814aad0 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3ded0de640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80a4aa0 con 0x7f3de806cb80 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3de7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3de814aad0 0x7f3de80a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3dec8dd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3de814e650 0x7f3de814eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:52830/0 (socket says 172.21.15.40:52830) 2023-05-24T04:00:22.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3dec8dd640 1 -- 172.21.15.40:0/1833177365 learned_addr learned my addr 172.21.15.40:0/1833177365 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3de77fe640 1 --2- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de806cb80 0x7f3de806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf800b3040 con 0x7fcf8800b9b0 2023-05-24T04:00:22.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf85ffb640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcf74066350 0x7fcf74068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf8011eaa0 con 0x7fcf8800b9b0 2023-05-24T04:00:22.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf85ffb640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7fcf74070020 0x7fcf74072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 --> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf74072b20 con 0x7fcf74070020 2023-05-24T04:00:22.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf8011ee50 con 0x7fcf8800b9b0 2023-05-24T04:00:22.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf95e14640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7fcf74070020 0x7fcf74072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf94e12640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcf74066350 0x7fcf74068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcf95e14640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7fcf74070020 0x7fcf74072450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f5e617b0640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f5e4006fed0 0x7f5e40072300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 -- 172.21.15.40:0/3151349711 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e080a02b0 con 0x7f7e0806a350 2023-05-24T04:00:22.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7f7e0dd73640 1 -- 172.21.15.40:0/3151349711 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e080a0120 con 0x7f7e0806a350 2023-05-24T04:00:22.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7e0dd73640 1 -- 172.21.15.40:0/3151349711 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e0814ea70 con 0x7f7e0806a350 2023-05-24T04:00:22.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1cff9640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7fcb0406ff50 0x7fcb04072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 --> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb04072a50 con 0x7fcb0406ff50 2023-05-24T04:00:22.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb1411e510 con 0x7fcb180068b0 2023-05-24T04:00:22.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.262+0000 7fcb1f7fe640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcb04066280 0x7fcb04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3de7fff640 1 -- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de806cb80 msgr2=0x7f3de806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3de7fff640 1 --2- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de806cb80 0x7f3de806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3de7fff640 1 -- 172.21.15.40:0/1833177365 >> v1:172.21.15.67:6789/0 conn(0x7f3de814e650 legacy=0x7f3de814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f3de7fff640 1 -- 172.21.15.40:0/1833177365 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80bd940 con 0x7f3de814aad0 2023-05-24T04:00:22.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fcf94e12640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcf74066350 0x7fcf74068800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf880e6090 tx=0x7fcf8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fcb24930640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7fcb0406ff50 0x7fcb04072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd4c01f440 con 0x7fbd540bf880 2023-05-24T04:00:22.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fcb1f7fe640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcb04066280 0x7fcb04068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb180d66c0 tx=0x7fcb0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== osd.1 v2:172.21.15.40:6800/2352123931 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcf74072b20 con 0x7fcf74070020 2023-05-24T04:00:22.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fcb24930640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7fcb0406ff50 0x7fcb04072380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd3b7fe640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbd40066280 0x7fbd40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd4c084c90 con 0x7fbd540bf880 2023-05-24T04:00:22.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd3b7fe640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7fbd4006ff50 0x7fbd40072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 --> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd40072a50 con 0x7fbd4006ff50 2023-05-24T04:00:22.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4c085040 con 0x7fbd540bf880 2023-05-24T04:00:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== osd.4 v2:172.21.15.67:6800/3240304785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5e400729d0 con 0x7f5e4006fed0 2023-05-24T04:00:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd527fc640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7fbd4006ff50 0x7fbd40072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7fbd527fc640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7fbd4006ff50 0x7fbd40072380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7dfc0b4050 con 0x7f7e0806a350 2023-05-24T04:00:22.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7df3fff640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7dec066350 0x7f7dec068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7dfc11eed0 con 0x7f7e0806a350 2023-05-24T04:00:22.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7df3fff640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f7dec070020 0x7f7dec072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 --> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7dec072b20 con 0x7f7dec070020 2023-05-24T04:00:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dfc11f280 con 0x7f7e0806a350 2023-05-24T04:00:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7e06ffd640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7dec066350 0x7f7dec068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.266+0000 7f7e07fff640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f7dec070020 0x7f7dec072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f3de7fff640 1 --2- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de814aad0 0x7f3de80a4f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80097c0 tx=0x7f3dd801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd2a5b7a9b11d5e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== osd.7 v2:172.21.15.67:6808/1243939275 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcb04072a50 con 0x7fcb0406ff50 2023-05-24T04:00:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f7e06ffd640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7dec066350 0x7f7dec068800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e081454d0 tx=0x7f7df4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f3de6ffd640 1 -- 172.21.15.40:0/1833177365 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80ab600 con 0x7f3de814aad0 2023-05-24T04:00:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f7e07fff640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f7dec070020 0x7f7dec072450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f3de6ffd640 1 -- 172.21.15.40:0/1833177365 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd80a7050 con 0x7f3de814aad0 2023-05-24T04:00:22.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f3de6ffd640 1 -- 172.21.15.40:0/1833177365 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80ab980 con 0x7f3de814aad0 2023-05-24T04:00:22.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== osd.6 v2:172.21.15.67:6813/1569713889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbd40072a50 con 0x7fbd4006ff50 2023-05-24T04:00:22.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f3ded0de640 1 -- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de814aad0 msgr2=0x7f3de80a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f3ded0de640 1 --2- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de814aad0 0x7f3de80a4f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80097c0 tx=0x7f3dd801c360 comp rx=0 tx=0).stop 2023-05-24T04:00:22.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.270+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== osd.5 v2:172.21.15.67:6824/4067900882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7dec072b20 con 0x7f7dec070020 2023-05-24T04:00:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.274+0000 7f3ded0de640 1 -- 172.21.15.40:0/1833177365 shutdown_connections 2023-05-24T04:00:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.274+0000 7f3ded0de640 1 --2- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de806cb80 0x7f3de806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.274+0000 7f3ded0de640 1 --2- 172.21.15.40:0/1833177365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de814aad0 0x7f3de80a4f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.274+0000 7f3ded0de640 1 -- 172.21.15.40:0/1833177365 >> 172.21.15.40:0/1833177365 conn(0x7f3de80c1280 msgr2=0x7f3de80c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.274+0000 7fbd52ffd640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbd40066280 0x7fbd40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.274+0000 7fbd52ffd640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbd40066280 0x7fbd40068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd440049e0 tx=0x7fbd44005f80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 -- 172.21.15.40:0/1833177365 shutdown_connections 2023-05-24T04:00:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 -- 172.21.15.40:0/1833177365 wait complete. 2023-05-24T04:00:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f8831317640 1 -- 172.21.15.40:0/3085446636 --> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f882c141ad0 con 0x7f881806ff50 2023-05-24T04:00:22.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 Processor -- start 2023-05-24T04:00:22.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 -- start start 2023-05-24T04:00:22.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f88137fe640 1 -- 172.21.15.40:0/3085446636 <== osd.3 v2:172.21.15.40:6824/3065273304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f882c141ad0 con 0x7f881806ff50 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de806cb80 0x7f3de814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de814aad0 0x7f3de81483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.278+0000 7f3ded0de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de814e650 0x7f3de8148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3ded0de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8145370 con 0x7f3de814e650 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3ded0de640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81472b0 con 0x7f3de806cb80 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3ded0de640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8149860 con 0x7f3de814aad0 2023-05-24T04:00:22.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de814e650 0x7f3de8148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3de7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de806cb80 0x7f3de814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de814e650 0x7f3de8148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47692/0 (socket says 172.21.15.40:47692) 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 -- 172.21.15.40:0/22025417 learned_addr learned my addr 172.21.15.40:0/22025417 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3de77fe640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de814aad0 0x7f3de81483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 -- 172.21.15.40:0/22025417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de814aad0 msgr2=0x7f3de81483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de814aad0 0x7f3de81483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 -- 172.21.15.40:0/22025417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de806cb80 msgr2=0x7f3de814d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de806cb80 0x7f3de814d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 -- 172.21.15.40:0/22025417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8009420 con 0x7f3de814e650 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3dec8dd640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de814e650 0x7f3de8148920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3de000ca80 tx=0x7f3de000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000ac30 con 0x7f3de814e650 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000ad90 con 0x7f3de814e650 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0012600 con 0x7f3de814e650 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de8156380 con 0x7f3de814e650 2023-05-24T04:00:22.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.282+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de81561f0 con 0x7f3de814e650 2023-05-24T04:00:22.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3de0007070 con 0x7f3de814e650 2023-05-24T04:00:22.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3de4ff9640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3dd4066280 0x7f3dd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3de0083d50 con 0x7f3de814e650 2023-05-24T04:00:22.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3de7fff640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3dd4066280 0x7f3dd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f881806ff50 msgr2=0x7f8818072380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f881806ff50 0x7f8818072380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8818066300 msgr2=0x7f88180687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8818066300 0x7f88180687b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f881c003670 tx=0x7f881c008040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f882c142eb0 msgr2=0x7f882c1e61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 --2- 172.21.15.40:0/3085446636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f882c142eb0 0x7f882c1e61f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f882000c7b0 tx=0x7f882000cbb0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3de7fff640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3dd4066280 0x7f3dd4068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80ad000 tx=0x7f3dd80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f882b7fe640 1 -- 172.21.15.40:0/3085446636 reap_dead start 2023-05-24T04:00:22.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 shutdown_connections 2023-05-24T04:00:22.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 >> 172.21.15.40:0/3085446636 conn(0x7f882c0c00d0 msgr2=0x7f882c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 shutdown_connections 2023-05-24T04:00:22.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f88117fa640 1 -- 172.21.15.40:0/3085446636 wait complete. 2023-05-24T04:00:22.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3ded0de640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7f3de81499d0 0x7f3de806a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.286+0000 7f3de77fe640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7f3de81499d0 0x7f3de806a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f3de77fe640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7f3de81499d0 0x7f3de806a0f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 --> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3de81473f0 con 0x7f3de81499d0 2023-05-24T04:00:22.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== osd.0 v2:172.21.15.40:6806/2887735176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3de81473f0 con 0x7f3de81499d0 2023-05-24T04:00:22.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 --> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb181716c0 con 0x7fcb0406ff50 2023-05-24T04:00:22.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 --> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16f014cf20 con 0x7f16dc06fed0 2023-05-24T04:00:22.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16ecff9640 1 -- 172.21.15.40:0/1515318326 <== osd.2 v2:172.21.15.40:6816/307115548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16f014cf20 con 0x7f16dc06fed0 2023-05-24T04:00:22.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb1cff9640 1 -- 172.21.15.40:0/573828731 <== osd.7 v2:172.21.15.67:6808/1243939275 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb181716c0 con 0x7fcb0406ff50 2023-05-24T04:00:22.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7f16dc06fed0 msgr2=0x7f16dc072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7f16dc06fed0 0x7f16dc072300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7fcb0406ff50 msgr2=0x7fcb04072380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7fcb0406ff50 0x7fcb04072380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f16dc066280 msgr2=0x7f16dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcb04066280 msgr2=0x7fcb04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcb04066280 0x7fcb04068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb180d66c0 tx=0x7fcb0c009040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f16dc066280 0x7f16dc068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16e4006f50 tx=0x7f16e4006ea0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f0070dc0 msgr2=0x7f16f01475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 --2- 172.21.15.40:0/1515318326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f0070dc0 0x7f16f01475f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b580 tx=0x7f16e000ba40 comp rx=0 tx=0).stop 2023-05-24T04:00:22.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f4c8b640 1 -- 172.21.15.40:0/1515318326 reap_dead start 2023-05-24T04:00:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 --> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf88176670 con 0x7fcf74070020 2023-05-24T04:00:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 shutdown_connections 2023-05-24T04:00:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb180068b0 msgr2=0x7fcb1803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 --2- 172.21.15.40:0/573828731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb180068b0 0x7fcb1803bb20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb14019000 tx=0x7fcb14019190 comp rx=0 tx=0).stop 2023-05-24T04:00:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb24930640 1 -- 172.21.15.40:0/573828731 reap_dead start 2023-05-24T04:00:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 >> 172.21.15.40:0/1515318326 conn(0x7f16f00c00d0 msgr2=0x7f16f0149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 shutdown_connections 2023-05-24T04:00:22.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 >> 172.21.15.40:0/573828731 conn(0x7fcb18043920 msgr2=0x7fcb18041680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 shutdown_connections 2023-05-24T04:00:22.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.290+0000 7f16f548c640 1 -- 172.21.15.40:0/1515318326 wait complete. 2023-05-24T04:00:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 shutdown_connections 2023-05-24T04:00:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcb25131640 1 -- 172.21.15.40:0/573828731 wait complete. 2023-05-24T04:00:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf85ffb640 1 -- 172.21.15.40:0/695742816 <== osd.1 v2:172.21.15.40:6800/2352123931 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf88176670 con 0x7fcf74070020 2023-05-24T04:00:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7fcf74070020 msgr2=0x7fcf74072450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7fcf74070020 0x7fcf74072450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcf74066350 msgr2=0x7fcf74068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fcf74066350 0x7fcf74068800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf880e6090 tx=0x7fcf8c009040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 msgr2=0x7fcf880ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 --2- 172.21.15.40:0/695742816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf8800b9b0 0x7fcf880ce200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c660 tx=0x7fcf80019110 comp rx=0 tx=0).stop 2023-05-24T04:00:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf95e14640 1 -- 172.21.15.40:0/695742816 reap_dead start 2023-05-24T04:00:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 shutdown_connections 2023-05-24T04:00:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 >> 172.21.15.40:0/695742816 conn(0x7fcf88048070 msgr2=0x7fcf88029120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 shutdown_connections 2023-05-24T04:00:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7fcf97877640 1 -- 172.21.15.40:0/695742816 wait complete. 2023-05-24T04:00:22.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.294+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 --> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e54005280 con 0x7f5e4006fed0 2023-05-24T04:00:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.298+0000 7f5e527fc640 1 -- 172.21.15.40:0/185039721 <== osd.4 v2:172.21.15.67:6800/3240304785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e54005280 con 0x7f5e4006fed0 2023-05-24T04:00:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.298+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 --> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd34002cc0 con 0x7fbd4006ff50 2023-05-24T04:00:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f5e4006fed0 msgr2=0x7f5e40072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f5e4006fed0 0x7f5e40072300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd3b7fe640 1 -- 172.21.15.40:0/3200704836 <== osd.6 v2:172.21.15.67:6813/1569713889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd34002cc0 con 0x7fbd4006ff50 2023-05-24T04:00:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7fbd4006ff50 msgr2=0x7fbd40072380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7fbd4006ff50 0x7fbd40072380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5e40066280 msgr2=0x7f5e40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5e40066280 0x7f5e40068730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ad000 tx=0x7f5e580a6000 comp rx=0 tx=0).stop 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e54043200 msgr2=0x7f5e540db640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 --2- 172.21.15.40:0/185039721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e54043200 0x7f5e540db640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c02c880 tx=0x7f5e5c066920 comp rx=0 tx=0).stop 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e627b2640 1 -- 172.21.15.40:0/185039721 reap_dead start 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 shutdown_connections 2023-05-24T04:00:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 >> 172.21.15.40:0/185039721 conn(0x7f5e54043810 msgr2=0x7f5e540dffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbd40066280 msgr2=0x7fbd40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbd40066280 0x7fbd40068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd440049e0 tx=0x7fbd44005f80 comp rx=0 tx=0).stop 2023-05-24T04:00:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540bf880 msgr2=0x7fbd54139510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 --2- 172.21.15.40:0/3200704836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd540bf880 0x7fbd54139510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00cdf0 tx=0x7fbd4c00a710 comp rx=0 tx=0).stop 2023-05-24T04:00:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd537fe640 1 -- 172.21.15.40:0/3200704836 reap_dead start 2023-05-24T04:00:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 shutdown_connections 2023-05-24T04:00:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 >> 172.21.15.40:0/3200704836 conn(0x7fbd540c0280 msgr2=0x7fbd5406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 shutdown_connections 2023-05-24T04:00:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7fbd5947a640 1 -- 172.21.15.40:0/3200704836 wait complete. 2023-05-24T04:00:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f7e0dd73640 1 -- 172.21.15.40:0/3151349711 --> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e0814ea70 con 0x7f7dec070020 2023-05-24T04:00:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 shutdown_connections 2023-05-24T04:00:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f5e64215640 1 -- 172.21.15.40:0/185039721 wait complete. 2023-05-24T04:00:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.302+0000 7f7df3fff640 1 -- 172.21.15.40:0/3151349711 <== osd.5 v2:172.21.15.67:6824/4067900882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e0814ea70 con 0x7f7dec070020 2023-05-24T04:00:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f7dec070020 msgr2=0x7f7dec072450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f7dec070020 0x7f7dec072450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7dec066350 msgr2=0x7f7dec068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7dec066350 0x7f7dec068800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e081454d0 tx=0x7f7df4009040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 msgr2=0x7f7e081ee250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 --2- 172.21.15.40:0/3151349711 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0806a350 0x7f7e081ee250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0ac000 tx=0x7f7dfc019540 comp rx=0 tx=0).stop 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7e07fff640 1 -- 172.21.15.40:0/3151349711 reap_dead start 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 shutdown_connections 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 >> 172.21.15.40:0/3151349711 conn(0x7f7e080a3270 msgr2=0x7f7e080a1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 shutdown_connections 2023-05-24T04:00:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.306+0000 7f7df1ffb640 1 -- 172.21.15.40:0/3151349711 wait complete. 2023-05-24T04:00:22.388 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-24T04:00:22.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 --> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3de8073a30 con 0x7f3de81499d0 2023-05-24T04:00:22.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3de4ff9640 1 -- 172.21.15.40:0/22025417 <== osd.0 v2:172.21.15.40:6806/2887735176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3de8073a30 con 0x7f3de81499d0 2023-05-24T04:00:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7f3de81499d0 msgr2=0x7f3de806a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7f3de81499d0 0x7f3de806a0f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3dd4066280 msgr2=0x7f3dd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f3dd4066280 0x7f3dd4068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80ad000 tx=0x7f3dd80a6000 comp rx=0 tx=0).stop 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de814e650 msgr2=0x7f3de8148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 --2- 172.21.15.40:0/22025417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de814e650 0x7f3de8148920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3de000ca80 tx=0x7f3de000cf40 comp rx=0 tx=0).stop 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3dec8dd640 1 -- 172.21.15.40:0/22025417 reap_dead start 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 shutdown_connections 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 >> 172.21.15.40:0/22025417 conn(0x7f3de80c1280 msgr2=0x7f3de80699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 shutdown_connections 2023-05-24T04:00:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.318+0000 7f3ded0de640 1 -- 172.21.15.40:0/22025417 wait complete. 2023-05-24T04:00:22.392 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-24T04:00:22.393 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-24T04:00:22.394 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-05-24T04:00:22.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-24T04:00:22.395 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-24T04:00:22.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-24T04:00:22.396 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-24T04:00:22.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-24T04:00:22.397 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-24T04:00:22.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-24T04:00:22.398 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-24T04:00:22.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:22.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:22.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:22.444 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:22.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.594+0000 7f6e8c5d6640 1 Processor -- start 2023-05-24T04:00:22.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.594+0000 7f6e8c5d6640 1 -- start start 2023-05-24T04:00:22.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.594+0000 7f6e8c5d6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 0x7f6e8414e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.594+0000 7f6e8c5d6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8406f110 con 0x7f6e8414dab0 2023-05-24T04:00:22.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.594+0000 7f6e8c5d6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e840bc1f0 con 0x7f6e840bc740 2023-05-24T04:00:22.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.594+0000 7f6e8c5d6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8406eda0 con 0x7f6e8406ca40 2023-05-24T04:00:22.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e8a372640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e8414dab0 0x7f6e8406c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45066/0 (socket says 172.21.15.40:45066) 2023-05-24T04:00:22.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e8a372640 1 -- 172.21.15.40:0/2739395767 learned_addr learned my addr 172.21.15.40:0/2739395767 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e8ab73640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 0x7f6e8414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709260807 0 0) 0x7f6e8406f110 con 0x7f6e8414dab0 2023-05-24T04:00:22.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e70003530 con 0x7f6e8414dab0 2023-05-24T04:00:22.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536342947 0 0) 0x7f6e70003530 con 0x7f6e8414dab0 2023-05-24T04:00:22.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 msgr2=0x7f6e8414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 0x7f6e8414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 >> v1:172.21.15.67:6789/0 conn(0x7f6e840bc740 legacy=0x7f6e8414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8414b3c0 con 0x7f6e8414dab0 2023-05-24T04:00:22.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f6e80001680 con 0x7f6e8414dab0 2023-05-24T04:00:22.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 >> v1:172.21.15.40:6789/0 conn(0x7f6e8414dab0 legacy=0x7f6e8406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 0x7f6e700039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e70003f70 0x7f6e700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e70004d10 0x7f6e70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8406eda0 con 0x7f6e70004d10 2023-05-24T04:00:22.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7000bba0 con 0x7f6e70003f70 2023-05-24T04:00:22.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7000bd60 con 0x7f6e8406ca40 2023-05-24T04:00:22.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e8ab73640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e70004d10 0x7f6e70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89b71640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e70003f70 0x7f6e700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e8a372640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 0x7f6e700039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89b71640 1 -- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 msgr2=0x7f6e700039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89b71640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e8406ca40 0x7f6e700039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89b71640 1 -- 172.21.15.40:0/2739395767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e70004d10 msgr2=0x7f6e70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89b71640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e70004d10 0x7f6e70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e89b71640 1 -- 172.21.15.40:0/2739395767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8414b3c0 con 0x7f6e70003f70 2023-05-24T04:00:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.598+0000 7f6e8ab73640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e70004d10 0x7f6e70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e89b71640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e70003f70 0x7f6e700047d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e74001750 tx=0x7f6e7401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c46049e009a8e53 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740050d0 con 0x7f6e70003f70 2023-05-24T04:00:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740a7050 con 0x7f6e70003f70 2023-05-24T04:00:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e89370640 1 -- 172.21.15.40:0/2739395767 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74005490 con 0x7f6e70003f70 2023-05-24T04:00:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e70003f70 msgr2=0x7f6e700047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8c5d6640 1 --2- 172.21.15.40:0/2739395767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e70003f70 0x7f6e700047d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e74001750 tx=0x7f6e7401c3c0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8ab73640 1 -- 172.21.15.40:0/2739395767 reap_dead start 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/2739395767 shutdown_connections 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/2739395767 >> 172.21.15.40:0/2739395767 conn(0x7f6e840c00d0 msgr2=0x7f6e840c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/2739395767 shutdown_connections 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.602+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/2739395767 wait complete. 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 Processor -- start 2023-05-24T04:00:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 -- start start 2023-05-24T04:00:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 Processor -- start 2023-05-24T04:00:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 Processor -- start 2023-05-24T04:00:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 -- start start 2023-05-24T04:00:22.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 -- start start 2023-05-24T04:00:22.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e84138c90 0x7f6e84139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 0x7f6e841e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e841e88e0 0x7f6e841e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84139c80 con 0x7f6e841e7f50 2023-05-24T04:00:22.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841396c0 con 0x7f6e84138c90 2023-05-24T04:00:22.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841399a0 con 0x7f6e841e88e0 2023-05-24T04:00:22.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 0x7f6e841e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 0x7f6e841e83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47700/0 (socket says 172.21.15.40:47700) 2023-05-24T04:00:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 -- 172.21.15.40:0/1786892435 learned_addr learned my addr 172.21.15.40:0/1786892435 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8ab73640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e841e88e0 0x7f6e841e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8a372640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e84138c90 0x7f6e84139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1000464b0 0x7fc100028610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc100048ce0 0x7fc10002ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10002ef70 con 0x7fc1000280e0 2023-05-24T04:00:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000471d0 con 0x7fc1000464b0 2023-05-24T04:00:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10759e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10003c880 con 0x7fc100048ce0 2023-05-24T04:00:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1000464b0 0x7fc100028610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 -- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e841e88e0 msgr2=0x7f6e841e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e841e88e0 0x7f6e841e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 -- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e84138c90 msgr2=0x7f6e84139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e84138c90 0x7f6e84139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 -- 172.21.15.40:0/1786892435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840a5320 con 0x7f6e841e7f50 2023-05-24T04:00:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1000464b0 0x7fc100028610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47716/0 (socket says 172.21.15.40:47716) 2023-05-24T04:00:22.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 -- 172.21.15.40:0/3838201948 learned_addr learned my addr 172.21.15.40:0/3838201948 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede806ce90 0x7fede814a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e89b71640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 0x7f6e841e83a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6e7401c1f0 tx=0x7f6e70005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74007230 con 0x7f6e841e7f50 2023-05-24T04:00:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc105d9b640 1 --2- 172.21.15.40:0/3838201948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc100048ce0 0x7fc10002ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 -- 172.21.15.40:0/3838201948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc100048ce0 msgr2=0x7fc10002ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 --2- 172.21.15.40:0/3838201948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc100048ce0 0x7fc10002ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 -- 172.21.15.40:0/3838201948 >> v1:172.21.15.67:6789/0 conn(0x7fc1000280e0 legacy=0x7fc1000d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fc10659c640 1 -- 172.21.15.40:0/3838201948 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000480c0 con 0x7fc1000464b0 2023-05-24T04:00:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fede814aad0 0x7fede8070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede8070660 con 0x7fede8070a30 2023-05-24T04:00:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede80a57a0 con 0x7fede814aad0 2023-05-24T04:00:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7feded4a1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede8071990 con 0x7fede806ce90 2023-05-24T04:00:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fede77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fede8070a30 0x7fede806fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45078/0 (socket says 172.21.15.40:45078) 2023-05-24T04:00:22.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fede77fe640 1 -- 172.21.15.40:0/3765570421 learned_addr learned my addr 172.21.15.40:0/3765570421 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7fedecca0640 1 --2- 172.21.15.40:0/3765570421 >> v2:172.21.15.67:3300/0 conn(0x7fede814aad0 0x7fede8070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f13d2d61640 1 Processor -- start 2023-05-24T04:00:22.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f13d2d61640 1 -- start start 2023-05-24T04:00:22.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.606+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/1786892435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8414e770 con 0x7f6e841e7f50 2023-05-24T04:00:22.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/1786892435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e840a54b0 con 0x7f6e841e7f50 2023-05-24T04:00:22.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fede7fff640 1 --2- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede806ce90 0x7fede814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fede6ffd640 1 -- 172.21.15.40:0/3765570421 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932763233 0 0) 0x7fede8070660 con 0x7fede8070a30 2023-05-24T04:00:22.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fede6ffd640 1 -- 172.21.15.40:0/3765570421 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd0003530 con 0x7fede8070a30 2023-05-24T04:00:22.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fedecca0640 1 -- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede806ce90 msgr2=0x7fede814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fedecca0640 1 --2- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede806ce90 0x7fede814a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fedecca0640 1 -- 172.21.15.40:0/3765570421 >> v1:172.21.15.40:6789/0 conn(0x7fede8070a30 legacy=0x7fede806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fedecca0640 1 -- 172.21.15.40:0/3765570421 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8071c90 con 0x7fede814aad0 2023-05-24T04:00:22.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740a4ec0 con 0x7f6e841e7f50 2023-05-24T04:00:22.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74007590 con 0x7f6e841e7f50 2023-05-24T04:00:22.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/1786892435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c005260 con 0x7f6e841e7f50 2023-05-24T04:00:22.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d2d61640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13cc0a3cf0 0x7f13cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d2d61640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f13cc1533a0 0x7f13cc0a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d2d61640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc155f20 con 0x7f13cc0699e0 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d2d61640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc155d10 con 0x7f13cc0a3cf0 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d2d61640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc152720 con 0x7f13cc1533a0 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d2560640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f13cc1533a0 0x7f13cc0a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13cc0a3cf0 0x7f13cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13cc0a3cf0 0x7f13cc069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47730/0 (socket says 172.21.15.40:47730) 2023-05-24T04:00:22.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 -- 172.21.15.40:0/3426833133 learned_addr learned my addr 172.21.15.40:0/3426833133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 Processor -- start 2023-05-24T04:00:22.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d13fff640 1 Processor -- start 2023-05-24T04:00:22.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d13fff640 1 -- start start 2023-05-24T04:00:22.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fc10659c640 1 --2- 172.21.15.40:0/3838201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000464b0 0x7fc100028610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009870 tx=0x7fc0f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5bc945e88a656c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fc10559a640 1 -- 172.21.15.40:0/3838201948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80ab600 con 0x7fc1000464b0 2023-05-24T04:00:22.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 -- start start 2023-05-24T04:00:22.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1698044350 0x7f1698045070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698043250 0x7f16980d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169802cf30 con 0x7f16980d5080 2023-05-24T04:00:22.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1698045e90 con 0x7f1698044350 2023-05-24T04:00:22.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a6af9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980420c0 con 0x7f1698043250 2023-05-24T04:00:22.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e740067e0 con 0x7f6e841e7f50 2023-05-24T04:00:22.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e7affd640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6e68066280 0x7f6e68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e7411dad0 con 0x7f6e841e7f50 2023-05-24T04:00:22.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 -- 172.21.15.40:0/3426833133 >> v2:172.21.15.67:3300/0 conn(0x7f13cc1533a0 msgr2=0x7f13cc0a25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 --2- 172.21.15.40:0/3426833133 >> v2:172.21.15.67:3300/0 conn(0x7f13cc1533a0 0x7f13cc0a25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 -- 172.21.15.40:0/3426833133 >> v1:172.21.15.40:6789/0 conn(0x7f13cc0699e0 legacy=0x7f13cc152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f13d155e640 1 -- 172.21.15.40:0/3426833133 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc071be0 con 0x7f13cc0a3cf0 2023-05-24T04:00:22.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a52f6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698043250 0x7f16980d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a7d5b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16980d5080 0x7f1698005f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45100/0 (socket says 172.21.15.40:45100) 2023-05-24T04:00:22.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a7d5b640 1 -- 172.21.15.40:0/448288680 learned_addr learned my addr 172.21.15.40:0/448288680 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:22.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f16a5af7640 1 --2- 172.21.15.40:0/448288680 >> v2:172.21.15.67:3300/0 conn(0x7f1698044350 0x7f1698045070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d13fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 0x7f9d1414e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d13fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d140bc740 0x7f9d1406c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d12ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 0x7f9d1414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d12ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 0x7f9d1414e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53318/0 (socket says 172.21.15.40:53318) 2023-05-24T04:00:22.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d12ffd640 1 -- 172.21.15.40:0/3462371574 learned_addr learned my addr 172.21.15.40:0/3462371574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d127fc640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.40:3300/0 conn(0x7f9d140bc740 0x7f9d1406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d13fff640 1 --2- 172.21.15.40:0/3462371574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1406c870 0x7f9d14149830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7fedecca0640 1 --2- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede814aad0 0x7fede8070120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fede000bfa0 tx=0x7fede001eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d35a796c646d164 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.610+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1406f110 con 0x7f9d140bc740 2023-05-24T04:00:22.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10559a640 1 -- 172.21.15.40:0/3838201948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80a7050 con 0x7fc1000464b0 2023-05-24T04:00:22.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140bc1f0 con 0x7f9d1414dab0 2023-05-24T04:00:22.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1406eda0 con 0x7f9d1406c870 2023-05-24T04:00:22.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f6e8a372640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6e68066280 0x7f6e68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 --2- 172.21.15.40:0/3462371574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1406c870 0x7f9d14149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 -- 172.21.15.40:0/3462371574 >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 msgr2=0x7f9d1414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 0x7f9d1414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 -- 172.21.15.40:0/3462371574 >> v2:172.21.15.40:3300/0 conn(0x7f9d140bc740 msgr2=0x7f9d1406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.40:3300/0 conn(0x7f9d140bc740 0x7f9d1406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 -- 172.21.15.40:0/3838201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000464b0 msgr2=0x7fc100028610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 --2- 172.21.15.40:0/3838201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000464b0 0x7fc100028610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009870 tx=0x7fc0f801c4b0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 -- 172.21.15.40:0/3838201948 shutdown_connections 2023-05-24T04:00:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 --2- 172.21.15.40:0/3838201948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc100048ce0 0x7fc10002ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 --2- 172.21.15.40:0/3838201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000464b0 0x7fc100028610 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009870 tx=0x7fc0f801c4b0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 -- 172.21.15.40:0/3838201948 >> 172.21.15.40:0/3838201948 conn(0x7fc100049d50 msgr2=0x7fc100045b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fede6ffd640 1 -- 172.21.15.40:0/3765570421 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000b2d0 con 0x7fede814aad0 2023-05-24T04:00:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fede6ffd640 1 -- 172.21.15.40:0/3765570421 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00a78f0 con 0x7fede814aad0 2023-05-24T04:00:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f13d155e640 1 --2- 172.21.15.40:0/3426833133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0a3cf0 0x7f13cc069db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0721e0 tx=0x7f13bc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105c891414e6f9d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 -- 172.21.15.40:0/3462371574 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1414b3c0 con 0x7f9d1406c870 2023-05-24T04:00:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d12ffd640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 0x7f9d1414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d127fc640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.40:3300/0 conn(0x7f9d140bc740 0x7f9d1406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fede6ffd640 1 -- 172.21.15.40:0/3765570421 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede00a7c80 con 0x7fede814aad0 2023-05-24T04:00:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 -- 172.21.15.40:0/3838201948 shutdown_connections 2023-05-24T04:00:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 -- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede814aad0 msgr2=0x7fede8070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 --2- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede814aad0 0x7fede8070120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fede000bfa0 tx=0x7fede001eb40 comp rx=0 tx=0).stop 2023-05-24T04:00:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 -- 172.21.15.40:0/3838201948 wait complete. 2023-05-24T04:00:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 -- 172.21.15.40:0/3765570421 shutdown_connections 2023-05-24T04:00:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 --2- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede814aad0 0x7fede8070120 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 --2- 172.21.15.40:0/3765570421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede806ce90 0x7fede814a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 -- 172.21.15.40:0/3765570421 >> 172.21.15.40:0/3765570421 conn(0x7fede80bdd90 msgr2=0x7fede80be190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 -- 172.21.15.40:0/3765570421 shutdown_connections 2023-05-24T04:00:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7feded4a1640 1 -- 172.21.15.40:0/3765570421 wait complete. 2023-05-24T04:00:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f16a52f6640 1 -- 172.21.15.40:0/448288680 >> v2:172.21.15.67:3300/0 conn(0x7f1698044350 msgr2=0x7f1698045070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f16a52f6640 1 --2- 172.21.15.40:0/448288680 >> v2:172.21.15.67:3300/0 conn(0x7f1698044350 0x7f1698045070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f16a52f6640 1 -- 172.21.15.40:0/448288680 >> v1:172.21.15.40:6789/0 conn(0x7f16980d5080 legacy=0x7f1698005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f16a52f6640 1 -- 172.21.15.40:0/448288680 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698046b60 con 0x7f1698043250 2023-05-24T04:00:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f16a52f6640 1 --2- 172.21.15.40:0/448288680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698043250 0x7f16980d4b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c1e0 tx=0x7f169c01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30418800fb8a8816 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f6e8a372640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6e68066280 0x7f6e68068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000f70 tx=0x7f6e80007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7fc10759e640 1 Processor -- start 2023-05-24T04:00:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f9d137fe640 1 --2- 172.21.15.40:0/3462371574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1406c870 0x7f9d14149830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d14071b70 tx=0x7f9d0801d390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e68476f86b51259 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.614+0000 7f16a4af5640 1 -- 172.21.15.40:0/448288680 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c008be0 con 0x7f1698043250 2023-05-24T04:00:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a4af5640 1 -- 172.21.15.40:0/448288680 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c0a7050 con 0x7f1698043250 2023-05-24T04:00:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a4af5640 1 -- 172.21.15.40:0/448288680 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c004030 con 0x7f1698043250 2023-05-24T04:00:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 -- start start 2023-05-24T04:00:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d11ffb640 1 -- 172.21.15.40:0/3462371574 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08008be0 con 0x7f9d1406c870 2023-05-24T04:00:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d11ffb640 1 -- 172.21.15.40:0/3462371574 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d080a8050 con 0x7f9d1406c870 2023-05-24T04:00:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d11ffb640 1 -- 172.21.15.40:0/3462371574 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08004030 con 0x7f9d1406c870 2023-05-24T04:00:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 Processor -- start 2023-05-24T04:00:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 -- start start 2023-05-24T04:00:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1000280e0 0x7fc1000dd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 0x7fc10003e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10003e850 0x7fc100040190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10003f390 con 0x7fc1000d5130 2023-05-24T04:00:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100041850 con 0x7fc10003e850 2023-05-24T04:00:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000dd830 con 0x7fc1000280e0 2023-05-24T04:00:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- 172.21.15.40:0/448288680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698043250 msgr2=0x7f16980d4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 --2- 172.21.15.40:0/448288680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698043250 0x7f16980d4b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c1e0 tx=0x7f169c01c320 comp rx=0 tx=0).stop 2023-05-24T04:00:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- 172.21.15.40:0/448288680 shutdown_connections 2023-05-24T04:00:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 --2- 172.21.15.40:0/448288680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698043250 0x7f16980d4b40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 --2- 172.21.15.40:0/448288680 >> v2:172.21.15.67:3300/0 conn(0x7f1698044350 0x7f1698045070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- 172.21.15.40:0/448288680 >> 172.21.15.40:0/448288680 conn(0x7f1698029740 msgr2=0x7f16980439e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- 172.21.15.40:0/448288680 shutdown_connections 2023-05-24T04:00:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1406c870 msgr2=0x7f9d14149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 --2- 172.21.15.40:0/3462371574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1406c870 0x7f9d14149830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d14071b70 tx=0x7f9d0801d390 comp rx=0 tx=0).stop 2023-05-24T04:00:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc105d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 0x7fc10003e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc105d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 0x7fc10003e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47748/0 (socket says 172.21.15.40:47748) 2023-05-24T04:00:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc105d9b640 1 -- 172.21.15.40:0/3127206892 learned_addr learned my addr 172.21.15.40:0/3127206892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 shutdown_connections 2023-05-24T04:00:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 --2- 172.21.15.40:0/3462371574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1406c870 0x7f9d14149830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.40:3300/0 conn(0x7f9d140bc740 0x7f9d1406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 --2- 172.21.15.40:0/3462371574 >> v2:172.21.15.67:3300/0 conn(0x7f9d1414dab0 0x7f9d1414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 >> 172.21.15.40:0/3462371574 conn(0x7f9d140c00d0 msgr2=0x7f9d140c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 shutdown_connections 2023-05-24T04:00:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede806ce90 0x7fede814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede8070a30 0x7fede81e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 0x7fede81e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede8149fb0 con 0x7fede814aad0 2023-05-24T04:00:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede8153b90 con 0x7fede806ce90 2023-05-24T04:00:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 -- 172.21.15.40:0/3462371574 wait complete. 2023-05-24T04:00:22.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7feded4a1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede81e9f10 con 0x7fede8070a30 2023-05-24T04:00:22.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 Processor -- start 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10003e850 0x7fc100040190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10659c640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1000280e0 0x7fc1000dd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 -- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1000280e0 msgr2=0x7fc1000dd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1000280e0 0x7fc1000dd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 -- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 msgr2=0x7fc10003e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 0x7fc10003e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 -- 172.21.15.40:0/3127206892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80094d0 con 0x7fc10003e850 2023-05-24T04:00:22.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 0x7fede81e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 0x7fede81e92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47764/0 (socket says 172.21.15.40:47764) 2023-05-24T04:00:22.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 -- 172.21.15.40:0/2890684912 learned_addr learned my addr 172.21.15.40:0/2890684912 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fede77fe640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede8070a30 0x7fede81e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fede7fff640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede806ce90 0x7fede814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc105d9b640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 0x7fc10003e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:22.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 -- start start 2023-05-24T04:00:22.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a4c40 0x7f65700a5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65700a46d0 0x7f657014e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700a39f0 con 0x7f657014b030 2023-05-24T04:00:22.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700a3050 con 0x7f65700a46d0 2023-05-24T04:00:22.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f65753b2640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657014a4c0 con 0x7f65700a4c40 2023-05-24T04:00:22.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc106d9d640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10003e850 0x7fc100040190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c3c0 tx=0x7fc0fc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- 172.21.15.40:0/448288680 wait complete. 2023-05-24T04:00:22.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 Processor -- start 2023-05-24T04:00:22.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- start start 2023-05-24T04:00:22.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 -- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede8070a30 msgr2=0x7fede81e67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede8070a30 0x7fede81e67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 -- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede806ce90 msgr2=0x7fede814d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede806ce90 0x7fede814d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 -- 172.21.15.40:0/2890684912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede000bc80 con 0x7fede814aad0 2023-05-24T04:00:22.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fedecca0640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 0x7fede81e92b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fede00b1040 tx=0x7fede001b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6e740eac90 con 0x7f6e841e7f50 2023-05-24T04:00:22.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 Processor -- start 2023-05-24T04:00:22.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656e7fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a4c40 0x7f65700a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65700a46d0 0x7f657014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656e7fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a4c40 0x7f65700a5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58186/0 (socket says 172.21.15.40:58186) 2023-05-24T04:00:22.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656e7fc640 1 -- 172.21.15.40:0/1463107950 learned_addr learned my addr 172.21.15.40:0/1463107950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f9d13fff640 1 -- start start 2023-05-24T04:00:22.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0052d0 con 0x7fc10003e850 2023-05-24T04:00:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc100046880 con 0x7fc10003e850 2023-05-24T04:00:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc100007940 con 0x7fc10003e850 2023-05-24T04:00:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f13d0d5d640 1 -- 172.21.15.40:0/3426833133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0ab600 con 0x7f13cc0a3cf0 2023-05-24T04:00:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f13d0d5d640 1 -- 172.21.15.40:0/3426833133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc0a7050 con 0x7f13cc0a3cf0 2023-05-24T04:00:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f13d0d5d640 1 -- 172.21.15.40:0/3426833133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0ab980 con 0x7f13cc0a3cf0 2023-05-24T04:00:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc005450 con 0x7fc10003e850 2023-05-24T04:00:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656f7fe640 1 -- 172.21.15.40:0/1463107950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a4c40 msgr2=0x7f65700a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656f7fe640 1 --2- 172.21.15.40:0/1463107950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a4c40 0x7f65700a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656f7fe640 1 -- 172.21.15.40:0/1463107950 >> v1:172.21.15.67:6789/0 conn(0x7f657014b030 legacy=0x7f657014dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f656f7fe640 1 -- 172.21.15.40:0/1463107950 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700a3c40 con 0x7f65700a46d0 2023-05-24T04:00:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 0x7f1698039d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698044350 0x7f169803d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16980d5080 0x7f169803ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169803d870 con 0x7f1698043250 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169803f470 con 0x7f16980d5080 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.618+0000 7f16a6af9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1698039b30 con 0x7f1698044350 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 0x7f1698039d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a52f6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698044350 0x7f169803d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 0x7f1698039d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47786/0 (socket says 172.21.15.40:47786) 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a52f6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698044350 0x7f169803d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58202/0 (socket says 172.21.15.40:58202) 2023-05-24T04:00:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 -- 172.21.15.40:0/627749362 learned_addr learned my addr 172.21.15.40:0/627749362 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 -- 172.21.15.40:0/627749362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698044350 msgr2=0x7f169803d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698044350 0x7f169803d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 -- 172.21.15.40:0/627749362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16980d5080 msgr2=0x7f169803ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T04:00:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16980d5080 0x7f169803ef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 -- 172.21.15.40:0/627749362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c00ae50 con 0x7f1698043250 2023-05-24T04:00:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 0x7f9d141e6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d140bc740 0x7f9d141461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1414dab0 0x7f9d1413ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14144dd0 con 0x7f9d140bc740 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d141e6670 con 0x7f9d1406c870 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1414d170 con 0x7f9d1414dab0 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 0x7f9d141e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 0x7f9d141e6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53344/0 (socket says 172.21.15.40:53344) 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 -- 172.21.15.40:0/3573263463 learned_addr learned my addr 172.21.15.40:0/3573263463 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d137fe640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1414dab0 0x7f9d1413ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 -- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1414dab0 msgr2=0x7f9d1413ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1414dab0 0x7f9d1413ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 -- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d140bc740 msgr2=0x7f9d141461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d140bc740 0x7f9d141461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 -- 172.21.15.40:0/3573263463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0800ae50 con 0x7f9d1406c870 2023-05-24T04:00:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0009740 con 0x7fede814aad0 2023-05-24T04:00:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00098c0 con 0x7fede814aad0 2023-05-24T04:00:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0009c70 con 0x7fede814aad0 2023-05-24T04:00:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7feded4a1640 1 -- 172.21.15.40:0/2890684912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede80a7330 con 0x7fede814aad0 2023-05-24T04:00:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7feded4a1640 1 -- 172.21.15.40:0/2890684912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede80bda10 con 0x7fede814aad0 2023-05-24T04:00:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d12ffd640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 0x7f9d141e6130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00ce00 tx=0x7f9d0c00a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a5af7640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 0x7f1698039d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f169000fa60 tx=0x7f169000ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000c070 con 0x7f1698043250 2023-05-24T04:00:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 -- 172.21.15.40:0/3426833133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0a3cf0 msgr2=0x7f13cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 --2- 172.21.15.40:0/3426833133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0a3cf0 0x7f13cc069db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0721e0 tx=0x7f13bc01c490 comp rx=0 tx=0).stop 2023-05-24T04:00:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 -- 172.21.15.40:0/3426833133 shutdown_connections 2023-05-24T04:00:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 --2- 172.21.15.40:0/3426833133 >> v2:172.21.15.67:3300/0 conn(0x7f13cc1533a0 0x7f13cc0a25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 --2- 172.21.15.40:0/3426833133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0a3cf0 0x7f13cc069db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 -- 172.21.15.40:0/3426833133 >> 172.21.15.40:0/3426833133 conn(0x7f13cc0bdd90 msgr2=0x7f13cc0be190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 -- 172.21.15.40:0/3426833133 shutdown_connections 2023-05-24T04:00:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f13d2d61640 1 -- 172.21.15.40:0/3426833133 wait complete. 2023-05-24T04:00:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00f890 con 0x7f9d1406c870 2023-05-24T04:00:22.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00f9f0 con 0x7f9d1406c870 2023-05-24T04:00:22.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 -- 172.21.15.40:0/3573263463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1414e010 con 0x7f9d1406c870 2023-05-24T04:00:22.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f9d13fff640 1 -- 172.21.15.40:0/3573263463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1414de80 con 0x7f9d1406c870 2023-05-24T04:00:22.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fede00c3460 con 0x7fede814aad0 2023-05-24T04:00:22.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fede4ff9640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fedd4066350 0x7fedd4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fede011f350 con 0x7fede814aad0 2023-05-24T04:00:22.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc007260 con 0x7fc10003e850 2023-05-24T04:00:22.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec005260 con 0x7fc10003e850 2023-05-24T04:00:22.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0fc007440 con 0x7fc10003e850 2023-05-24T04:00:22.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169803de80 con 0x7f1698043250 2023-05-24T04:00:22.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169803dcf0 con 0x7f1698043250 2023-05-24T04:00:22.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.622+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1698046130 con 0x7f1698043250 2023-05-24T04:00:22.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7feded4a1640 1 -- 172.21.15.40:0/2890684912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8005260 con 0x7fede814aad0 2023-05-24T04:00:22.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7fc0f6ffd640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0e8066400 0x7fc0e80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0fc0832e0 con 0x7fc10003e850 2023-05-24T04:00:22.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00fd80 con 0x7f9d1406c870 2023-05-24T04:00:22.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf4005260 con 0x7f9d1406c870 2023-05-24T04:00:22.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 Processor -- start 2023-05-24T04:00:22.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 -- start start 2023-05-24T04:00:22.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7fede7fff640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fedd4066350 0x7fedd4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7fede7fff640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fedd4066350 0x7fedd4068800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feddc004230 tx=0x7feddc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 0x7f13cc1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13cc0a3cf0 0x7f13cc1f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1533a0 0x7f13cc1f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc1ed5f0 con 0x7f13cc0699e0 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0a6f20 con 0x7f13cc1533a0 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2d61640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc14b9e0 con 0x7f13cc0a3cf0 2023-05-24T04:00:22.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 0x7f13cc1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 0x7f13cc1469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47792/0 (socket says 172.21.15.40:47792) 2023-05-24T04:00:22.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 -- 172.21.15.40:0/2223608126 learned_addr learned my addr 172.21.15.40:0/2223608126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d155e640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13cc0a3cf0 0x7f13cc1f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d2560640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1533a0 0x7f13cc1f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000dcd0 con 0x7f1698043250 2023-05-24T04:00:22.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f656f7fe640 1 --2- 172.21.15.40:0/1463107950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a46d0 0x7f657014e400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6568009d90 tx=0x7f656801f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdba23b5181702c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 -- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13cc0a3cf0 msgr2=0x7f13cc1f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13cc0a3cf0 0x7f13cc1f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 -- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1533a0 msgr2=0x7f13cc1f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1533a0 0x7f13cc1f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 -- 172.21.15.40:0/2223608126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0094d0 con 0x7f13cc0699e0 2023-05-24T04:00:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f13d1d5f640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 0x7f13cc1469b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c500 tx=0x7f13c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001a680 con 0x7f1698043250 2023-05-24T04:00:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d0c00b040 con 0x7f9d1406c870 2023-05-24T04:00:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f9cfbfff640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9d00066300 0x7f9d000687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d0c084b90 con 0x7f9d1406c870 2023-05-24T04:00:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7f9d127fc640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9d00066300 0x7f9d000687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.626+0000 7fc10659c640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0e8066400 0x7fc0e80688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.630+0000 7f9d127fc640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9d00066300 0x7f9d000687b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9d14145960 tx=0x7f9d04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.630+0000 7fc10659c640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0e8066400 0x7fc0e80688b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 Processor -- start 2023-05-24T04:00:22.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 -- start start 2023-05-24T04:00:22.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fede00f0090 con 0x7fede814aad0 2023-05-24T04:00:22.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dc006d030 0x7f1dc0071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc014af30 0x7f1dc00bbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dc006d030 0x7f1dc0071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dc006d030 0x7f1dc0071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47804/0 (socket says 172.21.15.40:47804) 2023-05-24T04:00:22.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbdd9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1dc014c240 0x7f1dc014a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45108/0 (socket says 172.21.15.40:45108) 2023-05-24T04:00:22.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc014bda0 con 0x7f1dc014c240 2023-05-24T04:00:22.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 -- 172.21.15.40:0/2050822316 learned_addr learned my addr 172.21.15.40:0/2050822316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc00b8330 con 0x7f1dc006d030 2023-05-24T04:00:22.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00b7d70 con 0x7f1dc014af30 2023-05-24T04:00:22.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbed9d640 1 --2- 172.21.15.40:0/2050822316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc014af30 0x7f1dc00bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8005220 con 0x7f13cc0699e0 2023-05-24T04:00:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 -- 172.21.15.40:0/2050822316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc014af30 msgr2=0x7f1dc00bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 --2- 172.21.15.40:0/2050822316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc014af30 0x7f1dc00bbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 -- 172.21.15.40:0/2050822316 >> v1:172.21.15.40:6789/0 conn(0x7f1dc014c240 legacy=0x7f1dc014a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 -- 172.21.15.40:0/2050822316 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00b8050 con 0x7f1dc006d030 2023-05-24T04:00:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc14c2f0 con 0x7f13cc0699e0 2023-05-24T04:00:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc14c160 con 0x7f13cc0699e0 2023-05-24T04:00:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f656dffb640 1 -- 172.21.15.40:0/1463107950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680b0440 con 0x7f65700a46d0 2023-05-24T04:00:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c8005380 con 0x7f13cc0699e0 2023-05-24T04:00:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc14c480 con 0x7f13cc0699e0 2023-05-24T04:00:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8007230 con 0x7f13cc0699e0 2023-05-24T04:00:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1690011450 con 0x7f1698043250 2023-05-24T04:00:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f16967fc640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1684066350 0x7f1684068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1690015070 con 0x7f1698043250 2023-05-24T04:00:22.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f656dffb640 1 -- 172.21.15.40:0/1463107950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680b05a0 con 0x7f65700a46d0 2023-05-24T04:00:22.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.634+0000 7f1dbe59c640 1 --2- 172.21.15.40:0/2050822316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc006d030 0x7f1dc0071600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b54264c75ec954c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f16a52f6640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1684066350 0x7f1684068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- 172.21.15.40:0/1463107950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a46d0 msgr2=0x7f657014e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 --2- 172.21.15.40:0/1463107950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a46d0 0x7f657014e400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6568009d90 tx=0x7f656801f100 comp rx=0 tx=0).stop 2023-05-24T04:00:22.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f16a52f6640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1684066350 0x7f1684068800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f169c0ac000 tx=0x7f169c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- 172.21.15.40:0/1463107950 shutdown_connections 2023-05-24T04:00:22.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 --2- 172.21.15.40:0/1463107950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a46d0 0x7f657014e400 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 --2- 172.21.15.40:0/1463107950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a4c40 0x7f65700a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- 172.21.15.40:0/1463107950 >> 172.21.15.40:0/1463107950 conn(0x7f65700657b0 msgr2=0x7f6570065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- 172.21.15.40:0/1463107950 shutdown_connections 2023-05-24T04:00:22.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc0fc050590 con 0x7fc10003e850 2023-05-24T04:00:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- 172.21.15.40:0/1463107950 wait complete. 2023-05-24T04:00:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 Processor -- start 2023-05-24T04:00:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- start start 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a46d0 0x7f65701597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 0x7f65700bff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657014b030 0x7f65701e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570159cf0 con 0x7f65700a4c40 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c04b0 con 0x7f657014b030 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f65753b2640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6570158cd0 con 0x7f65700a46d0 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f656e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 0x7f65700bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f656e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 0x7f65700bff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47820/0 (socket says 172.21.15.40:47820) 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.638+0000 7f656e7fc640 1 -- 172.21.15.40:0/3362473316 learned_addr learned my addr 172.21.15.40:0/3362473316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656effd640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a46d0 0x7f65701597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656f7fe640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657014b030 0x7f65701e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656e7fc640 1 -- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a46d0 msgr2=0x7f65701597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656e7fc640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a46d0 0x7f65701597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656e7fc640 1 -- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657014b030 msgr2=0x7f65701e7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656e7fc640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657014b030 0x7f65701e7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656e7fc640 1 -- 172.21.15.40:0/3362473316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009a70 con 0x7f65700a4c40 2023-05-24T04:00:22.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.642+0000 7f656e7fc640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 0x7f65700bff70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f656400e820 tx=0x7f656400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1690051a40 con 0x7f1698043250 2023-05-24T04:00:22.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f1dbd59a640 1 -- 172.21.15.40:0/2050822316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00ac640 con 0x7f1dc006d030 2023-05-24T04:00:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13c8007390 con 0x7f13cc0699e0 2023-05-24T04:00:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f13c27fc640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f13b0066280 0x7f13b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f13c80846f0 con 0x7f13cc0699e0 2023-05-24T04:00:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400c940 con 0x7f65700a4c40 2023-05-24T04:00:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656400caa0 con 0x7f65700a4c40 2023-05-24T04:00:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400ce10 con 0x7f65700a4c40 2023-05-24T04:00:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700a3f20 con 0x7f65700a4c40 2023-05-24T04:00:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700a4240 con 0x7f65700a4c40 2023-05-24T04:00:22.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f13d155e640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f13b0066280 0x7f13b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.646+0000 7f13d155e640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f13b0066280 0x7f13b0068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0ad000 tx=0x7f13bc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.650+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657014e940 con 0x7f65700a4c40 2023-05-24T04:00:22.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.650+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9d0c051d90 con 0x7f9d1406c870 2023-05-24T04:00:22.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.654+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f13c80517f0 con 0x7f13cc0699e0 2023-05-24T04:00:22.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6564013470 con 0x7f65700a4c40 2023-05-24T04:00:22.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f65577fe640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f655c066280 0x7f655c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65640849d0 con 0x7f65700a4c40 2023-05-24T04:00:22.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f1dbd59a640 1 -- 172.21.15.40:0/2050822316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00ac7a0 con 0x7f1dc006d030 2023-05-24T04:00:22.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f1dbd59a640 1 -- 172.21.15.40:0/2050822316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00ac640 con 0x7f1dc006d030 2023-05-24T04:00:22.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc006d030 msgr2=0x7f1dc0071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f1dc4d28640 1 --2- 172.21.15.40:0/2050822316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc006d030 0x7f1dc0071600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db001c540 comp rx=0 tx=0).stop 2023-05-24T04:00:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f656effd640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f655c066280 0x7f655c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.658+0000 7f656effd640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f655c066280 0x7f655c068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65600098e0 tx=0x7f6560009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 shutdown_connections 2023-05-24T04:00:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 --2- 172.21.15.40:0/2050822316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc014af30 0x7f1dc00bbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 --2- 172.21.15.40:0/2050822316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc006d030 0x7f1dc0071600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 >> 172.21.15.40:0/2050822316 conn(0x7f1dc006aef0 msgr2=0x7f1dc006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 shutdown_connections 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- 172.21.15.40:0/2050822316 wait complete. 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 Processor -- start 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- start start 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 0x7f1dc00a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dc014af30 0x7f1dc013f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc014c240 0x7f1dc013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc014c240 0x7f1dc013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc014c240 0x7f1dc013fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47828/0 (socket says 172.21.15.40:47828) 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbe59c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 0x7f1dc00a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dc014af30 0x7f1dc013f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dc014af30 0x7f1dc013f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53380/0 (socket says 172.21.15.40:53380) 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00b9160 con 0x7f1dc014c240 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00b9e00 con 0x7f1dc014af30 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dc4d28640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00a33c0 con 0x7f1dc006d030 2023-05-24T04:00:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbe59c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 0x7f1dc00a23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58246/0 (socket says 172.21.15.40:58246) 2023-05-24T04:00:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.662+0000 7f1dbed9d640 1 -- 172.21.15.40:0/1243668520 learned_addr learned my addr 172.21.15.40:0/1243668520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dbe59c640 1 -- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dc014af30 msgr2=0x7f1dc013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dbe59c640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dc014af30 0x7f1dc013f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dbe59c640 1 -- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc014c240 msgr2=0x7f1dc013fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dbe59c640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc014c240 0x7f1dc013fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dbe59c640 1 -- 172.21.15.40:0/1243668520 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00094d0 con 0x7f1dc006d030 2023-05-24T04:00:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6564051b70 con 0x7f65700a4c40 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dbe59c640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 0x7f1dc00a23c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1db00ac000 tx=0x7f1db00192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00acd20 con 0x7f1dc006d030 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dc4d28640 1 -- 172.21.15.40:0/1243668520 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc00bc640 con 0x7f1dc006d030 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00ace80 con 0x7f1dc006d030 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0003820 con 0x7f1dc006d030 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.666+0000 7f1dc4d28640 1 -- 172.21.15.40:0/1243668520 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc00bc4b0 con 0x7f1dc006d030 2023-05-24T04:00:22.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.670+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1db00b3040 con 0x7f1dc006d030 2023-05-24T04:00:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.670+0000 7f1daeffd640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1da0066280 0x7f1da0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.670+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1db011e620 con 0x7f1dc006d030 2023-05-24T04:00:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.670+0000 7f1dbdd9b640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1da0066280 0x7f1da0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.670+0000 7f1dbdd9b640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1da0066280 0x7f1da0068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a20f0 tx=0x7f1db4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.682+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc006a1f0 con 0x7f1dc006d030 2023-05-24T04:00:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.698+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1db00ef480 con 0x7f1dc006d030 2023-05-24T04:00:22.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.934+0000 7f6e8c5d6640 1 -- 172.21.15.40:0/1786892435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6e6c005510 con 0x7f6e841e7f50 2023-05-24T04:00:22.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.934+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0ec005510 con 0x7fc10003e850 2023-05-24T04:00:22.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.934+0000 7f6e7affd640 1 -- 172.21.15.40:0/1786892435 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e740ee2b0 con 0x7f6e841e7f50 2023-05-24T04:00:22.939 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.934+0000 7fc0f6ffd640 1 -- 172.21.15.40:0/3127206892 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0fc053bb0 con 0x7fc10003e850 2023-05-24T04:00:22.941 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0e8066400 msgr2=0x7fc0e80688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0e8066400 0x7fc0e80688b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80a6000 comp rx=0 tx=0).stop 2023-05-24T04:00:22.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10003e850 msgr2=0x7fc100040190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 -- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6e68066280 msgr2=0x7f6e68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10003e850 0x7fc100040190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c3c0 tx=0x7fc0fc00c880 comp rx=0 tx=0).stop 2023-05-24T04:00:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6e68066280 0x7f6e68068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000f70 tx=0x7f6e80007040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 -- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 msgr2=0x7f6e841e83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 0x7f6e841e83a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6e7401c1f0 tx=0x7f6e70005800 comp rx=0 tx=0).stop 2023-05-24T04:00:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 -- 172.21.15.40:0/1786892435 shutdown_connections 2023-05-24T04:00:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6e68066280 0x7f6e68068730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e841e88e0 0x7f6e841e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e841e7f50 0x7f6e841e83a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 --2- 172.21.15.40:0/1786892435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e84138c90 0x7f6e84139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 -- 172.21.15.40:0/1786892435 >> 172.21.15.40:0/1786892435 conn(0x7f6e840c00d0 msgr2=0x7f6e84149f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 shutdown_connections 2023-05-24T04:00:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 -- 172.21.15.40:0/1786892435 shutdown_connections 2023-05-24T04:00:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0e8066400 0x7fc0e80688b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7f6e78ff9640 1 -- 172.21.15.40:0/1786892435 wait complete. 2023-05-24T04:00:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10003e850 0x7fc100040190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1000d5130 0x7fc10003e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 --2- 172.21.15.40:0/3127206892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1000280e0 0x7fc1000dd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 >> 172.21.15.40:0/3127206892 conn(0x7fc100049d50 msgr2=0x7fc10000cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 shutdown_connections 2023-05-24T04:00:22.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.938+0000 7fc10759e640 1 -- 172.21.15.40:0/3127206892 wait complete. 2023-05-24T04:00:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.954+0000 7feded4a1640 1 -- 172.21.15.40:0/2890684912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fedc8005510 con 0x7fede814aad0 2023-05-24T04:00:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.954+0000 7fede4ff9640 1 -- 172.21.15.40:0/2890684912 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fede00efc20 con 0x7fede814aad0 2023-05-24T04:00:22.961 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-24T04:00:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 -- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fedd4066350 msgr2=0x7fedd4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fedd4066350 0x7fedd4068800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feddc004230 tx=0x7feddc008040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 -- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 msgr2=0x7fede81e92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 0x7fede81e92b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fede00b1040 tx=0x7fede001b8e0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 -- 172.21.15.40:0/2890684912 shutdown_connections 2023-05-24T04:00:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fedd4066350 0x7fedd4068800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fede814aad0 0x7fede81e92b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fede8070a30 0x7fede81e67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 --2- 172.21.15.40:0/2890684912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede806ce90 0x7fede814d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 -- 172.21.15.40:0/2890684912 >> 172.21.15.40:0/2890684912 conn(0x7fede80bdd90 msgr2=0x7fede80be160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 -- 172.21.15.40:0/2890684912 shutdown_connections 2023-05-24T04:00:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.958+0000 7fedce7fc640 1 -- 172.21.15.40:0/2890684912 wait complete. 2023-05-24T04:00:22.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-05-24T04:00:22.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-05-24T04:00:22.971 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:22.971 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1698005450 con 0x7f1698043250 2023-05-24T04:00:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16967fc640 1 -- 172.21.15.40:0/627749362 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1690055060 con 0x7f1698043250 2023-05-24T04:00:22.972 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-24T04:00:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1684066350 msgr2=0x7f1684068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1684066350 0x7f1684068800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f169c0ac000 tx=0x7f169c0a6000 comp rx=0 tx=0).stop 2023-05-24T04:00:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 msgr2=0x7f1698039d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 0x7f1698039d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f169000fa60 tx=0x7f169000ff20 comp rx=0 tx=0).stop 2023-05-24T04:00:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 shutdown_connections 2023-05-24T04:00:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1684066350 0x7f1684068800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16980d5080 0x7f169803ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1698044350 0x7f169803d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 --2- 172.21.15.40:0/627749362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1698043250 0x7f1698039d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 >> 172.21.15.40:0/627749362 conn(0x7f1698029740 msgr2=0x7f1698028280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 shutdown_connections 2023-05-24T04:00:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.966+0000 7f16a6af9640 1 -- 172.21.15.40:0/627749362 wait complete. 2023-05-24T04:00:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.970+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9cf40057e0 con 0x7f9d1406c870 2023-05-24T04:00:22.976 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-24T04:00:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.970+0000 7f9cfbfff640 1 -- 172.21.15.40:0/3573263463 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d0c0553b0 con 0x7f9d1406c870 2023-05-24T04:00:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f657004ddd0 con 0x7f65700a4c40 2023-05-24T04:00:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9d00066300 msgr2=0x7f9d000687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9d00066300 0x7f9d000687b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9d14145960 tx=0x7f9d04008040 comp rx=0 tx=0).stop 2023-05-24T04:00:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 msgr2=0x7f9d141e6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 0x7f9d141e6130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00ce00 tx=0x7f9d0c00a650 comp rx=0 tx=0).stop 2023-05-24T04:00:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 shutdown_connections 2023-05-24T04:00:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9d00066300 0x7f9d000687b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d1414dab0 0x7f9d1413ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d140bc740 0x7f9d141461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 --2- 172.21.15.40:0/3573263463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d1406c870 0x7f9d141e6130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 >> 172.21.15.40:0/3573263463 conn(0x7f9d140c00d0 msgr2=0x7f9d14147e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 shutdown_connections 2023-05-24T04:00:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f65577fe640 1 -- 172.21.15.40:0/3362473316 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6564055190 con 0x7f65700a4c40 2023-05-24T04:00:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.974+0000 7f9cf9ffb640 1 -- 172.21.15.40:0/3573263463 wait complete. 2023-05-24T04:00:22.981 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:22.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f655c066280 msgr2=0x7f655c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f655c066280 0x7f655c068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65600098e0 tx=0x7f6560009060 comp rx=0 tx=0).stop 2023-05-24T04:00:22.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 msgr2=0x7f65700bff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 0x7f65700bff70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f656400e820 tx=0x7f656400ece0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 shutdown_connections 2023-05-24T04:00:22.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f655c066280 0x7f655c068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657014b030 0x7f65701e7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65700a4c40 0x7f65700bff70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 --2- 172.21.15.40:0/3362473316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65700a46d0 0x7f65701597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 >> 172.21.15.40:0/3362473316 conn(0x7f65700657b0 msgr2=0x7f65701433f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 shutdown_connections 2023-05-24T04:00:22.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f65753b2640 1 -- 172.21.15.40:0/3362473316 wait complete. 2023-05-24T04:00:22.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13cc073a30 con 0x7f13cc0699e0 2023-05-24T04:00:22.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.978+0000 7f13c27fc640 1 -- 172.21.15.40:0/2223608126 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13c8054e10 con 0x7f13cc0699e0 2023-05-24T04:00:22.985 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-05-24T04:00:22.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-05-24T04:00:22.986 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:22.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f13b0066280 msgr2=0x7f13b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f13b0066280 0x7f13b0068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0ad000 tx=0x7f13bc0a6000 comp rx=0 tx=0).stop 2023-05-24T04:00:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 msgr2=0x7f13cc1469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 0x7f13cc1469b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c500 tx=0x7f13c800c9c0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 shutdown_connections 2023-05-24T04:00:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f13b0066280 0x7f13b0068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1533a0 0x7f13cc1f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13cc0a3cf0 0x7f13cc1f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 --2- 172.21.15.40:0/2223608126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13cc0699e0 0x7f13cc1469b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 >> 172.21.15.40:0/2223608126 conn(0x7f13cc0bdd90 msgr2=0x7f13cc0c1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 shutdown_connections 2023-05-24T04:00:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:22.982+0000 7f13d2d61640 1 -- 172.21.15.40:0/2223608126 wait complete. 2023-05-24T04:00:22.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-05-24T04:00:22.996 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:23.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-05-24T04:00:23.010 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:23.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-05-24T04:00:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1dc00674e0 con 0x7f1dc006d030 2023-05-24T04:00:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1daeffd640 1 -- 172.21.15.40:0/1243668520 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1db00bb090 con 0x7f1dc006d030 2023-05-24T04:00:23.012 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:23.013 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-24T04:00:23.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-05-24T04:00:23.014 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:23.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1da0066280 msgr2=0x7f1da0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1da0066280 0x7f1da0068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a20f0 tx=0x7f1db4009040 comp rx=0 tx=0).stop 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 msgr2=0x7f1dc00a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 0x7f1dc00a23c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1db00ac000 tx=0x7f1db00192e0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 shutdown_connections 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1da0066280 0x7f1da0068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dc014c240 0x7f1dc013fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dc014af30 0x7f1dc013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 --2- 172.21.15.40:0/1243668520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dc006d030 0x7f1dc00a23c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.006+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 >> 172.21.15.40:0/1243668520 conn(0x7f1dc006aef0 msgr2=0x7f1dc014b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:23.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.010+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 shutdown_connections 2023-05-24T04:00:23.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.010+0000 7f1dacff9640 1 -- 172.21.15.40:0/1243668520 wait complete. 2023-05-24T04:00:23.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-05-24T04:00:23.028 DEBUG:teuthology.parallel:result is None 2023-05-24T04:00:23.028 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-24T04:00:23.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:00:23.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.174+0000 7f613afa9640 1 Processor -- start 2023-05-24T04:00:23.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.174+0000 7f613afa9640 1 -- start start 2023-05-24T04:00:23.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f613afa9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61340a6d40 0x7f6134071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f613afa9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f613414e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f613afa9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61340a4e20 con 0x7f613414ed90 2023-05-24T04:00:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f613afa9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61340a4a70 con 0x7f61340a6d40 2023-05-24T04:00:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f613afa9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a5070 con 0x7f61340a5370 2023-05-24T04:00:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6139546640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f613414ed90 0x7f613414a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45116/0 (socket says 172.21.15.40:45116) 2023-05-24T04:00:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6139546640 1 -- 172.21.15.40:0/1691073380 learned_addr learned my addr 172.21.15.40:0/1691073380 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:23.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 --2- 172.21.15.40:0/1691073380 >> v2:172.21.15.67:3300/0 conn(0x7f61340a6d40 0x7f6134071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6133fff640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f613414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093066758 0 0) 0x7f61340a4e20 con 0x7f613414ed90 2023-05-24T04:00:23.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f611c003530 con 0x7f613414ed90 2023-05-24T04:00:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2036554504 0 0) 0x7f611c003530 con 0x7f613414ed90 2023-05-24T04:00:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 msgr2=0x7f613414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f613414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 >> v2:172.21.15.67:3300/0 conn(0x7f61340a6d40 msgr2=0x7f6134071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 --2- 172.21.15.40:0/1691073380 >> v2:172.21.15.67:3300/0 conn(0x7f61340a6d40 0x7f6134071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340a4520 con 0x7f613414ed90 2023-05-24T04:00:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f612c001a00 con 0x7f613414ed90 2023-05-24T04:00:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 --2- 172.21.15.40:0/1691073380 >> v2:172.21.15.67:3300/0 conn(0x7f61340a6d40 0x7f6134071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 >> v1:172.21.15.40:6789/0 conn(0x7f613414ed90 legacy=0x7f613414a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c003980 0x7f611c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c0047d0 0x7f611c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f611c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a4a70 con 0x7f611c003980 2023-05-24T04:00:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a5070 con 0x7f611c0047d0 2023-05-24T04:00:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c00dcd0 con 0x7f61340a5370 2023-05-24T04:00:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c003980 0x7f611c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6133fff640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c0047d0 0x7f611c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6139546640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f611c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 -- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 msgr2=0x7f611c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f611c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 -- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c0047d0 msgr2=0x7f611c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c0047d0 0x7f611c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 -- 172.21.15.40:0/1691073380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c003530 con 0x7f611c003980 2023-05-24T04:00:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6139546640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61340a5370 0x7f611c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:23.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f6138d45640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c003980 0x7f611c003d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f61240098d0 tx=0x7f612401c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10a06bfee5f13f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240ab660 con 0x7f611c003980 2023-05-24T04:00:23.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240ab7c0 con 0x7f611c003980 2023-05-24T04:00:23.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.178+0000 7f61337fe640 1 -- 172.21.15.40:0/1691073380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240abb30 con 0x7f611c003980 2023-05-24T04:00:23.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/1691073380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c003980 msgr2=0x7f611c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 --2- 172.21.15.40:0/1691073380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c003980 0x7f611c003d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f61240098d0 tx=0x7f612401c630 comp rx=0 tx=0).stop 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 -- 172.21.15.40:0/1691073380 reap_dead start 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/1691073380 shutdown_connections 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/1691073380 >> 172.21.15.40:0/1691073380 conn(0x7f61340c13f0 msgr2=0x7f61340c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/1691073380 shutdown_connections 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/1691073380 wait complete. 2023-05-24T04:00:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 Processor -- start 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- start start 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c003980 0x7f61341460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6134141360 0x7f613414c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 0x7f613414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613414cb90 con 0x7f61341494a0 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61341e6b60 con 0x7f611c003980 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6134142070 con 0x7f6134141360 2023-05-24T04:00:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 0x7f613414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 0x7f613414fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47834/0 (socket says 172.21.15.40:47834) 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 -- 172.21.15.40:0/3520011775 learned_addr learned my addr 172.21.15.40:0/3520011775 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6138d45640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c003980 0x7f61341460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6133fff640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6134141360 0x7f613414c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 -- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6134141360 msgr2=0x7f613414c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6134141360 0x7f613414c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 -- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c003980 msgr2=0x7f61341460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c003980 0x7f61341460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 -- 172.21.15.40:0/3520011775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613414b770 con 0x7f61341494a0 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6138d45640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c003980 0x7f61341460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f6139546640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 0x7f613414fca0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61340bde20 tx=0x7f612c002200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c007070 con 0x7f61341494a0 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c0071f0 con 0x7f61341494a0 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613414f5b0 con 0x7f61341494a0 2023-05-24T04:00:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0075a0 con 0x7f61341494a0 2023-05-24T04:00:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613414b900 con 0x7f61341494a0 2023-05-24T04:00:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.182+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61340a5dd0 con 0x7f61341494a0 2023-05-24T04:00:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.186+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f612c007700 con 0x7f61341494a0 2023-05-24T04:00:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.186+0000 7f61317fa640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6120066280 0x7f6120068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.186+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f612c083360 con 0x7f61341494a0 2023-05-24T04:00:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.186+0000 7f6138d45640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6120066280 0x7f6120068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.186+0000 7f6138d45640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6120066280 0x7f6120068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61240098d0 tx=0x7f61240046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.190+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f612c050460 con 0x7f61341494a0 2023-05-24T04:00:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.334+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f613406aff0 con 0x7f6120066280 2023-05-24T04:00:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.358+0000 7f61317fa640 1 -- 172.21.15.40:0/3520011775 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367324 (secure 0 0 0) 0x7f613406aff0 con 0x7f6120066280 2023-05-24T04:00:23.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:23.371 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:00:23.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6120066280 msgr2=0x7f6120068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6120066280 0x7f6120068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61240098d0 tx=0x7f61240046d0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 msgr2=0x7f613414fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 0x7f613414fca0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61340bde20 tx=0x7f612c002200 comp rx=0 tx=0).stop 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 shutdown_connections 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6120066280 0x7f6120068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61341494a0 0x7f613414fca0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6134141360 0x7f613414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 --2- 172.21.15.40:0/3520011775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c003980 0x7f61341460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 >> 172.21.15.40:0/3520011775 conn(0x7f61340c13f0 msgr2=0x7f6134070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 shutdown_connections 2023-05-24T04:00:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.362+0000 7f613afa9640 1 -- 172.21.15.40:0/3520011775 wait complete. 2023-05-24T04:00:23.385 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-05-24T04:00:22.527775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":146920,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827800,"statfs":{"total":773094113280,"available":772943667200,"internally_reserved":0,"allocated":3579904,"data_stored":2149222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004572"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672564+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:02.672564+0000","last_peered":"2023-05-24T04:00:02.672564+0000","last_clean":"2023-05-24T04:00:02.672564+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:02.672564+0000","last_undegraded":"2023-05-24T04:00:02.672564+0000","last_fullsized":"2023-05-24T04:00:02.672564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:48.464106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283617+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:03.283617+0000","last_peered":"2023-05-24T04:00:03.283617+0000","last_clean":"2023-05-24T04:00:03.283617+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:03.283617+0000","last_undegraded":"2023-05-24T04:00:03.283617+0000","last_fullsized":"2023-05-24T04:00:03.283617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328955+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:02.328955+0000","last_peered":"2023-05-24T04:00:02.328955+0000","last_clean":"2023-05-24T04:00:02.328955+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:02.328955+0000","last_undegraded":"2023-05-24T04:00:02.328955+0000","last_fullsized":"2023-05-24T04:00:02.328955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328599+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:02.328599+0000","last_peered":"2023-05-24T04:00:02.328599+0000","last_clean":"2023-05-24T04:00:02.328599+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:02.328599+0000","last_undegraded":"2023-05-24T04:00:02.328599+0000","last_fullsized":"2023-05-24T04:00:02.328599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363367+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:02.363367+0000","last_peered":"2023-05-24T04:00:02.363367+0000","last_clean":"2023-05-24T04:00:02.363367+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:02.363367+0000","last_undegraded":"2023-05-24T04:00:02.363367+0000","last_fullsized":"2023-05-24T04:00:02.363367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:34.290959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362509+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:02.362509+0000","last_peered":"2023-05-24T04:00:02.362509+0000","last_clean":"2023-05-24T04:00:02.362509+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:02.362509+0000","last_undegraded":"2023-05-24T04:00:02.362509+0000","last_fullsized":"2023-05-24T04:00:02.362509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284412+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:03.284412+0000","last_peered":"2023-05-24T04:00:03.284412+0000","last_clean":"2023-05-24T04:00:03.284412+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:03.284412+0000","last_undegraded":"2023-05-24T04:00:03.284412+0000","last_fullsized":"2023-05-24T04:00:03.284412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285038+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:03.285038+0000","last_peered":"2023-05-24T04:00:03.285038+0000","last_clean":"2023-05-24T04:00:03.285038+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:03.285038+0000","last_undegraded":"2023-05-24T04:00:03.285038+0000","last_fullsized":"2023-05-24T04:00:03.285038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329969+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:02.329969+0000","last_peered":"2023-05-24T04:00:02.329969+0000","last_clean":"2023-05-24T04:00:02.329969+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:02.329969+0000","last_undegraded":"2023-05-24T04:00:02.329969+0000","last_fullsized":"2023-05-24T04:00:02.329969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284437+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:03.284437+0000","last_peered":"2023-05-24T04:00:03.284437+0000","last_clean":"2023-05-24T04:00:03.284437+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:03.284437+0000","last_undegraded":"2023-05-24T04:00:03.284437+0000","last_fullsized":"2023-05-24T04:00:03.284437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:21.271231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283513+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:03.283513+0000","last_peered":"2023-05-24T04:00:03.283513+0000","last_clean":"2023-05-24T04:00:03.283513+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:03.283513+0000","last_undegraded":"2023-05-24T04:00:03.283513+0000","last_fullsized":"2023-05-24T04:00:03.283513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:26.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331682+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:02.331682+0000","last_peered":"2023-05-24T04:00:02.331682+0000","last_clean":"2023-05-24T04:00:02.331682+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:02.331682+0000","last_undegraded":"2023-05-24T04:00:02.331682+0000","last_fullsized":"2023-05-24T04:00:02.331682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:50.558794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673853+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:02.673853+0000","last_peered":"2023-05-24T04:00:02.673853+0000","last_clean":"2023-05-24T04:00:02.673853+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:02.673853+0000","last_undegraded":"2023-05-24T04:00:02.673853+0000","last_fullsized":"2023-05-24T04:00:02.673853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283535+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:03.283535+0000","last_peered":"2023-05-24T04:00:03.283535+0000","last_clean":"2023-05-24T04:00:03.283535+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:03.283535+0000","last_undegraded":"2023-05-24T04:00:03.283535+0000","last_fullsized":"2023-05-24T04:00:03.283535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:28.900435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326827+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:02.326827+0000","last_peered":"2023-05-24T04:00:02.326827+0000","last_clean":"2023-05-24T04:00:02.326827+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:02.326827+0000","last_undegraded":"2023-05-24T04:00:02.326827+0000","last_fullsized":"2023-05-24T04:00:02.326827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:49:51.893837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331409+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:02.331409+0000","last_peered":"2023-05-24T04:00:02.331409+0000","last_clean":"2023-05-24T04:00:02.331409+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:02.331409+0000","last_undegraded":"2023-05-24T04:00:02.331409+0000","last_fullsized":"2023-05-24T04:00:02.331409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330783+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:02.330783+0000","last_peered":"2023-05-24T04:00:02.330783+0000","last_clean":"2023-05-24T04:00:02.330783+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:02.330783+0000","last_undegraded":"2023-05-24T04:00:02.330783+0000","last_fullsized":"2023-05-24T04:00:02.330783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:54.808184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363065+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:02.363065+0000","last_peered":"2023-05-24T04:00:02.363065+0000","last_clean":"2023-05-24T04:00:02.363065+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:02.363065+0000","last_undegraded":"2023-05-24T04:00:02.363065+0000","last_fullsized":"2023-05-24T04:00:02.363065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:22.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333322+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:02.333322+0000","last_peered":"2023-05-24T04:00:02.333322+0000","last_clean":"2023-05-24T04:00:02.333322+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:02.333322+0000","last_undegraded":"2023-05-24T04:00:02.333322+0000","last_fullsized":"2023-05-24T04:00:02.333322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:00.634094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673332+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:02.673332+0000","last_peered":"2023-05-24T04:00:02.673332+0000","last_clean":"2023-05-24T04:00:02.673332+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:02.673332+0000","last_undegraded":"2023-05-24T04:00:02.673332+0000","last_fullsized":"2023-05-24T04:00:02.673332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282810+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:03.282810+0000","last_peered":"2023-05-24T04:00:03.282810+0000","last_clean":"2023-05-24T04:00:03.282810+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:03.282810+0000","last_undegraded":"2023-05-24T04:00:03.282810+0000","last_fullsized":"2023-05-24T04:00:03.282810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282862+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:03.282862+0000","last_peered":"2023-05-24T04:00:03.282862+0000","last_clean":"2023-05-24T04:00:03.282862+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:03.282862+0000","last_undegraded":"2023-05-24T04:00:03.282862+0000","last_fullsized":"2023-05-24T04:00:03.282862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:52.353037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362055+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:02.362055+0000","last_peered":"2023-05-24T04:00:02.362055+0000","last_clean":"2023-05-24T04:00:02.362055+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:02.362055+0000","last_undegraded":"2023-05-24T04:00:02.362055+0000","last_fullsized":"2023-05-24T04:00:02.362055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:20.968502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333722+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:02.333722+0000","last_peered":"2023-05-24T04:00:02.333722+0000","last_clean":"2023-05-24T04:00:02.333722+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:02.333722+0000","last_undegraded":"2023-05-24T04:00:02.333722+0000","last_fullsized":"2023-05-24T04:00:02.333722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:15:50.664698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362004+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:02.362004+0000","last_peered":"2023-05-24T04:00:02.362004+0000","last_clean":"2023-05-24T04:00:02.362004+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:02.362004+0000","last_undegraded":"2023-05-24T04:00:02.362004+0000","last_fullsized":"2023-05-24T04:00:02.362004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283773+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:03.283773+0000","last_peered":"2023-05-24T04:00:03.283773+0000","last_clean":"2023-05-24T04:00:03.283773+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:03.283773+0000","last_undegraded":"2023-05-24T04:00:03.283773+0000","last_fullsized":"2023-05-24T04:00:03.283773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330368+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:02.330368+0000","last_peered":"2023-05-24T04:00:02.330368+0000","last_clean":"2023-05-24T04:00:02.330368+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:02.330368+0000","last_undegraded":"2023-05-24T04:00:02.330368+0000","last_fullsized":"2023-05-24T04:00:02.330368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:48:28.342687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362251+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:02.362251+0000","last_peered":"2023-05-24T04:00:02.362251+0000","last_clean":"2023-05-24T04:00:02.362251+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:02.362251+0000","last_undegraded":"2023-05-24T04:00:02.362251+0000","last_fullsized":"2023-05-24T04:00:02.362251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285221+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:03.285221+0000","last_peered":"2023-05-24T04:00:03.285221+0000","last_clean":"2023-05-24T04:00:03.285221+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:03.285221+0000","last_undegraded":"2023-05-24T04:00:03.285221+0000","last_fullsized":"2023-05-24T04:00:03.285221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282396+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:03.282396+0000","last_peered":"2023-05-24T04:00:03.282396+0000","last_clean":"2023-05-24T04:00:03.282396+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:03.282396+0000","last_undegraded":"2023-05-24T04:00:03.282396+0000","last_fullsized":"2023-05-24T04:00:03.282396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:30.582812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285127+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:03.285127+0000","last_peered":"2023-05-24T04:00:03.285127+0000","last_clean":"2023-05-24T04:00:03.285127+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:03.285127+0000","last_undegraded":"2023-05-24T04:00:03.285127+0000","last_fullsized":"2023-05-24T04:00:03.285127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673675+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:02.673675+0000","last_peered":"2023-05-24T04:00:02.673675+0000","last_clean":"2023-05-24T04:00:02.673675+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:02.673675+0000","last_undegraded":"2023-05-24T04:00:02.673675+0000","last_fullsized":"2023-05-24T04:00:02.673675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:50:58.369856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362343+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:02.362343+0000","last_peered":"2023-05-24T04:00:02.362343+0000","last_clean":"2023-05-24T04:00:02.362343+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:02.362343+0000","last_undegraded":"2023-05-24T04:00:02.362343+0000","last_fullsized":"2023-05-24T04:00:02.362343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:07.609800+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:07.609800+0000","last_peered":"2023-05-24T04:00:07.609800+0000","last_clean":"2023-05-24T04:00:07.609800+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:07.609800+0000","last_undegraded":"2023-05-24T04:00:07.609800+0000","last_fullsized":"2023-05-24T04:00:07.609800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331855+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:02.331855+0000","last_peered":"2023-05-24T04:00:02.331855+0000","last_clean":"2023-05-24T04:00:02.331855+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:02.331855+0000","last_undegraded":"2023-05-24T04:00:02.331855+0000","last_fullsized":"2023-05-24T04:00:02.331855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:05:19.807337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672982+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:02.672982+0000","last_peered":"2023-05-24T04:00:02.672982+0000","last_clean":"2023-05-24T04:00:02.672982+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:02.672982+0000","last_undegraded":"2023-05-24T04:00:02.672982+0000","last_fullsized":"2023-05-24T04:00:02.672982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:15.871289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330236+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:02.330236+0000","last_peered":"2023-05-24T04:00:02.330236+0000","last_clean":"2023-05-24T04:00:02.330236+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:02.330236+0000","last_undegraded":"2023-05-24T04:00:02.330236+0000","last_fullsized":"2023-05-24T04:00:02.330236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333814+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:02.333814+0000","last_peered":"2023-05-24T04:00:02.333814+0000","last_clean":"2023-05-24T04:00:02.333814+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:02.333814+0000","last_undegraded":"2023-05-24T04:00:02.333814+0000","last_fullsized":"2023-05-24T04:00:02.333814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:44:04.775971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283220+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:03.283220+0000","last_peered":"2023-05-24T04:00:03.283220+0000","last_clean":"2023-05-24T04:00:03.283220+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:03.283220+0000","last_undegraded":"2023-05-24T04:00:03.283220+0000","last_fullsized":"2023-05-24T04:00:03.283220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.723109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361756+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:02.361756+0000","last_peered":"2023-05-24T04:00:02.361756+0000","last_clean":"2023-05-24T04:00:02.361756+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:02.361756+0000","last_undegraded":"2023-05-24T04:00:02.361756+0000","last_fullsized":"2023-05-24T04:00:02.361756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361923+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:02.361923+0000","last_peered":"2023-05-24T04:00:02.361923+0000","last_clean":"2023-05-24T04:00:02.361923+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:02.361923+0000","last_undegraded":"2023-05-24T04:00:02.361923+0000","last_fullsized":"2023-05-24T04:00:02.361923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674247+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:02.674247+0000","last_peered":"2023-05-24T04:00:02.674247+0000","last_clean":"2023-05-24T04:00:02.674247+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:02.674247+0000","last_undegraded":"2023-05-24T04:00:02.674247+0000","last_fullsized":"2023-05-24T04:00:02.674247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:16.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363505+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:02.363505+0000","last_peered":"2023-05-24T04:00:02.363505+0000","last_clean":"2023-05-24T04:00:02.363505+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:02.363505+0000","last_undegraded":"2023-05-24T04:00:02.363505+0000","last_fullsized":"2023-05-24T04:00:02.363505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:38.541927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329007+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:02.329007+0000","last_peered":"2023-05-24T04:00:02.329007+0000","last_clean":"2023-05-24T04:00:02.329007+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:02.329007+0000","last_undegraded":"2023-05-24T04:00:02.329007+0000","last_fullsized":"2023-05-24T04:00:02.329007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282793+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:03.282793+0000","last_peered":"2023-05-24T04:00:03.282793+0000","last_clean":"2023-05-24T04:00:03.282793+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:03.282793+0000","last_undegraded":"2023-05-24T04:00:03.282793+0000","last_fullsized":"2023-05-24T04:00:03.282793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285507+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:03.285507+0000","last_peered":"2023-05-24T04:00:03.285507+0000","last_clean":"2023-05-24T04:00:03.285507+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:03.285507+0000","last_undegraded":"2023-05-24T04:00:03.285507+0000","last_fullsized":"2023-05-24T04:00:03.285507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:08.607412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673339+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:02.673339+0000","last_peered":"2023-05-24T04:00:02.673339+0000","last_clean":"2023-05-24T04:00:02.673339+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:02.673339+0000","last_undegraded":"2023-05-24T04:00:02.673339+0000","last_fullsized":"2023-05-24T04:00:02.673339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:47:35.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331141+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:02.331141+0000","last_peered":"2023-05-24T04:00:02.331141+0000","last_clean":"2023-05-24T04:00:02.331141+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:02.331141+0000","last_undegraded":"2023-05-24T04:00:02.331141+0000","last_fullsized":"2023-05-24T04:00:02.331141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:23:57.729163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673806+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:02.673806+0000","last_peered":"2023-05-24T04:00:02.673806+0000","last_clean":"2023-05-24T04:00:02.673806+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:02.673806+0000","last_undegraded":"2023-05-24T04:00:02.673806+0000","last_fullsized":"2023-05-24T04:00:02.673806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673598+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:02.673598+0000","last_peered":"2023-05-24T04:00:02.673598+0000","last_clean":"2023-05-24T04:00:02.673598+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:02.673598+0000","last_undegraded":"2023-05-24T04:00:02.673598+0000","last_fullsized":"2023-05-24T04:00:02.673598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:07.555151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285023+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:03.285023+0000","last_peered":"2023-05-24T04:00:03.285023+0000","last_clean":"2023-05-24T04:00:03.285023+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:03.285023+0000","last_undegraded":"2023-05-24T04:00:03.285023+0000","last_fullsized":"2023-05-24T04:00:03.285023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282319+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:03.282319+0000","last_peered":"2023-05-24T04:00:03.282319+0000","last_clean":"2023-05-24T04:00:03.282319+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:03.282319+0000","last_undegraded":"2023-05-24T04:00:03.282319+0000","last_fullsized":"2023-05-24T04:00:03.282319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:51:01.780904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673177+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:02.673177+0000","last_peered":"2023-05-24T04:00:02.673177+0000","last_clean":"2023-05-24T04:00:02.673177+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:02.673177+0000","last_undegraded":"2023-05-24T04:00:02.673177+0000","last_fullsized":"2023-05-24T04:00:02.673177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:41.878236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332012+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:02.332012+0000","last_peered":"2023-05-24T04:00:02.332012+0000","last_clean":"2023-05-24T04:00:02.332012+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:02.332012+0000","last_undegraded":"2023-05-24T04:00:02.332012+0000","last_fullsized":"2023-05-24T04:00:02.332012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:09:21.966314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284283+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:03.284283+0000","last_peered":"2023-05-24T04:00:03.284283+0000","last_clean":"2023-05-24T04:00:03.284283+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:03.284283+0000","last_undegraded":"2023-05-24T04:00:03.284283+0000","last_fullsized":"2023-05-24T04:00:03.284283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:46.140598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282668+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:03.282668+0000","last_peered":"2023-05-24T04:00:03.282668+0000","last_clean":"2023-05-24T04:00:03.282668+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:03.282668+0000","last_undegraded":"2023-05-24T04:00:03.282668+0000","last_fullsized":"2023-05-24T04:00:03.282668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674153+0000","last_change":"2023-05-24T03:59:57.943601+0000","last_active":"2023-05-24T04:00:02.674153+0000","last_peered":"2023-05-24T04:00:02.674153+0000","last_clean":"2023-05-24T04:00:02.674153+0000","last_became_active":"2023-05-24T03:59:57.943293+0000","last_became_peered":"2023-05-24T03:59:57.943293+0000","last_unstale":"2023-05-24T04:00:02.674153+0000","last_undegraded":"2023-05-24T04:00:02.674153+0000","last_fullsized":"2023-05-24T04:00:02.674153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672507+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:02.672507+0000","last_peered":"2023-05-24T04:00:02.672507+0000","last_clean":"2023-05-24T04:00:02.672507+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:02.672507+0000","last_undegraded":"2023-05-24T04:00:02.672507+0000","last_fullsized":"2023-05-24T04:00:02.672507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:47:44.006595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326439+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:02.326439+0000","last_peered":"2023-05-24T04:00:02.326439+0000","last_clean":"2023-05-24T04:00:02.326439+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:02.326439+0000","last_undegraded":"2023-05-24T04:00:02.326439+0000","last_fullsized":"2023-05-24T04:00:02.326439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:21.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326937+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:02.326937+0000","last_peered":"2023-05-24T04:00:02.326937+0000","last_clean":"2023-05-24T04:00:02.326937+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:02.326937+0000","last_undegraded":"2023-05-24T04:00:02.326937+0000","last_fullsized":"2023-05-24T04:00:02.326937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:49.486454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282960+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:03.282960+0000","last_peered":"2023-05-24T04:00:03.282960+0000","last_clean":"2023-05-24T04:00:03.282960+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:03.282960+0000","last_undegraded":"2023-05-24T04:00:03.282960+0000","last_fullsized":"2023-05-24T04:00:03.282960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281634+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:03.281634+0000","last_peered":"2023-05-24T04:00:03.281634+0000","last_clean":"2023-05-24T04:00:03.281634+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:03.281634+0000","last_undegraded":"2023-05-24T04:00:03.281634+0000","last_fullsized":"2023-05-24T04:00:03.281634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282747+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:03.282747+0000","last_peered":"2023-05-24T04:00:03.282747+0000","last_clean":"2023-05-24T04:00:03.282747+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:03.282747+0000","last_undegraded":"2023-05-24T04:00:03.282747+0000","last_fullsized":"2023-05-24T04:00:03.282747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:43.884737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285575+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:03.285575+0000","last_peered":"2023-05-24T04:00:03.285575+0000","last_clean":"2023-05-24T04:00:03.285575+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:03.285575+0000","last_undegraded":"2023-05-24T04:00:03.285575+0000","last_fullsized":"2023-05-24T04:00:03.285575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333304+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:02.333304+0000","last_peered":"2023-05-24T04:00:02.333304+0000","last_clean":"2023-05-24T04:00:02.333304+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:02.333304+0000","last_undegraded":"2023-05-24T04:00:02.333304+0000","last_fullsized":"2023-05-24T04:00:02.333304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:28:34.017147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362742+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:02.362742+0000","last_peered":"2023-05-24T04:00:02.362742+0000","last_clean":"2023-05-24T04:00:02.362742+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:02.362742+0000","last_undegraded":"2023-05-24T04:00:02.362742+0000","last_fullsized":"2023-05-24T04:00:02.362742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284681+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:03.284681+0000","last_peered":"2023-05-24T04:00:03.284681+0000","last_clean":"2023-05-24T04:00:03.284681+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:03.284681+0000","last_undegraded":"2023-05-24T04:00:03.284681+0000","last_fullsized":"2023-05-24T04:00:03.284681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:24.858148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283099+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:03.283099+0000","last_peered":"2023-05-24T04:00:03.283099+0000","last_clean":"2023-05-24T04:00:03.283099+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:03.283099+0000","last_undegraded":"2023-05-24T04:00:03.283099+0000","last_fullsized":"2023-05-24T04:00:03.283099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.224030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283187+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:03.283187+0000","last_peered":"2023-05-24T04:00:03.283187+0000","last_clean":"2023-05-24T04:00:03.283187+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:03.283187+0000","last_undegraded":"2023-05-24T04:00:03.283187+0000","last_fullsized":"2023-05-24T04:00:03.283187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:31.149121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674192+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:02.674192+0000","last_peered":"2023-05-24T04:00:02.674192+0000","last_clean":"2023-05-24T04:00:02.674192+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:02.674192+0000","last_undegraded":"2023-05-24T04:00:02.674192+0000","last_fullsized":"2023-05-24T04:00:02.674192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362180+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:02.362180+0000","last_peered":"2023-05-24T04:00:02.362180+0000","last_clean":"2023-05-24T04:00:02.362180+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:02.362180+0000","last_undegraded":"2023-05-24T04:00:02.362180+0000","last_fullsized":"2023-05-24T04:00:02.362180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:50.182886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331311+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:02.331311+0000","last_peered":"2023-05-24T04:00:02.331311+0000","last_clean":"2023-05-24T04:00:02.331311+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:02.331311+0000","last_undegraded":"2023-05-24T04:00:02.331311+0000","last_fullsized":"2023-05-24T04:00:02.331311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:23.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331513+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:02.331513+0000","last_peered":"2023-05-24T04:00:02.331513+0000","last_clean":"2023-05-24T04:00:02.331513+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:02.331513+0000","last_undegraded":"2023-05-24T04:00:02.331513+0000","last_fullsized":"2023-05-24T04:00:02.331513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330561+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:02.330561+0000","last_peered":"2023-05-24T04:00:02.330561+0000","last_clean":"2023-05-24T04:00:02.330561+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:02.330561+0000","last_undegraded":"2023-05-24T04:00:02.330561+0000","last_fullsized":"2023-05-24T04:00:02.330561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:31.974554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285241+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:03.285241+0000","last_peered":"2023-05-24T04:00:03.285241+0000","last_clean":"2023-05-24T04:00:03.285241+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:03.285241+0000","last_undegraded":"2023-05-24T04:00:03.285241+0000","last_fullsized":"2023-05-24T04:00:03.285241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:17.075712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330946+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:02.330946+0000","last_peered":"2023-05-24T04:00:02.330946+0000","last_clean":"2023-05-24T04:00:02.330946+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:02.330946+0000","last_undegraded":"2023-05-24T04:00:02.330946+0000","last_fullsized":"2023-05-24T04:00:02.330946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332083+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:02.332083+0000","last_peered":"2023-05-24T04:00:02.332083+0000","last_clean":"2023-05-24T04:00:02.332083+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:02.332083+0000","last_undegraded":"2023-05-24T04:00:02.332083+0000","last_fullsized":"2023-05-24T04:00:02.332083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:42.657478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672804+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:02.672804+0000","last_peered":"2023-05-24T04:00:02.672804+0000","last_clean":"2023-05-24T04:00:02.672804+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:02.672804+0000","last_undegraded":"2023-05-24T04:00:02.672804+0000","last_fullsized":"2023-05-24T04:00:02.672804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:29.691457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332202+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:02.332202+0000","last_peered":"2023-05-24T04:00:02.332202+0000","last_clean":"2023-05-24T04:00:02.332202+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:02.332202+0000","last_undegraded":"2023-05-24T04:00:02.332202+0000","last_fullsized":"2023-05-24T04:00:02.332202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:53.899808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362667+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:02.362667+0000","last_peered":"2023-05-24T04:00:02.362667+0000","last_clean":"2023-05-24T04:00:02.362667+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:02.362667+0000","last_undegraded":"2023-05-24T04:00:02.362667+0000","last_fullsized":"2023-05-24T04:00:02.362667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326499+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:02.326499+0000","last_peered":"2023-05-24T04:00:02.326499+0000","last_clean":"2023-05-24T04:00:02.326499+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:02.326499+0000","last_undegraded":"2023-05-24T04:00:02.326499+0000","last_fullsized":"2023-05-24T04:00:02.326499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:58.397535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282498+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:03.282498+0000","last_peered":"2023-05-24T04:00:03.282498+0000","last_clean":"2023-05-24T04:00:03.282498+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:03.282498+0000","last_undegraded":"2023-05-24T04:00:03.282498+0000","last_fullsized":"2023-05-24T04:00:03.282498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283868+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:03.283868+0000","last_peered":"2023-05-24T04:00:03.283868+0000","last_clean":"2023-05-24T04:00:03.283868+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:03.283868+0000","last_undegraded":"2023-05-24T04:00:03.283868+0000","last_fullsized":"2023-05-24T04:00:03.283868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:47.927025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326480+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:02.326480+0000","last_peered":"2023-05-24T04:00:02.326480+0000","last_clean":"2023-05-24T04:00:02.326480+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:02.326480+0000","last_undegraded":"2023-05-24T04:00:02.326480+0000","last_fullsized":"2023-05-24T04:00:02.326480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:28:04.663781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331449+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:02.331449+0000","last_peered":"2023-05-24T04:00:02.331449+0000","last_clean":"2023-05-24T04:00:02.331449+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:02.331449+0000","last_undegraded":"2023-05-24T04:00:02.331449+0000","last_fullsized":"2023-05-24T04:00:02.331449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:51:07.300738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285444+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:03.285444+0000","last_peered":"2023-05-24T04:00:03.285444+0000","last_clean":"2023-05-24T04:00:03.285444+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:03.285444+0000","last_undegraded":"2023-05-24T04:00:03.285444+0000","last_fullsized":"2023-05-24T04:00:03.285444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326235+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:02.326235+0000","last_peered":"2023-05-24T04:00:02.326235+0000","last_clean":"2023-05-24T04:00:02.326235+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:02.326235+0000","last_undegraded":"2023-05-24T04:00:02.326235+0000","last_fullsized":"2023-05-24T04:00:02.326235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:37.831392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329749+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:02.329749+0000","last_peered":"2023-05-24T04:00:02.329749+0000","last_clean":"2023-05-24T04:00:02.329749+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:02.329749+0000","last_undegraded":"2023-05-24T04:00:02.329749+0000","last_fullsized":"2023-05-24T04:00:02.329749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:46.939599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285009+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:03.285009+0000","last_peered":"2023-05-24T04:00:03.285009+0000","last_clean":"2023-05-24T04:00:03.285009+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:03.285009+0000","last_undegraded":"2023-05-24T04:00:03.285009+0000","last_fullsized":"2023-05-24T04:00:03.285009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326958+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:02.326958+0000","last_peered":"2023-05-24T04:00:02.326958+0000","last_clean":"2023-05-24T04:00:02.326958+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:02.326958+0000","last_undegraded":"2023-05-24T04:00:02.326958+0000","last_fullsized":"2023-05-24T04:00:02.326958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:18:48.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282592+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:03.282592+0000","last_peered":"2023-05-24T04:00:03.282592+0000","last_clean":"2023-05-24T04:00:03.282592+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:03.282592+0000","last_undegraded":"2023-05-24T04:00:03.282592+0000","last_fullsized":"2023-05-24T04:00:03.282592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:24.952669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285821+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:03.285821+0000","last_peered":"2023-05-24T04:00:03.285821+0000","last_clean":"2023-05-24T04:00:03.285821+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:03.285821+0000","last_undegraded":"2023-05-24T04:00:03.285821+0000","last_fullsized":"2023-05-24T04:00:03.285821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:20.609741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283124+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:03.283124+0000","last_peered":"2023-05-24T04:00:03.283124+0000","last_clean":"2023-05-24T04:00:03.283124+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:03.283124+0000","last_undegraded":"2023-05-24T04:00:03.283124+0000","last_fullsized":"2023-05-24T04:00:03.283124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283719+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:03.283719+0000","last_peered":"2023-05-24T04:00:03.283719+0000","last_clean":"2023-05-24T04:00:03.283719+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:03.283719+0000","last_undegraded":"2023-05-24T04:00:03.283719+0000","last_fullsized":"2023-05-24T04:00:03.283719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:43.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329762+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:02.329762+0000","last_peered":"2023-05-24T04:00:02.329762+0000","last_clean":"2023-05-24T04:00:02.329762+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:02.329762+0000","last_undegraded":"2023-05-24T04:00:02.329762+0000","last_fullsized":"2023-05-24T04:00:02.329762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:56:59.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363323+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:02.363323+0000","last_peered":"2023-05-24T04:00:02.363323+0000","last_clean":"2023-05-24T04:00:02.363323+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:02.363323+0000","last_undegraded":"2023-05-24T04:00:02.363323+0000","last_fullsized":"2023-05-24T04:00:02.363323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:13.664663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363303+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:02.363303+0000","last_peered":"2023-05-24T04:00:02.363303+0000","last_clean":"2023-05-24T04:00:02.363303+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:02.363303+0000","last_undegraded":"2023-05-24T04:00:02.363303+0000","last_fullsized":"2023-05-24T04:00:02.363303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283798+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:03.283798+0000","last_peered":"2023-05-24T04:00:03.283798+0000","last_clean":"2023-05-24T04:00:03.283798+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:03.283798+0000","last_undegraded":"2023-05-24T04:00:03.283798+0000","last_fullsized":"2023-05-24T04:00:03.283798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283107+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:03.283107+0000","last_peered":"2023-05-24T04:00:03.283107+0000","last_clean":"2023-05-24T04:00:03.283107+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:03.283107+0000","last_undegraded":"2023-05-24T04:00:03.283107+0000","last_fullsized":"2023-05-24T04:00:03.283107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281988+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:03.281988+0000","last_peered":"2023-05-24T04:00:03.281988+0000","last_clean":"2023-05-24T04:00:03.281988+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:03.281988+0000","last_undegraded":"2023-05-24T04:00:03.281988+0000","last_fullsized":"2023-05-24T04:00:03.281988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:12.761189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284815+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:03.284815+0000","last_peered":"2023-05-24T04:00:03.284815+0000","last_clean":"2023-05-24T04:00:03.284815+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:03.284815+0000","last_undegraded":"2023-05-24T04:00:03.284815+0000","last_fullsized":"2023-05-24T04:00:03.284815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:31.585428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362908+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:02.362908+0000","last_peered":"2023-05-24T04:00:02.362908+0000","last_clean":"2023-05-24T04:00:02.362908+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:02.362908+0000","last_undegraded":"2023-05-24T04:00:02.362908+0000","last_fullsized":"2023-05-24T04:00:02.362908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:39.263590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283473+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:03.283473+0000","last_peered":"2023-05-24T04:00:03.283473+0000","last_clean":"2023-05-24T04:00:03.283473+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:03.283473+0000","last_undegraded":"2023-05-24T04:00:03.283473+0000","last_fullsized":"2023-05-24T04:00:03.283473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:48.939524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363256+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:02.363256+0000","last_peered":"2023-05-24T04:00:02.363256+0000","last_clean":"2023-05-24T04:00:02.363256+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:02.363256+0000","last_undegraded":"2023-05-24T04:00:02.363256+0000","last_fullsized":"2023-05-24T04:00:02.363256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:29.382612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283979+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:03.283979+0000","last_peered":"2023-05-24T04:00:03.283979+0000","last_clean":"2023-05-24T04:00:03.283979+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:03.283979+0000","last_undegraded":"2023-05-24T04:00:03.283979+0000","last_fullsized":"2023-05-24T04:00:03.283979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329457+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:02.329457+0000","last_peered":"2023-05-24T04:00:02.329457+0000","last_clean":"2023-05-24T04:00:02.329457+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:02.329457+0000","last_undegraded":"2023-05-24T04:00:02.329457+0000","last_fullsized":"2023-05-24T04:00:02.329457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:06:39.129747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362046+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:02.362046+0000","last_peered":"2023-05-24T04:00:02.362046+0000","last_clean":"2023-05-24T04:00:02.362046+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:02.362046+0000","last_undegraded":"2023-05-24T04:00:02.362046+0000","last_fullsized":"2023-05-24T04:00:02.362046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330454+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:02.330454+0000","last_peered":"2023-05-24T04:00:02.330454+0000","last_clean":"2023-05-24T04:00:02.330454+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:02.330454+0000","last_undegraded":"2023-05-24T04:00:02.330454+0000","last_fullsized":"2023-05-24T04:00:02.330454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:26.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362536+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:02.362536+0000","last_peered":"2023-05-24T04:00:02.362536+0000","last_clean":"2023-05-24T04:00:02.362536+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:02.362536+0000","last_undegraded":"2023-05-24T04:00:02.362536+0000","last_fullsized":"2023-05-24T04:00:02.362536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673473+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:02.673473+0000","last_peered":"2023-05-24T04:00:02.673473+0000","last_clean":"2023-05-24T04:00:02.673473+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:02.673473+0000","last_undegraded":"2023-05-24T04:00:02.673473+0000","last_fullsized":"2023-05-24T04:00:02.673473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:13.776152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284495+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:03.284495+0000","last_peered":"2023-05-24T04:00:03.284495+0000","last_clean":"2023-05-24T04:00:03.284495+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:03.284495+0000","last_undegraded":"2023-05-24T04:00:03.284495+0000","last_fullsized":"2023-05-24T04:00:03.284495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673918+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:02.673918+0000","last_peered":"2023-05-24T04:00:02.673918+0000","last_clean":"2023-05-24T04:00:02.673918+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:02.673918+0000","last_undegraded":"2023-05-24T04:00:02.673918+0000","last_fullsized":"2023-05-24T04:00:02.673918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674024+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:02.674024+0000","last_peered":"2023-05-24T04:00:02.674024+0000","last_clean":"2023-05-24T04:00:02.674024+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:02.674024+0000","last_undegraded":"2023-05-24T04:00:02.674024+0000","last_fullsized":"2023-05-24T04:00:02.674024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282709+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:03.282709+0000","last_peered":"2023-05-24T04:00:03.282709+0000","last_clean":"2023-05-24T04:00:03.282709+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:03.282709+0000","last_undegraded":"2023-05-24T04:00:03.282709+0000","last_fullsized":"2023-05-24T04:00:03.282709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361920+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:02.361920+0000","last_peered":"2023-05-24T04:00:02.361920+0000","last_clean":"2023-05-24T04:00:02.361920+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:02.361920+0000","last_undegraded":"2023-05-24T04:00:02.361920+0000","last_fullsized":"2023-05-24T04:00:02.361920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282020+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:03.282020+0000","last_peered":"2023-05-24T04:00:03.282020+0000","last_clean":"2023-05-24T04:00:03.282020+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:03.282020+0000","last_undegraded":"2023-05-24T04:00:03.282020+0000","last_fullsized":"2023-05-24T04:00:03.282020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:12.612403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283275+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:03.283275+0000","last_peered":"2023-05-24T04:00:03.283275+0000","last_clean":"2023-05-24T04:00:03.283275+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:03.283275+0000","last_undegraded":"2023-05-24T04:00:03.283275+0000","last_fullsized":"2023-05-24T04:00:03.283275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331904+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:02.331904+0000","last_peered":"2023-05-24T04:00:02.331904+0000","last_clean":"2023-05-24T04:00:02.331904+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:02.331904+0000","last_undegraded":"2023-05-24T04:00:02.331904+0000","last_fullsized":"2023-05-24T04:00:02.331904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:26:07.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326634+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:02.326634+0000","last_peered":"2023-05-24T04:00:02.326634+0000","last_clean":"2023-05-24T04:00:02.326634+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:02.326634+0000","last_undegraded":"2023-05-24T04:00:02.326634+0000","last_fullsized":"2023-05-24T04:00:02.326634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:23:41.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331187+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:02.331187+0000","last_peered":"2023-05-24T04:00:02.331187+0000","last_clean":"2023-05-24T04:00:02.331187+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:02.331187+0000","last_undegraded":"2023-05-24T04:00:02.331187+0000","last_fullsized":"2023-05-24T04:00:02.331187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:20.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283457+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:03.283457+0000","last_peered":"2023-05-24T04:00:03.283457+0000","last_clean":"2023-05-24T04:00:03.283457+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:03.283457+0000","last_undegraded":"2023-05-24T04:00:03.283457+0000","last_fullsized":"2023-05-24T04:00:03.283457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328836+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:02.328836+0000","last_peered":"2023-05-24T04:00:02.328836+0000","last_clean":"2023-05-24T04:00:02.328836+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:02.328836+0000","last_undegraded":"2023-05-24T04:00:02.328836+0000","last_fullsized":"2023-05-24T04:00:02.328836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:22.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283484+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:03.283484+0000","last_peered":"2023-05-24T04:00:03.283484+0000","last_clean":"2023-05-24T04:00:03.283484+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:03.283484+0000","last_undegraded":"2023-05-24T04:00:03.283484+0000","last_fullsized":"2023-05-24T04:00:03.283484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283949+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:03.283949+0000","last_peered":"2023-05-24T04:00:03.283949+0000","last_clean":"2023-05-24T04:00:03.283949+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:03.283949+0000","last_undegraded":"2023-05-24T04:00:03.283949+0000","last_fullsized":"2023-05-24T04:00:03.283949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326231+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:02.326231+0000","last_peered":"2023-05-24T04:00:02.326231+0000","last_clean":"2023-05-24T04:00:02.326231+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:02.326231+0000","last_undegraded":"2023-05-24T04:00:02.326231+0000","last_fullsized":"2023-05-24T04:00:02.326231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:08:53.915635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326785+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:02.326785+0000","last_peered":"2023-05-24T04:00:02.326785+0000","last_clean":"2023-05-24T04:00:02.326785+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:02.326785+0000","last_undegraded":"2023-05-24T04:00:02.326785+0000","last_fullsized":"2023-05-24T04:00:02.326785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:35:05.345944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330585+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:02.330585+0000","last_peered":"2023-05-24T04:00:02.330585+0000","last_clean":"2023-05-24T04:00:02.330585+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:02.330585+0000","last_undegraded":"2023-05-24T04:00:02.330585+0000","last_fullsized":"2023-05-24T04:00:02.330585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284900+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:03.284900+0000","last_peered":"2023-05-24T04:00:03.284900+0000","last_clean":"2023-05-24T04:00:03.284900+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:03.284900+0000","last_undegraded":"2023-05-24T04:00:03.284900+0000","last_fullsized":"2023-05-24T04:00:03.284900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:17.860183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283198+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:03.283198+0000","last_peered":"2023-05-24T04:00:03.283198+0000","last_clean":"2023-05-24T04:00:03.283198+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:03.283198+0000","last_undegraded":"2023-05-24T04:00:03.283198+0000","last_fullsized":"2023-05-24T04:00:03.283198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282366+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:03.282366+0000","last_peered":"2023-05-24T04:00:03.282366+0000","last_clean":"2023-05-24T04:00:03.282366+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:03.282366+0000","last_undegraded":"2023-05-24T04:00:03.282366+0000","last_fullsized":"2023-05-24T04:00:03.282366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283141+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:03.283141+0000","last_peered":"2023-05-24T04:00:03.283141+0000","last_clean":"2023-05-24T04:00:03.283141+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:03.283141+0000","last_undegraded":"2023-05-24T04:00:03.283141+0000","last_fullsized":"2023-05-24T04:00:03.283141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329420+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:02.329420+0000","last_peered":"2023-05-24T04:00:02.329420+0000","last_clean":"2023-05-24T04:00:02.329420+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:02.329420+0000","last_undegraded":"2023-05-24T04:00:02.329420+0000","last_fullsized":"2023-05-24T04:00:02.329420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283341+0000","last_change":"2023-05-24T03:59:57.913975+0000","last_active":"2023-05-24T04:00:03.283341+0000","last_peered":"2023-05-24T04:00:03.283341+0000","last_clean":"2023-05-24T04:00:03.283341+0000","last_became_active":"2023-05-24T03:59:57.913528+0000","last_became_peered":"2023-05-24T03:59:57.913528+0000","last_unstale":"2023-05-24T04:00:03.283341+0000","last_undegraded":"2023-05-24T04:00:03.283341+0000","last_fullsized":"2023-05-24T04:00:03.283341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333140+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:02.333140+0000","last_peered":"2023-05-24T04:00:02.333140+0000","last_clean":"2023-05-24T04:00:02.333140+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:02.333140+0000","last_undegraded":"2023-05-24T04:00:02.333140+0000","last_fullsized":"2023-05-24T04:00:02.333140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:29.390853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330279+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:02.330279+0000","last_peered":"2023-05-24T04:00:02.330279+0000","last_clean":"2023-05-24T04:00:02.330279+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:02.330279+0000","last_undegraded":"2023-05-24T04:00:02.330279+0000","last_fullsized":"2023-05-24T04:00:02.330279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284322+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:03.284322+0000","last_peered":"2023-05-24T04:00:03.284322+0000","last_clean":"2023-05-24T04:00:03.284322+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:03.284322+0000","last_undegraded":"2023-05-24T04:00:03.284322+0000","last_fullsized":"2023-05-24T04:00:03.284322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326738+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:02.326738+0000","last_peered":"2023-05-24T04:00:02.326738+0000","last_clean":"2023-05-24T04:00:02.326738+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:02.326738+0000","last_undegraded":"2023-05-24T04:00:02.326738+0000","last_fullsized":"2023-05-24T04:00:02.326738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:18:29.367916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":714326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18220,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353620,"statfs":{"total":96636764160,"available":96618106880,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":123798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18216,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353624,"statfs":{"total":96636764160,"available":96618110976,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18796,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353044,"statfs":{"total":96636764160,"available":96617517056,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:00:23.394 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:00:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 Processor -- start 2023-05-24T04:00:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 -- start start 2023-05-24T04:00:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa30814fa70 0x7fa30806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa308070b20 0x7fa30806bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa308145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30806ea20 con 0x7fa308070b20 2023-05-24T04:00:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30806ec70 con 0x7fa30814fa70 2023-05-24T04:00:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30e7b4640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa308150230 con 0x7fa30806c000 2023-05-24T04:00:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa3077fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa308070b20 0x7fa30806bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa3077fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa308070b20 0x7fa30806bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47848/0 (socket says 172.21.15.40:47848) 2023-05-24T04:00:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa3077fe640 1 -- 172.21.15.40:0/3929583510 learned_addr learned my addr 172.21.15.40:0/3929583510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa30cd51640 1 --2- 172.21.15.40:0/3929583510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa308145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.550+0000 7fa307fff640 1 --2- 172.21.15.40:0/3929583510 >> v2:172.21.15.67:3300/0 conn(0x7fa30814fa70 0x7fa30806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa3077fe640 1 -- 172.21.15.40:0/3929583510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 msgr2=0x7fa308145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa3077fe640 1 --2- 172.21.15.40:0/3929583510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa308145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa3077fe640 1 -- 172.21.15.40:0/3929583510 >> v2:172.21.15.67:3300/0 conn(0x7fa30814fa70 msgr2=0x7fa30806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa3077fe640 1 --2- 172.21.15.40:0/3929583510 >> v2:172.21.15.67:3300/0 conn(0x7fa30814fa70 0x7fa30806fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa3077fe640 1 -- 172.21.15.40:0/3929583510 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080c10d0 con 0x7fa308070b20 2023-05-24T04:00:23.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa3077fe640 1 --2- 172.21.15.40:0/3929583510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa308070b20 0x7fa30806bac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa30806d650 tx=0x7fa2fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3c2c8e72359439 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa306ffd640 1 -- 172.21.15.40:0/3929583510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0ab600 con 0x7fa308070b20 2023-05-24T04:00:23.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa306ffd640 1 -- 172.21.15.40:0/3929583510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0a7050 con 0x7fa308070b20 2023-05-24T04:00:23.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa306ffd640 1 -- 172.21.15.40:0/3929583510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0ab980 con 0x7fa308070b20 2023-05-24T04:00:23.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 -- 172.21.15.40:0/3929583510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa308070b20 msgr2=0x7fa30806bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/3929583510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa308070b20 0x7fa30806bac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa30806d650 tx=0x7fa2fc01c500 comp rx=0 tx=0).stop 2023-05-24T04:00:23.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 -- 172.21.15.40:0/3929583510 shutdown_connections 2023-05-24T04:00:23.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/3929583510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa308145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/3929583510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa308070b20 0x7fa30806bac0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/3929583510 >> v2:172.21.15.67:3300/0 conn(0x7fa30814fa70 0x7fa30806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 -- 172.21.15.40:0/3929583510 >> 172.21.15.40:0/3929583510 conn(0x7fa3080c0280 msgr2=0x7fa3080c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 -- 172.21.15.40:0/3929583510 shutdown_connections 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.554+0000 7fa30e7b4640 1 -- 172.21.15.40:0/3929583510 wait complete. 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 Processor -- start 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- start start 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa30813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa308070b20 0x7fa3081e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 0x7fa3081e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3081386a0 con 0x7fa30814fa70 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308139c30 con 0x7fa308070b20 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3081388f0 con 0x7fa30806c000 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 0x7fa3081e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 0x7fa3081e8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47860/0 (socket says 172.21.15.40:47860) 2023-05-24T04:00:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 -- 172.21.15.40:0/880271585 learned_addr learned my addr 172.21.15.40:0/880271585 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa307fff640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa30813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa3077fe640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa308070b20 0x7fa3081e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 -- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 msgr2=0x7fa30813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa30813ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 -- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa308070b20 msgr2=0x7fa3081e7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa308070b20 0x7fa3081e7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 -- 172.21.15.40:0/880271585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc0094d0 con 0x7fa30814fa70 2023-05-24T04:00:23.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30cd51640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 0x7fa3081e8370 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa300007e10 tx=0x7fa30000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300014620 con 0x7fa30814fa70 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3000147a0 con 0x7fa30814fa70 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300014b50 con 0x7fa30814fa70 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30814ffd0 con 0x7fa30814fa70 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30814fe40 con 0x7fa30814fa70 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.558+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30814ca00 con 0x7fa30814fa70 2023-05-24T04:00:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.562+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa300014cb0 con 0x7fa30814fa70 2023-05-24T04:00:23.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.562+0000 7fa304ff9640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa2f4066280 0x7fa2f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.562+0000 7fa307fff640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa2f4066280 0x7fa2f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.562+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa300084a70 con 0x7fa30814fa70 2023-05-24T04:00:23.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.562+0000 7fa307fff640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa2f4066280 0x7fa2f4068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d8d0 tx=0x7fa2f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.566+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa300055600 con 0x7fa30814fa70 2023-05-24T04:00:23.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.714+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa30804ddd0 con 0x7fa2f4066280 2023-05-24T04:00:23.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.722+0000 7fa304ff9640 1 -- 172.21.15.40:0/880271585 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367324 (secure 0 0 0) 0x7fa30804ddd0 con 0x7fa2f4066280 2023-05-24T04:00:23.731 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:23.734 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:00:23.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa2f4066280 msgr2=0x7fa2f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa2f4066280 0x7fa2f4068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d8d0 tx=0x7fa2f8008040 comp rx=0 tx=0).stop 2023-05-24T04:00:23.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 msgr2=0x7fa3081e8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 0x7fa3081e8370 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa300007e10 tx=0x7fa30000e4b0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 shutdown_connections 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa2f4066280 0x7fa2f4068730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30814fa70 0x7fa3081e8370 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa308070b20 0x7fa3081e7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 --2- 172.21.15.40:0/880271585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa30806c000 0x7fa30813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 >> 172.21.15.40:0/880271585 conn(0x7fa3080c0280 msgr2=0x7fa308067900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 shutdown_connections 2023-05-24T04:00:23.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.730+0000 7fa30e7b4640 1 -- 172.21.15.40:0/880271585 wait complete. 2023-05-24T04:00:23.750 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-05-24T04:00:22.527775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":146920,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827800,"statfs":{"total":773094113280,"available":772943667200,"internally_reserved":0,"allocated":3579904,"data_stored":2149222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004572"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672564+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:02.672564+0000","last_peered":"2023-05-24T04:00:02.672564+0000","last_clean":"2023-05-24T04:00:02.672564+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:02.672564+0000","last_undegraded":"2023-05-24T04:00:02.672564+0000","last_fullsized":"2023-05-24T04:00:02.672564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:48.464106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283617+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:03.283617+0000","last_peered":"2023-05-24T04:00:03.283617+0000","last_clean":"2023-05-24T04:00:03.283617+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:03.283617+0000","last_undegraded":"2023-05-24T04:00:03.283617+0000","last_fullsized":"2023-05-24T04:00:03.283617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328955+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:02.328955+0000","last_peered":"2023-05-24T04:00:02.328955+0000","last_clean":"2023-05-24T04:00:02.328955+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:02.328955+0000","last_undegraded":"2023-05-24T04:00:02.328955+0000","last_fullsized":"2023-05-24T04:00:02.328955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328599+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:02.328599+0000","last_peered":"2023-05-24T04:00:02.328599+0000","last_clean":"2023-05-24T04:00:02.328599+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:02.328599+0000","last_undegraded":"2023-05-24T04:00:02.328599+0000","last_fullsized":"2023-05-24T04:00:02.328599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363367+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:02.363367+0000","last_peered":"2023-05-24T04:00:02.363367+0000","last_clean":"2023-05-24T04:00:02.363367+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:02.363367+0000","last_undegraded":"2023-05-24T04:00:02.363367+0000","last_fullsized":"2023-05-24T04:00:02.363367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:34.290959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362509+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:02.362509+0000","last_peered":"2023-05-24T04:00:02.362509+0000","last_clean":"2023-05-24T04:00:02.362509+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:02.362509+0000","last_undegraded":"2023-05-24T04:00:02.362509+0000","last_fullsized":"2023-05-24T04:00:02.362509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284412+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:03.284412+0000","last_peered":"2023-05-24T04:00:03.284412+0000","last_clean":"2023-05-24T04:00:03.284412+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:03.284412+0000","last_undegraded":"2023-05-24T04:00:03.284412+0000","last_fullsized":"2023-05-24T04:00:03.284412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285038+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:03.285038+0000","last_peered":"2023-05-24T04:00:03.285038+0000","last_clean":"2023-05-24T04:00:03.285038+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:03.285038+0000","last_undegraded":"2023-05-24T04:00:03.285038+0000","last_fullsized":"2023-05-24T04:00:03.285038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329969+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:02.329969+0000","last_peered":"2023-05-24T04:00:02.329969+0000","last_clean":"2023-05-24T04:00:02.329969+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:02.329969+0000","last_undegraded":"2023-05-24T04:00:02.329969+0000","last_fullsized":"2023-05-24T04:00:02.329969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284437+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:03.284437+0000","last_peered":"2023-05-24T04:00:03.284437+0000","last_clean":"2023-05-24T04:00:03.284437+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:03.284437+0000","last_undegraded":"2023-05-24T04:00:03.284437+0000","last_fullsized":"2023-05-24T04:00:03.284437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:21.271231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283513+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:03.283513+0000","last_peered":"2023-05-24T04:00:03.283513+0000","last_clean":"2023-05-24T04:00:03.283513+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:03.283513+0000","last_undegraded":"2023-05-24T04:00:03.283513+0000","last_fullsized":"2023-05-24T04:00:03.283513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:26.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331682+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:02.331682+0000","last_peered":"2023-05-24T04:00:02.331682+0000","last_clean":"2023-05-24T04:00:02.331682+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:02.331682+0000","last_undegraded":"2023-05-24T04:00:02.331682+0000","last_fullsized":"2023-05-24T04:00:02.331682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:50.558794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673853+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:02.673853+0000","last_peered":"2023-05-24T04:00:02.673853+0000","last_clean":"2023-05-24T04:00:02.673853+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:02.673853+0000","last_undegraded":"2023-05-24T04:00:02.673853+0000","last_fullsized":"2023-05-24T04:00:02.673853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283535+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:03.283535+0000","last_peered":"2023-05-24T04:00:03.283535+0000","last_clean":"2023-05-24T04:00:03.283535+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:03.283535+0000","last_undegraded":"2023-05-24T04:00:03.283535+0000","last_fullsized":"2023-05-24T04:00:03.283535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:28.900435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326827+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:02.326827+0000","last_peered":"2023-05-24T04:00:02.326827+0000","last_clean":"2023-05-24T04:00:02.326827+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:02.326827+0000","last_undegraded":"2023-05-24T04:00:02.326827+0000","last_fullsized":"2023-05-24T04:00:02.326827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:49:51.893837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331409+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:02.331409+0000","last_peered":"2023-05-24T04:00:02.331409+0000","last_clean":"2023-05-24T04:00:02.331409+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:02.331409+0000","last_undegraded":"2023-05-24T04:00:02.331409+0000","last_fullsized":"2023-05-24T04:00:02.331409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330783+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:02.330783+0000","last_peered":"2023-05-24T04:00:02.330783+0000","last_clean":"2023-05-24T04:00:02.330783+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:02.330783+0000","last_undegraded":"2023-05-24T04:00:02.330783+0000","last_fullsized":"2023-05-24T04:00:02.330783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:54.808184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363065+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:02.363065+0000","last_peered":"2023-05-24T04:00:02.363065+0000","last_clean":"2023-05-24T04:00:02.363065+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:02.363065+0000","last_undegraded":"2023-05-24T04:00:02.363065+0000","last_fullsized":"2023-05-24T04:00:02.363065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:22.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333322+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:02.333322+0000","last_peered":"2023-05-24T04:00:02.333322+0000","last_clean":"2023-05-24T04:00:02.333322+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:02.333322+0000","last_undegraded":"2023-05-24T04:00:02.333322+0000","last_fullsized":"2023-05-24T04:00:02.333322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:00.634094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673332+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:02.673332+0000","last_peered":"2023-05-24T04:00:02.673332+0000","last_clean":"2023-05-24T04:00:02.673332+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:02.673332+0000","last_undegraded":"2023-05-24T04:00:02.673332+0000","last_fullsized":"2023-05-24T04:00:02.673332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282810+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:03.282810+0000","last_peered":"2023-05-24T04:00:03.282810+0000","last_clean":"2023-05-24T04:00:03.282810+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:03.282810+0000","last_undegraded":"2023-05-24T04:00:03.282810+0000","last_fullsized":"2023-05-24T04:00:03.282810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282862+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:03.282862+0000","last_peered":"2023-05-24T04:00:03.282862+0000","last_clean":"2023-05-24T04:00:03.282862+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:03.282862+0000","last_undegraded":"2023-05-24T04:00:03.282862+0000","last_fullsized":"2023-05-24T04:00:03.282862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:52.353037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362055+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:02.362055+0000","last_peered":"2023-05-24T04:00:02.362055+0000","last_clean":"2023-05-24T04:00:02.362055+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:02.362055+0000","last_undegraded":"2023-05-24T04:00:02.362055+0000","last_fullsized":"2023-05-24T04:00:02.362055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:20.968502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333722+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:02.333722+0000","last_peered":"2023-05-24T04:00:02.333722+0000","last_clean":"2023-05-24T04:00:02.333722+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:02.333722+0000","last_undegraded":"2023-05-24T04:00:02.333722+0000","last_fullsized":"2023-05-24T04:00:02.333722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:15:50.664698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362004+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:02.362004+0000","last_peered":"2023-05-24T04:00:02.362004+0000","last_clean":"2023-05-24T04:00:02.362004+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:02.362004+0000","last_undegraded":"2023-05-24T04:00:02.362004+0000","last_fullsized":"2023-05-24T04:00:02.362004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283773+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:03.283773+0000","last_peered":"2023-05-24T04:00:03.283773+0000","last_clean":"2023-05-24T04:00:03.283773+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:03.283773+0000","last_undegraded":"2023-05-24T04:00:03.283773+0000","last_fullsized":"2023-05-24T04:00:03.283773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330368+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:02.330368+0000","last_peered":"2023-05-24T04:00:02.330368+0000","last_clean":"2023-05-24T04:00:02.330368+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:02.330368+0000","last_undegraded":"2023-05-24T04:00:02.330368+0000","last_fullsized":"2023-05-24T04:00:02.330368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:48:28.342687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362251+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:02.362251+0000","last_peered":"2023-05-24T04:00:02.362251+0000","last_clean":"2023-05-24T04:00:02.362251+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:02.362251+0000","last_undegraded":"2023-05-24T04:00:02.362251+0000","last_fullsized":"2023-05-24T04:00:02.362251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285221+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:03.285221+0000","last_peered":"2023-05-24T04:00:03.285221+0000","last_clean":"2023-05-24T04:00:03.285221+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:03.285221+0000","last_undegraded":"2023-05-24T04:00:03.285221+0000","last_fullsized":"2023-05-24T04:00:03.285221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282396+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:03.282396+0000","last_peered":"2023-05-24T04:00:03.282396+0000","last_clean":"2023-05-24T04:00:03.282396+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:03.282396+0000","last_undegraded":"2023-05-24T04:00:03.282396+0000","last_fullsized":"2023-05-24T04:00:03.282396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:30.582812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285127+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:03.285127+0000","last_peered":"2023-05-24T04:00:03.285127+0000","last_clean":"2023-05-24T04:00:03.285127+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:03.285127+0000","last_undegraded":"2023-05-24T04:00:03.285127+0000","last_fullsized":"2023-05-24T04:00:03.285127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:33:21.663609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673675+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:02.673675+0000","last_peered":"2023-05-24T04:00:02.673675+0000","last_clean":"2023-05-24T04:00:02.673675+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:02.673675+0000","last_undegraded":"2023-05-24T04:00:02.673675+0000","last_fullsized":"2023-05-24T04:00:02.673675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:50:58.369856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362343+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:02.362343+0000","last_peered":"2023-05-24T04:00:02.362343+0000","last_clean":"2023-05-24T04:00:02.362343+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:02.362343+0000","last_undegraded":"2023-05-24T04:00:02.362343+0000","last_fullsized":"2023-05-24T04:00:02.362343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:41.396863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:07.609800+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:07.609800+0000","last_peered":"2023-05-24T04:00:07.609800+0000","last_clean":"2023-05-24T04:00:07.609800+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:07.609800+0000","last_undegraded":"2023-05-24T04:00:07.609800+0000","last_fullsized":"2023-05-24T04:00:07.609800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331855+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:02.331855+0000","last_peered":"2023-05-24T04:00:02.331855+0000","last_clean":"2023-05-24T04:00:02.331855+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:02.331855+0000","last_undegraded":"2023-05-24T04:00:02.331855+0000","last_fullsized":"2023-05-24T04:00:02.331855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:05:19.807337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672982+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:02.672982+0000","last_peered":"2023-05-24T04:00:02.672982+0000","last_clean":"2023-05-24T04:00:02.672982+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:02.672982+0000","last_undegraded":"2023-05-24T04:00:02.672982+0000","last_fullsized":"2023-05-24T04:00:02.672982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:15.871289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330236+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:02.330236+0000","last_peered":"2023-05-24T04:00:02.330236+0000","last_clean":"2023-05-24T04:00:02.330236+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:02.330236+0000","last_undegraded":"2023-05-24T04:00:02.330236+0000","last_fullsized":"2023-05-24T04:00:02.330236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333814+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:02.333814+0000","last_peered":"2023-05-24T04:00:02.333814+0000","last_clean":"2023-05-24T04:00:02.333814+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:02.333814+0000","last_undegraded":"2023-05-24T04:00:02.333814+0000","last_fullsized":"2023-05-24T04:00:02.333814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:44:04.775971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283220+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:03.283220+0000","last_peered":"2023-05-24T04:00:03.283220+0000","last_clean":"2023-05-24T04:00:03.283220+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:03.283220+0000","last_undegraded":"2023-05-24T04:00:03.283220+0000","last_fullsized":"2023-05-24T04:00:03.283220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:26.723109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361756+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:02.361756+0000","last_peered":"2023-05-24T04:00:02.361756+0000","last_clean":"2023-05-24T04:00:02.361756+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:02.361756+0000","last_undegraded":"2023-05-24T04:00:02.361756+0000","last_fullsized":"2023-05-24T04:00:02.361756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361923+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:02.361923+0000","last_peered":"2023-05-24T04:00:02.361923+0000","last_clean":"2023-05-24T04:00:02.361923+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:02.361923+0000","last_undegraded":"2023-05-24T04:00:02.361923+0000","last_fullsized":"2023-05-24T04:00:02.361923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674247+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:02.674247+0000","last_peered":"2023-05-24T04:00:02.674247+0000","last_clean":"2023-05-24T04:00:02.674247+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:02.674247+0000","last_undegraded":"2023-05-24T04:00:02.674247+0000","last_fullsized":"2023-05-24T04:00:02.674247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:16.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363505+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:02.363505+0000","last_peered":"2023-05-24T04:00:02.363505+0000","last_clean":"2023-05-24T04:00:02.363505+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:02.363505+0000","last_undegraded":"2023-05-24T04:00:02.363505+0000","last_fullsized":"2023-05-24T04:00:02.363505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:38.541927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329007+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:02.329007+0000","last_peered":"2023-05-24T04:00:02.329007+0000","last_clean":"2023-05-24T04:00:02.329007+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:02.329007+0000","last_undegraded":"2023-05-24T04:00:02.329007+0000","last_fullsized":"2023-05-24T04:00:02.329007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282793+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:03.282793+0000","last_peered":"2023-05-24T04:00:03.282793+0000","last_clean":"2023-05-24T04:00:03.282793+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:03.282793+0000","last_undegraded":"2023-05-24T04:00:03.282793+0000","last_fullsized":"2023-05-24T04:00:03.282793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285507+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:03.285507+0000","last_peered":"2023-05-24T04:00:03.285507+0000","last_clean":"2023-05-24T04:00:03.285507+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:03.285507+0000","last_undegraded":"2023-05-24T04:00:03.285507+0000","last_fullsized":"2023-05-24T04:00:03.285507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:08.607412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673339+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:02.673339+0000","last_peered":"2023-05-24T04:00:02.673339+0000","last_clean":"2023-05-24T04:00:02.673339+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:02.673339+0000","last_undegraded":"2023-05-24T04:00:02.673339+0000","last_fullsized":"2023-05-24T04:00:02.673339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:47:35.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331141+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:02.331141+0000","last_peered":"2023-05-24T04:00:02.331141+0000","last_clean":"2023-05-24T04:00:02.331141+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:02.331141+0000","last_undegraded":"2023-05-24T04:00:02.331141+0000","last_fullsized":"2023-05-24T04:00:02.331141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:23:57.729163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673806+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:02.673806+0000","last_peered":"2023-05-24T04:00:02.673806+0000","last_clean":"2023-05-24T04:00:02.673806+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:02.673806+0000","last_undegraded":"2023-05-24T04:00:02.673806+0000","last_fullsized":"2023-05-24T04:00:02.673806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673598+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:02.673598+0000","last_peered":"2023-05-24T04:00:02.673598+0000","last_clean":"2023-05-24T04:00:02.673598+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:02.673598+0000","last_undegraded":"2023-05-24T04:00:02.673598+0000","last_fullsized":"2023-05-24T04:00:02.673598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:07.555151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285023+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:03.285023+0000","last_peered":"2023-05-24T04:00:03.285023+0000","last_clean":"2023-05-24T04:00:03.285023+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:03.285023+0000","last_undegraded":"2023-05-24T04:00:03.285023+0000","last_fullsized":"2023-05-24T04:00:03.285023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282319+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:03.282319+0000","last_peered":"2023-05-24T04:00:03.282319+0000","last_clean":"2023-05-24T04:00:03.282319+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:03.282319+0000","last_undegraded":"2023-05-24T04:00:03.282319+0000","last_fullsized":"2023-05-24T04:00:03.282319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:51:01.780904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673177+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:02.673177+0000","last_peered":"2023-05-24T04:00:02.673177+0000","last_clean":"2023-05-24T04:00:02.673177+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:02.673177+0000","last_undegraded":"2023-05-24T04:00:02.673177+0000","last_fullsized":"2023-05-24T04:00:02.673177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:41.878236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332012+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:02.332012+0000","last_peered":"2023-05-24T04:00:02.332012+0000","last_clean":"2023-05-24T04:00:02.332012+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:02.332012+0000","last_undegraded":"2023-05-24T04:00:02.332012+0000","last_fullsized":"2023-05-24T04:00:02.332012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:09:21.966314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284283+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:03.284283+0000","last_peered":"2023-05-24T04:00:03.284283+0000","last_clean":"2023-05-24T04:00:03.284283+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:03.284283+0000","last_undegraded":"2023-05-24T04:00:03.284283+0000","last_fullsized":"2023-05-24T04:00:03.284283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:46.140598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282668+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:03.282668+0000","last_peered":"2023-05-24T04:00:03.282668+0000","last_clean":"2023-05-24T04:00:03.282668+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:03.282668+0000","last_undegraded":"2023-05-24T04:00:03.282668+0000","last_fullsized":"2023-05-24T04:00:03.282668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:28.363718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674153+0000","last_change":"2023-05-24T03:59:57.943601+0000","last_active":"2023-05-24T04:00:02.674153+0000","last_peered":"2023-05-24T04:00:02.674153+0000","last_clean":"2023-05-24T04:00:02.674153+0000","last_became_active":"2023-05-24T03:59:57.943293+0000","last_became_peered":"2023-05-24T03:59:57.943293+0000","last_unstale":"2023-05-24T04:00:02.674153+0000","last_undegraded":"2023-05-24T04:00:02.674153+0000","last_fullsized":"2023-05-24T04:00:02.674153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:48.941989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672507+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:02.672507+0000","last_peered":"2023-05-24T04:00:02.672507+0000","last_clean":"2023-05-24T04:00:02.672507+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:02.672507+0000","last_undegraded":"2023-05-24T04:00:02.672507+0000","last_fullsized":"2023-05-24T04:00:02.672507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:47:44.006595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326439+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:02.326439+0000","last_peered":"2023-05-24T04:00:02.326439+0000","last_clean":"2023-05-24T04:00:02.326439+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:02.326439+0000","last_undegraded":"2023-05-24T04:00:02.326439+0000","last_fullsized":"2023-05-24T04:00:02.326439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:21.584742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326937+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:02.326937+0000","last_peered":"2023-05-24T04:00:02.326937+0000","last_clean":"2023-05-24T04:00:02.326937+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:02.326937+0000","last_undegraded":"2023-05-24T04:00:02.326937+0000","last_fullsized":"2023-05-24T04:00:02.326937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:49.486454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282960+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:03.282960+0000","last_peered":"2023-05-24T04:00:03.282960+0000","last_clean":"2023-05-24T04:00:03.282960+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:03.282960+0000","last_undegraded":"2023-05-24T04:00:03.282960+0000","last_fullsized":"2023-05-24T04:00:03.282960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281634+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:03.281634+0000","last_peered":"2023-05-24T04:00:03.281634+0000","last_clean":"2023-05-24T04:00:03.281634+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:03.281634+0000","last_undegraded":"2023-05-24T04:00:03.281634+0000","last_fullsized":"2023-05-24T04:00:03.281634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:43:57.624762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282747+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:03.282747+0000","last_peered":"2023-05-24T04:00:03.282747+0000","last_clean":"2023-05-24T04:00:03.282747+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:03.282747+0000","last_undegraded":"2023-05-24T04:00:03.282747+0000","last_fullsized":"2023-05-24T04:00:03.282747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:43.884737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285575+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:03.285575+0000","last_peered":"2023-05-24T04:00:03.285575+0000","last_clean":"2023-05-24T04:00:03.285575+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:03.285575+0000","last_undegraded":"2023-05-24T04:00:03.285575+0000","last_fullsized":"2023-05-24T04:00:03.285575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333304+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:02.333304+0000","last_peered":"2023-05-24T04:00:02.333304+0000","last_clean":"2023-05-24T04:00:02.333304+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:02.333304+0000","last_undegraded":"2023-05-24T04:00:02.333304+0000","last_fullsized":"2023-05-24T04:00:02.333304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:28:34.017147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362742+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:02.362742+0000","last_peered":"2023-05-24T04:00:02.362742+0000","last_clean":"2023-05-24T04:00:02.362742+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:02.362742+0000","last_undegraded":"2023-05-24T04:00:02.362742+0000","last_fullsized":"2023-05-24T04:00:02.362742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:16.845219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284681+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:03.284681+0000","last_peered":"2023-05-24T04:00:03.284681+0000","last_clean":"2023-05-24T04:00:03.284681+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:03.284681+0000","last_undegraded":"2023-05-24T04:00:03.284681+0000","last_fullsized":"2023-05-24T04:00:03.284681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:24.858148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283099+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:03.283099+0000","last_peered":"2023-05-24T04:00:03.283099+0000","last_clean":"2023-05-24T04:00:03.283099+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:03.283099+0000","last_undegraded":"2023-05-24T04:00:03.283099+0000","last_fullsized":"2023-05-24T04:00:03.283099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.224030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283187+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:03.283187+0000","last_peered":"2023-05-24T04:00:03.283187+0000","last_clean":"2023-05-24T04:00:03.283187+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:03.283187+0000","last_undegraded":"2023-05-24T04:00:03.283187+0000","last_fullsized":"2023-05-24T04:00:03.283187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:31.149121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674192+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:02.674192+0000","last_peered":"2023-05-24T04:00:02.674192+0000","last_clean":"2023-05-24T04:00:02.674192+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:02.674192+0000","last_undegraded":"2023-05-24T04:00:02.674192+0000","last_fullsized":"2023-05-24T04:00:02.674192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362180+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:02.362180+0000","last_peered":"2023-05-24T04:00:02.362180+0000","last_clean":"2023-05-24T04:00:02.362180+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:02.362180+0000","last_undegraded":"2023-05-24T04:00:02.362180+0000","last_fullsized":"2023-05-24T04:00:02.362180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:50.182886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331311+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:02.331311+0000","last_peered":"2023-05-24T04:00:02.331311+0000","last_clean":"2023-05-24T04:00:02.331311+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:02.331311+0000","last_undegraded":"2023-05-24T04:00:02.331311+0000","last_fullsized":"2023-05-24T04:00:02.331311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:23.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331513+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:02.331513+0000","last_peered":"2023-05-24T04:00:02.331513+0000","last_clean":"2023-05-24T04:00:02.331513+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:02.331513+0000","last_undegraded":"2023-05-24T04:00:02.331513+0000","last_fullsized":"2023-05-24T04:00:02.331513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330561+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:02.330561+0000","last_peered":"2023-05-24T04:00:02.330561+0000","last_clean":"2023-05-24T04:00:02.330561+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:02.330561+0000","last_undegraded":"2023-05-24T04:00:02.330561+0000","last_fullsized":"2023-05-24T04:00:02.330561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:31.974554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285241+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:03.285241+0000","last_peered":"2023-05-24T04:00:03.285241+0000","last_clean":"2023-05-24T04:00:03.285241+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:03.285241+0000","last_undegraded":"2023-05-24T04:00:03.285241+0000","last_fullsized":"2023-05-24T04:00:03.285241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:17.075712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330946+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:02.330946+0000","last_peered":"2023-05-24T04:00:02.330946+0000","last_clean":"2023-05-24T04:00:02.330946+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:02.330946+0000","last_undegraded":"2023-05-24T04:00:02.330946+0000","last_fullsized":"2023-05-24T04:00:02.330946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332083+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:02.332083+0000","last_peered":"2023-05-24T04:00:02.332083+0000","last_clean":"2023-05-24T04:00:02.332083+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:02.332083+0000","last_undegraded":"2023-05-24T04:00:02.332083+0000","last_fullsized":"2023-05-24T04:00:02.332083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:07:42.657478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.672804+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:02.672804+0000","last_peered":"2023-05-24T04:00:02.672804+0000","last_clean":"2023-05-24T04:00:02.672804+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:02.672804+0000","last_undegraded":"2023-05-24T04:00:02.672804+0000","last_fullsized":"2023-05-24T04:00:02.672804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:29.691457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.332202+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:02.332202+0000","last_peered":"2023-05-24T04:00:02.332202+0000","last_clean":"2023-05-24T04:00:02.332202+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:02.332202+0000","last_undegraded":"2023-05-24T04:00:02.332202+0000","last_fullsized":"2023-05-24T04:00:02.332202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:53.899808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362667+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:02.362667+0000","last_peered":"2023-05-24T04:00:02.362667+0000","last_clean":"2023-05-24T04:00:02.362667+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:02.362667+0000","last_undegraded":"2023-05-24T04:00:02.362667+0000","last_fullsized":"2023-05-24T04:00:02.362667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326499+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:02.326499+0000","last_peered":"2023-05-24T04:00:02.326499+0000","last_clean":"2023-05-24T04:00:02.326499+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:02.326499+0000","last_undegraded":"2023-05-24T04:00:02.326499+0000","last_fullsized":"2023-05-24T04:00:02.326499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:58.397535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282498+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:03.282498+0000","last_peered":"2023-05-24T04:00:03.282498+0000","last_clean":"2023-05-24T04:00:03.282498+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:03.282498+0000","last_undegraded":"2023-05-24T04:00:03.282498+0000","last_fullsized":"2023-05-24T04:00:03.282498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283868+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:03.283868+0000","last_peered":"2023-05-24T04:00:03.283868+0000","last_clean":"2023-05-24T04:00:03.283868+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:03.283868+0000","last_undegraded":"2023-05-24T04:00:03.283868+0000","last_fullsized":"2023-05-24T04:00:03.283868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:40:47.927025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326480+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:02.326480+0000","last_peered":"2023-05-24T04:00:02.326480+0000","last_clean":"2023-05-24T04:00:02.326480+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:02.326480+0000","last_undegraded":"2023-05-24T04:00:02.326480+0000","last_fullsized":"2023-05-24T04:00:02.326480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:28:04.663781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331449+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:02.331449+0000","last_peered":"2023-05-24T04:00:02.331449+0000","last_clean":"2023-05-24T04:00:02.331449+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:02.331449+0000","last_undegraded":"2023-05-24T04:00:02.331449+0000","last_fullsized":"2023-05-24T04:00:02.331449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:51:07.300738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285444+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:03.285444+0000","last_peered":"2023-05-24T04:00:03.285444+0000","last_clean":"2023-05-24T04:00:03.285444+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:03.285444+0000","last_undegraded":"2023-05-24T04:00:03.285444+0000","last_fullsized":"2023-05-24T04:00:03.285444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:28.367648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326235+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:02.326235+0000","last_peered":"2023-05-24T04:00:02.326235+0000","last_clean":"2023-05-24T04:00:02.326235+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:02.326235+0000","last_undegraded":"2023-05-24T04:00:02.326235+0000","last_fullsized":"2023-05-24T04:00:02.326235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:37.831392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329749+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:02.329749+0000","last_peered":"2023-05-24T04:00:02.329749+0000","last_clean":"2023-05-24T04:00:02.329749+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:02.329749+0000","last_undegraded":"2023-05-24T04:00:02.329749+0000","last_fullsized":"2023-05-24T04:00:02.329749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:46.939599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285009+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:03.285009+0000","last_peered":"2023-05-24T04:00:03.285009+0000","last_clean":"2023-05-24T04:00:03.285009+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:03.285009+0000","last_undegraded":"2023-05-24T04:00:03.285009+0000","last_fullsized":"2023-05-24T04:00:03.285009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:34.837578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326958+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:02.326958+0000","last_peered":"2023-05-24T04:00:02.326958+0000","last_clean":"2023-05-24T04:00:02.326958+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:02.326958+0000","last_undegraded":"2023-05-24T04:00:02.326958+0000","last_fullsized":"2023-05-24T04:00:02.326958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:18:48.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282592+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:03.282592+0000","last_peered":"2023-05-24T04:00:03.282592+0000","last_clean":"2023-05-24T04:00:03.282592+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:03.282592+0000","last_undegraded":"2023-05-24T04:00:03.282592+0000","last_fullsized":"2023-05-24T04:00:03.282592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:00:24.952669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.285821+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:03.285821+0000","last_peered":"2023-05-24T04:00:03.285821+0000","last_clean":"2023-05-24T04:00:03.285821+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:03.285821+0000","last_undegraded":"2023-05-24T04:00:03.285821+0000","last_fullsized":"2023-05-24T04:00:03.285821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:20.609741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283124+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:03.283124+0000","last_peered":"2023-05-24T04:00:03.283124+0000","last_clean":"2023-05-24T04:00:03.283124+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:03.283124+0000","last_undegraded":"2023-05-24T04:00:03.283124+0000","last_fullsized":"2023-05-24T04:00:03.283124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283719+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:03.283719+0000","last_peered":"2023-05-24T04:00:03.283719+0000","last_clean":"2023-05-24T04:00:03.283719+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:03.283719+0000","last_undegraded":"2023-05-24T04:00:03.283719+0000","last_fullsized":"2023-05-24T04:00:03.283719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:43.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329762+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:02.329762+0000","last_peered":"2023-05-24T04:00:02.329762+0000","last_clean":"2023-05-24T04:00:02.329762+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:02.329762+0000","last_undegraded":"2023-05-24T04:00:02.329762+0000","last_fullsized":"2023-05-24T04:00:02.329762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:56:59.373218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363323+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:02.363323+0000","last_peered":"2023-05-24T04:00:02.363323+0000","last_clean":"2023-05-24T04:00:02.363323+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:02.363323+0000","last_undegraded":"2023-05-24T04:00:02.363323+0000","last_fullsized":"2023-05-24T04:00:02.363323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:33:13.664663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363303+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:02.363303+0000","last_peered":"2023-05-24T04:00:02.363303+0000","last_clean":"2023-05-24T04:00:02.363303+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:02.363303+0000","last_undegraded":"2023-05-24T04:00:02.363303+0000","last_fullsized":"2023-05-24T04:00:02.363303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283798+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:03.283798+0000","last_peered":"2023-05-24T04:00:03.283798+0000","last_clean":"2023-05-24T04:00:03.283798+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:03.283798+0000","last_undegraded":"2023-05-24T04:00:03.283798+0000","last_fullsized":"2023-05-24T04:00:03.283798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:30.570464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283107+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:03.283107+0000","last_peered":"2023-05-24T04:00:03.283107+0000","last_clean":"2023-05-24T04:00:03.283107+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:03.283107+0000","last_undegraded":"2023-05-24T04:00:03.283107+0000","last_fullsized":"2023-05-24T04:00:03.283107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.281988+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:03.281988+0000","last_peered":"2023-05-24T04:00:03.281988+0000","last_clean":"2023-05-24T04:00:03.281988+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:03.281988+0000","last_undegraded":"2023-05-24T04:00:03.281988+0000","last_fullsized":"2023-05-24T04:00:03.281988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:12.761189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284815+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:03.284815+0000","last_peered":"2023-05-24T04:00:03.284815+0000","last_clean":"2023-05-24T04:00:03.284815+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:03.284815+0000","last_undegraded":"2023-05-24T04:00:03.284815+0000","last_fullsized":"2023-05-24T04:00:03.284815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:46:31.585428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362908+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:02.362908+0000","last_peered":"2023-05-24T04:00:02.362908+0000","last_clean":"2023-05-24T04:00:02.362908+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:02.362908+0000","last_undegraded":"2023-05-24T04:00:02.362908+0000","last_fullsized":"2023-05-24T04:00:02.362908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:39.263590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283473+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:03.283473+0000","last_peered":"2023-05-24T04:00:03.283473+0000","last_clean":"2023-05-24T04:00:03.283473+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:03.283473+0000","last_undegraded":"2023-05-24T04:00:03.283473+0000","last_fullsized":"2023-05-24T04:00:03.283473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:48.939524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.363256+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:02.363256+0000","last_peered":"2023-05-24T04:00:02.363256+0000","last_clean":"2023-05-24T04:00:02.363256+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:02.363256+0000","last_undegraded":"2023-05-24T04:00:02.363256+0000","last_fullsized":"2023-05-24T04:00:02.363256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:02:29.382612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283979+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:03.283979+0000","last_peered":"2023-05-24T04:00:03.283979+0000","last_clean":"2023-05-24T04:00:03.283979+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:03.283979+0000","last_undegraded":"2023-05-24T04:00:03.283979+0000","last_fullsized":"2023-05-24T04:00:03.283979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:24.724676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329457+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:02.329457+0000","last_peered":"2023-05-24T04:00:02.329457+0000","last_clean":"2023-05-24T04:00:02.329457+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:02.329457+0000","last_undegraded":"2023-05-24T04:00:02.329457+0000","last_fullsized":"2023-05-24T04:00:02.329457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:06:39.129747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362046+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:02.362046+0000","last_peered":"2023-05-24T04:00:02.362046+0000","last_clean":"2023-05-24T04:00:02.362046+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:02.362046+0000","last_undegraded":"2023-05-24T04:00:02.362046+0000","last_fullsized":"2023-05-24T04:00:02.362046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:21.313628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330454+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:02.330454+0000","last_peered":"2023-05-24T04:00:02.330454+0000","last_clean":"2023-05-24T04:00:02.330454+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:02.330454+0000","last_undegraded":"2023-05-24T04:00:02.330454+0000","last_fullsized":"2023-05-24T04:00:02.330454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:26.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.362536+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:02.362536+0000","last_peered":"2023-05-24T04:00:02.362536+0000","last_clean":"2023-05-24T04:00:02.362536+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:02.362536+0000","last_undegraded":"2023-05-24T04:00:02.362536+0000","last_fullsized":"2023-05-24T04:00:02.362536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673473+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:02.673473+0000","last_peered":"2023-05-24T04:00:02.673473+0000","last_clean":"2023-05-24T04:00:02.673473+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:02.673473+0000","last_undegraded":"2023-05-24T04:00:02.673473+0000","last_fullsized":"2023-05-24T04:00:02.673473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:18:13.776152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284495+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:03.284495+0000","last_peered":"2023-05-24T04:00:03.284495+0000","last_clean":"2023-05-24T04:00:03.284495+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:03.284495+0000","last_undegraded":"2023-05-24T04:00:03.284495+0000","last_fullsized":"2023-05-24T04:00:03.284495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.673918+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:02.673918+0000","last_peered":"2023-05-24T04:00:02.673918+0000","last_clean":"2023-05-24T04:00:02.673918+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:02.673918+0000","last_undegraded":"2023-05-24T04:00:02.673918+0000","last_fullsized":"2023-05-24T04:00:02.673918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:27.171763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.674024+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:02.674024+0000","last_peered":"2023-05-24T04:00:02.674024+0000","last_clean":"2023-05-24T04:00:02.674024+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:02.674024+0000","last_undegraded":"2023-05-24T04:00:02.674024+0000","last_fullsized":"2023-05-24T04:00:02.674024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282709+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:03.282709+0000","last_peered":"2023-05-24T04:00:03.282709+0000","last_clean":"2023-05-24T04:00:03.282709+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:03.282709+0000","last_undegraded":"2023-05-24T04:00:03.282709+0000","last_fullsized":"2023-05-24T04:00:03.282709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.361920+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:02.361920+0000","last_peered":"2023-05-24T04:00:02.361920+0000","last_clean":"2023-05-24T04:00:02.361920+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:02.361920+0000","last_undegraded":"2023-05-24T04:00:02.361920+0000","last_fullsized":"2023-05-24T04:00:02.361920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:39.997185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282020+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:03.282020+0000","last_peered":"2023-05-24T04:00:03.282020+0000","last_clean":"2023-05-24T04:00:03.282020+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:03.282020+0000","last_undegraded":"2023-05-24T04:00:03.282020+0000","last_fullsized":"2023-05-24T04:00:03.282020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:16:12.612403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283275+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:03.283275+0000","last_peered":"2023-05-24T04:00:03.283275+0000","last_clean":"2023-05-24T04:00:03.283275+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:03.283275+0000","last_undegraded":"2023-05-24T04:00:03.283275+0000","last_fullsized":"2023-05-24T04:00:03.283275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331904+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:02.331904+0000","last_peered":"2023-05-24T04:00:02.331904+0000","last_clean":"2023-05-24T04:00:02.331904+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:02.331904+0000","last_undegraded":"2023-05-24T04:00:02.331904+0000","last_fullsized":"2023-05-24T04:00:02.331904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:26:07.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326634+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:02.326634+0000","last_peered":"2023-05-24T04:00:02.326634+0000","last_clean":"2023-05-24T04:00:02.326634+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:02.326634+0000","last_undegraded":"2023-05-24T04:00:02.326634+0000","last_fullsized":"2023-05-24T04:00:02.326634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:23:41.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.331187+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:02.331187+0000","last_peered":"2023-05-24T04:00:02.331187+0000","last_clean":"2023-05-24T04:00:02.331187+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:02.331187+0000","last_undegraded":"2023-05-24T04:00:02.331187+0000","last_fullsized":"2023-05-24T04:00:02.331187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:20.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283457+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:03.283457+0000","last_peered":"2023-05-24T04:00:03.283457+0000","last_clean":"2023-05-24T04:00:03.283457+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:03.283457+0000","last_undegraded":"2023-05-24T04:00:03.283457+0000","last_fullsized":"2023-05-24T04:00:03.283457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:41:49.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.328836+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:02.328836+0000","last_peered":"2023-05-24T04:00:02.328836+0000","last_clean":"2023-05-24T04:00:02.328836+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:02.328836+0000","last_undegraded":"2023-05-24T04:00:02.328836+0000","last_fullsized":"2023-05-24T04:00:02.328836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:22.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283484+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:03.283484+0000","last_peered":"2023-05-24T04:00:03.283484+0000","last_clean":"2023-05-24T04:00:03.283484+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:03.283484+0000","last_undegraded":"2023-05-24T04:00:03.283484+0000","last_fullsized":"2023-05-24T04:00:03.283484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:29.915399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283949+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:03.283949+0000","last_peered":"2023-05-24T04:00:03.283949+0000","last_clean":"2023-05-24T04:00:03.283949+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:03.283949+0000","last_undegraded":"2023-05-24T04:00:03.283949+0000","last_fullsized":"2023-05-24T04:00:03.283949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:21.983466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326231+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:02.326231+0000","last_peered":"2023-05-24T04:00:02.326231+0000","last_clean":"2023-05-24T04:00:02.326231+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:02.326231+0000","last_undegraded":"2023-05-24T04:00:02.326231+0000","last_fullsized":"2023-05-24T04:00:02.326231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:08:53.915635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326785+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:02.326785+0000","last_peered":"2023-05-24T04:00:02.326785+0000","last_clean":"2023-05-24T04:00:02.326785+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:02.326785+0000","last_undegraded":"2023-05-24T04:00:02.326785+0000","last_fullsized":"2023-05-24T04:00:02.326785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:35:05.345944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330585+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:02.330585+0000","last_peered":"2023-05-24T04:00:02.330585+0000","last_clean":"2023-05-24T04:00:02.330585+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:02.330585+0000","last_undegraded":"2023-05-24T04:00:02.330585+0000","last_fullsized":"2023-05-24T04:00:02.330585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284900+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:03.284900+0000","last_peered":"2023-05-24T04:00:03.284900+0000","last_clean":"2023-05-24T04:00:03.284900+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:03.284900+0000","last_undegraded":"2023-05-24T04:00:03.284900+0000","last_fullsized":"2023-05-24T04:00:03.284900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:10:17.860183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283198+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:03.283198+0000","last_peered":"2023-05-24T04:00:03.283198+0000","last_clean":"2023-05-24T04:00:03.283198+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:03.283198+0000","last_undegraded":"2023-05-24T04:00:03.283198+0000","last_fullsized":"2023-05-24T04:00:03.283198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.282366+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:03.282366+0000","last_peered":"2023-05-24T04:00:03.282366+0000","last_clean":"2023-05-24T04:00:03.282366+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:03.282366+0000","last_undegraded":"2023-05-24T04:00:03.282366+0000","last_fullsized":"2023-05-24T04:00:03.282366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:34:06.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283141+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:03.283141+0000","last_peered":"2023-05-24T04:00:03.283141+0000","last_clean":"2023-05-24T04:00:03.283141+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:03.283141+0000","last_undegraded":"2023-05-24T04:00:03.283141+0000","last_fullsized":"2023-05-24T04:00:03.283141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:51.197849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.329420+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:02.329420+0000","last_peered":"2023-05-24T04:00:02.329420+0000","last_clean":"2023-05-24T04:00:02.329420+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:02.329420+0000","last_undegraded":"2023-05-24T04:00:02.329420+0000","last_fullsized":"2023-05-24T04:00:02.329420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.283341+0000","last_change":"2023-05-24T03:59:57.913975+0000","last_active":"2023-05-24T04:00:03.283341+0000","last_peered":"2023-05-24T04:00:03.283341+0000","last_clean":"2023-05-24T04:00:03.283341+0000","last_became_active":"2023-05-24T03:59:57.913528+0000","last_became_peered":"2023-05-24T03:59:57.913528+0000","last_unstale":"2023-05-24T04:00:03.283341+0000","last_undegraded":"2023-05-24T04:00:03.283341+0000","last_fullsized":"2023-05-24T04:00:03.283341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:12:37.985814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.333140+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:02.333140+0000","last_peered":"2023-05-24T04:00:02.333140+0000","last_clean":"2023-05-24T04:00:02.333140+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:02.333140+0000","last_undegraded":"2023-05-24T04:00:02.333140+0000","last_fullsized":"2023-05-24T04:00:02.333140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:29.390853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.330279+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:02.330279+0000","last_peered":"2023-05-24T04:00:02.330279+0000","last_clean":"2023-05-24T04:00:02.330279+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:02.330279+0000","last_undegraded":"2023-05-24T04:00:02.330279+0000","last_fullsized":"2023-05-24T04:00:02.330279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:03.284322+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:03.284322+0000","last_peered":"2023-05-24T04:00:03.284322+0000","last_clean":"2023-05-24T04:00:03.284322+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:03.284322+0000","last_undegraded":"2023-05-24T04:00:03.284322+0000","last_fullsized":"2023-05-24T04:00:03.284322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:36:27.738073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-24T04:00:02.326738+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:02.326738+0000","last_peered":"2023-05-24T04:00:02.326738+0000","last_clean":"2023-05-24T04:00:02.326738+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:02.326738+0000","last_undegraded":"2023-05-24T04:00:02.326738+0000","last_fullsized":"2023-05-24T04:00:02.326738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:18:29.367916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":714326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18220,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353620,"statfs":{"total":96636764160,"available":96618106880,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":123798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18216,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353624,"statfs":{"total":96636764160,"available":96618110976,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18212,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353628,"statfs":{"total":96636764160,"available":96618115072,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18796,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353044,"statfs":{"total":96636764160,"available":96617517056,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:00:23.758 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-24T04:00:23.759 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-24T04:00:23.759 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-24T04:00:23.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-24T04:00:23.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 Processor -- start 2023-05-24T04:00:23.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 -- start start 2023-05-24T04:00:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48c00be680 0x7f48c00bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48c0146580 0x7f48c00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c014c2e0 con 0x7f48c0071810 2023-05-24T04:00:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c00bdc80 con 0x7f48c0146580 2023-05-24T04:00:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48c61f9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c00bc070 con 0x7f48c00be680 2023-05-24T04:00:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48beffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48c0146580 0x7f48c00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48bffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f48c0071810 0x7f48c0069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45128/0 (socket says 172.21.15.40:45128) 2023-05-24T04:00:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48bffff640 1 -- 172.21.15.40:0/1363664627 learned_addr learned my addr 172.21.15.40:0/1363664627 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48bf7fe640 1 --2- 172.21.15.40:0/1363664627 >> v2:172.21.15.67:3300/0 conn(0x7f48c00be680 0x7f48c00bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48beffd640 1 -- 172.21.15.40:0/1363664627 >> v2:172.21.15.67:3300/0 conn(0x7f48c00be680 msgr2=0x7f48c00bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48beffd640 1 --2- 172.21.15.40:0/1363664627 >> v2:172.21.15.67:3300/0 conn(0x7f48c00be680 0x7f48c00bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48beffd640 1 -- 172.21.15.40:0/1363664627 >> v1:172.21.15.40:6789/0 conn(0x7f48c0071810 legacy=0x7f48c0069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48be7fc640 1 -- 172.21.15.40:0/1363664627 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990540964 0 0) 0x7f48b80014a0 con 0x7f48c0071810 2023-05-24T04:00:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.906+0000 7f48beffd640 1 -- 172.21.15.40:0/1363664627 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c014d540 con 0x7f48c0146580 2023-05-24T04:00:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48beffd640 1 --2- 172.21.15.40:0/1363664627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0146580 0x7f48c00699e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48c00bf060 tx=0x7f48b401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491768ce9b6748c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48be7fc640 1 -- 172.21.15.40:0/1363664627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40ab600 con 0x7f48c0146580 2023-05-24T04:00:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48be7fc640 1 -- 172.21.15.40:0/1363664627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b40a7050 con 0x7f48c0146580 2023-05-24T04:00:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48be7fc640 1 -- 172.21.15.40:0/1363664627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40ab980 con 0x7f48c0146580 2023-05-24T04:00:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 -- 172.21.15.40:0/1363664627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0146580 msgr2=0x7f48c00699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 --2- 172.21.15.40:0/1363664627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0146580 0x7f48c00699e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48c00bf060 tx=0x7f48b401c3a0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 -- 172.21.15.40:0/1363664627 shutdown_connections 2023-05-24T04:00:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 --2- 172.21.15.40:0/1363664627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0146580 0x7f48c00699e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 --2- 172.21.15.40:0/1363664627 >> v2:172.21.15.67:3300/0 conn(0x7f48c00be680 0x7f48c00bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 -- 172.21.15.40:0/1363664627 >> 172.21.15.40:0/1363664627 conn(0x7f48c006aef0 msgr2=0x7f48c006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 -- 172.21.15.40:0/1363664627 shutdown_connections 2023-05-24T04:00:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 -- 172.21.15.40:0/1363664627 wait complete. 2023-05-24T04:00:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 Processor -- start 2023-05-24T04:00:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.910+0000 7f48c61f9640 1 -- start start 2023-05-24T04:00:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48c0071810 0x7f48c01e8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 0x7f48c014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48c01e8590 0x7f48c014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0145bb0 con 0x7f48c00be680 2023-05-24T04:00:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0145720 con 0x7f48c0071810 2023-05-24T04:00:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0142e50 con 0x7f48c01e8590 2023-05-24T04:00:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 0x7f48c014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 0x7f48c014e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47878/0 (socket says 172.21.15.40:47878) 2023-05-24T04:00:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 -- 172.21.15.40:0/2731234765 learned_addr learned my addr 172.21.15.40:0/2731234765 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48bf7fe640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48c0071810 0x7f48c01e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 -- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48c01e8590 msgr2=0x7f48c014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48c01e8590 0x7f48c014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 -- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48c0071810 msgr2=0x7f48c01e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48c0071810 0x7f48c01e8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 -- 172.21.15.40:0/2731234765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009420 con 0x7f48c00be680 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48beffd640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 0x7f48c014e230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48b40ae040 tx=0x7f48b4019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40b4840 con 0x7f48c00be680 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b40b49c0 con 0x7f48c00be680 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40b4d70 con 0x7f48c00be680 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c00bb9b0 con 0x7f48c00be680 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c00bb820 con 0x7f48c00be680 2023-05-24T04:00:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c01594d0 con 0x7f48c00be680 2023-05-24T04:00:23.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48b40b2040 con 0x7f48c00be680 2023-05-24T04:00:23.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48a7fff640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f48ac066280 0x7f48ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:23.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48b411e310 con 0x7f48c00be680 2023-05-24T04:00:23.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48bf7fe640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f48ac066280 0x7f48ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:23.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.914+0000 7f48bf7fe640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f48ac066280 0x7f48ac068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009790 tx=0x7f48b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:23.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:23.918+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48b40eb490 con 0x7f48c00be680 2023-05-24T04:00:24.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f48c00674e0 con 0x7f48c00be680 2023-05-24T04:00:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48a7fff640 1 -- 172.21.15.40:0/2731234765 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f48b40eeab0 con 0x7f48c00be680 2023-05-24T04:00:24.103 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:24.103 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-24T04:00:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f48ac066280 msgr2=0x7f48ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f48ac066280 0x7f48ac068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009790 tx=0x7f48b0008040 comp rx=0 tx=0).stop 2023-05-24T04:00:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 msgr2=0x7f48c014e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 0x7f48c014e230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48b40ae040 tx=0x7f48b4019140 comp rx=0 tx=0).stop 2023-05-24T04:00:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 shutdown_connections 2023-05-24T04:00:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f48ac066280 0x7f48ac068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48c01e8590 0x7f48c014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00be680 0x7f48c014e230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 --2- 172.21.15.40:0/2731234765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48c0071810 0x7f48c01e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 >> 172.21.15.40:0/2731234765 conn(0x7f48c006aef0 msgr2=0x7f48c00bfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:24.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 shutdown_connections 2023-05-24T04:00:24.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.098+0000 7f48c61f9640 1 -- 172.21.15.40:0/2731234765 wait complete. 2023-05-24T04:00:24.120 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-24T04:00:24.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:24.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 Processor -- start 2023-05-24T04:00:24.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 -- start start 2023-05-24T04:00:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73e814aa30 0x7f73e8071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e80a3290 0x7f73e8071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e814b240 con 0x7f73e814bfe0 2023-05-24T04:00:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e806e810 con 0x7f73e814aa30 2023-05-24T04:00:24.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73ecfd6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806ea20 con 0x7f73e80a3290 2023-05-24T04:00:24.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73e814aa30 0x7f73e8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e5d9b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e80a3290 0x7f73e8071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e6d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f73e814bfe0 0x7f73e806ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:52860/0 (socket says 172.21.15.40:52860) 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e6d9d640 1 -- 172.21.15.40:0/3306776590 learned_addr learned my addr 172.21.15.40:0/3306776590 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e559a640 1 -- 172.21.15.40:0/3306776590 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416974295 0 0) 0x7f73e814b240 con 0x7f73e814bfe0 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e559a640 1 -- 172.21.15.40:0/3306776590 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d0003530 con 0x7f73e814bfe0 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e659c640 1 -- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e80a3290 msgr2=0x7f73e8071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e659c640 1 --2- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e80a3290 0x7f73e8071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e659c640 1 -- 172.21.15.40:0/3306776590 >> v1:172.21.15.67:6789/0 conn(0x7f73e814bfe0 legacy=0x7f73e806ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e659c640 1 -- 172.21.15.40:0/3306776590 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e806bfa0 con 0x7f73e814aa30 2023-05-24T04:00:24.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.234+0000 7f73e5d9b640 1 --2- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e80a3290 0x7f73e8071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:24.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e659c640 1 --2- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e8071100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0097c0 tx=0x7f73dc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e764e9bf86eca0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e559a640 1 -- 172.21.15.40:0/3306776590 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0ad640 con 0x7f73e814aa30 2023-05-24T04:00:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e559a640 1 -- 172.21.15.40:0/3306776590 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc0ad7a0 con 0x7f73e814aa30 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e559a640 1 -- 172.21.15.40:0/3306776590 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0adb10 con 0x7f73e814aa30 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 msgr2=0x7f73e8071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e8071100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0097c0 tx=0x7f73dc01c480 comp rx=0 tx=0).stop 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- 172.21.15.40:0/3306776590 shutdown_connections 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e80a3290 0x7f73e8071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/3306776590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e8071100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- 172.21.15.40:0/3306776590 >> 172.21.15.40:0/3306776590 conn(0x7f73e80c0280 msgr2=0x7f73e80c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- 172.21.15.40:0/3306776590 shutdown_connections 2023-05-24T04:00:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- 172.21.15.40:0/3306776590 wait complete. 2023-05-24T04:00:24.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 Processor -- start 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- start start 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e81e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e814bfe0 0x7f73e8145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 0x7f73e814c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81e6920 con 0x7f73e8146120 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8146640 con 0x7f73e814aa30 2023-05-24T04:00:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73ecfd6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81e6540 con 0x7f73e814bfe0 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 0x7f73e814c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 0x7f73e814c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47882/0 (socket says 172.21.15.40:47882) 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 -- 172.21.15.40:0/1485032198 learned_addr learned my addr 172.21.15.40:0/1485032198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e5d9b640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e814bfe0 0x7f73e8145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e659c640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e81e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 -- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e814bfe0 msgr2=0x7f73e8145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e814bfe0 0x7f73e8145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 -- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 msgr2=0x7f73e81e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e81e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 -- 172.21.15.40:0/1485032198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009420 con 0x7f73e8146120 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.238+0000 7f73e6d9d640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 0x7f73e814c540 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f73e000ca70 tx=0x7f73e000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000ab70 con 0x7f73e8146120 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000acd0 con 0x7f73e8146120 2023-05-24T04:00:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc009420 con 0x7f73e8146120 2023-05-24T04:00:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0012600 con 0x7f73e8146120 2023-05-24T04:00:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e814af90 con 0x7f73e8146120 2023-05-24T04:00:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e814ae00 con 0x7f73e8146120 2023-05-24T04:00:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73e0007070 con 0x7f73e8146120 2023-05-24T04:00:24.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73d6ffd640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f73c8066280 0x7f73c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73e659c640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f73c8066280 0x7f73c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f73e00846c0 con 0x7f73e8146120 2023-05-24T04:00:24.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.242+0000 7f73e659c640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f73c8066280 0x7f73c8068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0af000 tx=0x7f73dc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.246+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f73e00518e0 con 0x7f73e8146120 2023-05-24T04:00:24.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.398+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e804ddd0 con 0x7f73e8146120 2023-05-24T04:00:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.398+0000 7f73d6ffd640 1 -- 172.21.15.40:0/1485032198 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f73e0054f00 con 0x7f73e8146120 2023-05-24T04:00:24.405 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:24.405 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f73c8066280 msgr2=0x7f73c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f73c8066280 0x7f73c8068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0af000 tx=0x7f73dc0a7070 comp rx=0 tx=0).stop 2023-05-24T04:00:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 msgr2=0x7f73e814c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 0x7f73e814c540 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f73e000ca70 tx=0x7f73e000cf30 comp rx=0 tx=0).stop 2023-05-24T04:00:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 shutdown_connections 2023-05-24T04:00:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f73c8066280 0x7f73c8068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8146120 0x7f73e814c540 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e814bfe0 0x7f73e8145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 --2- 172.21.15.40:0/1485032198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e814aa30 0x7f73e81e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 >> 172.21.15.40:0/1485032198 conn(0x7f73e80c0280 msgr2=0x7f73e8147b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 shutdown_connections 2023-05-24T04:00:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.402+0000 7f73ecfd6640 1 -- 172.21.15.40:0/1485032198 wait complete. 2023-05-24T04:00:24.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:24.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:24.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd3bb8640 1 Processor -- start 2023-05-24T04:00:24.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd3bb8640 1 -- start start 2023-05-24T04:00:24.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd3bb8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7fcc0a4d10 0x7f7fcc0bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd3bb8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc148760 con 0x7f7fcc0bdb60 2023-05-24T04:00:24.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd3bb8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc06eac0 con 0x7f7fcc148390 2023-05-24T04:00:24.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd3bb8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0702d0 con 0x7f7fcc0a4d10 2023-05-24T04:00:24.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd2155640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7fcc0bdb60 0x7f7fcc155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45144/0 (socket says 172.21.15.40:45144) 2023-05-24T04:00:24.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.546+0000 7f7fd2155640 1 -- 172.21.15.40:0/508088934 learned_addr learned my addr 172.21.15.40:0/508088934 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649765242 0 0) 0x7f7fcc148760 con 0x7f7fcc0bdb60 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 --2- 172.21.15.40:0/508088934 >> v2:172.21.15.67:3300/0 conn(0x7f7fcc0a4d10 0x7f7fcc0bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb8003450 con 0x7f7fcc0bdb60 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404012609 0 0) 0x7f7fb8003450 con 0x7f7fcc0bdb60 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 >> v2:172.21.15.67:3300/0 conn(0x7f7fcc0a4d10 msgr2=0x7f7fcc0bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 --2- 172.21.15.40:0/508088934 >> v2:172.21.15.67:3300/0 conn(0x7f7fcc0a4d10 0x7f7fcc0bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 >> v1:172.21.15.67:6789/0 conn(0x7f7fcc148390 legacy=0x7f7fcc071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0a5150 con 0x7f7fcc0bdb60 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f7fc4001a00 con 0x7f7fcc0bdb60 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 >> v1:172.21.15.40:6789/0 conn(0x7f7fcc0bdb60 legacy=0x7f7fcc155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fb8003a70 0x7f7fb8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fb800ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fb800b530 0x7f7fb800d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0702d0 con 0x7f7fb80088b0 2023-05-24T04:00:24.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb800e2c0 con 0x7f7fb8003a70 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb800e480 con 0x7f7fb800b530 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fb800ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1954640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fb8003a70 0x7f7fb8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd2155640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fb800b530 0x7f7fb800d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 -- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fb800b530 msgr2=0x7f7fb800d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fb800b530 0x7f7fb800d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 -- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fb8003a70 msgr2=0x7f7fb8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:24.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fb8003a70 0x7f7fb8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 -- 172.21.15.40:0/508088934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8003450 con 0x7f7fb80088b0 2023-05-24T04:00:24.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd2155640 1 -- 172.21.15.40:0/508088934 reap_dead start 2023-05-24T04:00:24.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1954640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fb8003a70 0x7f7fb8003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:24.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd1153640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fb800ad30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00ba00 tx=0x7f7fbc01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695bace4ddfadd83 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0ab650 con 0x7f7fb80088b0 2023-05-24T04:00:24.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0ab7b0 con 0x7f7fb80088b0 2023-05-24T04:00:24.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd0952640 1 -- 172.21.15.40:0/508088934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0abb60 con 0x7f7fb80088b0 2023-05-24T04:00:24.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/508088934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 msgr2=0x7f7fb800ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fb800ad30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00ba00 tx=0x7f7fbc01c640 comp rx=0 tx=0).stop 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/508088934 shutdown_connections 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/508088934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fb800ad30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/508088934 >> 172.21.15.40:0/508088934 conn(0x7f7fcc0c0310 msgr2=0x7f7fcc0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/508088934 shutdown_connections 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.550+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/508088934 wait complete. 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 Processor -- start 2023-05-24T04:00:24.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- start start 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fcc1e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc0bafd0 0x7f7fcc1405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fcc13f9b0 0x7f7fcc0b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc141060 con 0x7f7fb80088b0 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc13f460 con 0x7f7fcc0bafd0 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc140270 con 0x7f7fcc13f9b0 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fcc1e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fcc1e4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47892/0 (socket says 172.21.15.40:47892) 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 -- 172.21.15.40:0/1934398222 learned_addr learned my addr 172.21.15.40:0/1934398222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 -- 172.21.15.40:0/1934398222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fcc13f9b0 msgr2=0x7f7fcc0b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fcc13f9b0 0x7f7fcc0b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 -- 172.21.15.40:0/1934398222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc0bafd0 msgr2=0x7f7fcc1405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc0bafd0 0x7f7fcc1405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 -- 172.21.15.40:0/1934398222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc06f0b0 con 0x7f7fb80088b0 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd1954640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fcc1e4d50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800d4a0 tx=0x7f7fc800d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800b070 con 0x7f7fb80088b0 2023-05-24T04:00:24.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80052d0 con 0x7f7fb80088b0 2023-05-24T04:00:24.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003860 con 0x7f7fb80088b0 2023-05-24T04:00:24.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc0a48c0 con 0x7f7fb80088b0 2023-05-24T04:00:24.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc06ed10 con 0x7f7fb80088b0 2023-05-24T04:00:24.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc04ddd0 con 0x7f7fb80088b0 2023-05-24T04:00:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.554+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fc80039c0 con 0x7f7fb80088b0 2023-05-24T04:00:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.558+0000 7f7fc27fc640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7fb00662b0 0x7f7fb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.558+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fc8083590 con 0x7f7fb80088b0 2023-05-24T04:00:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.558+0000 7f7fd1153640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7fb00662b0 0x7f7fb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.558+0000 7f7fd1153640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7fb00662b0 0x7f7fb0068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0af000 tx=0x7f7fbc004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.562+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7fc8050730 con 0x7f7fb80088b0 2023-05-24T04:00:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fcc0a57a0 con 0x7f7fb80088b0 2023-05-24T04:00:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fc27fc640 1 -- 172.21.15.40:0/1934398222 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fc8053d50 con 0x7f7fb80088b0 2023-05-24T04:00:24.719 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:24.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7fb00662b0 msgr2=0x7f7fb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7fb00662b0 0x7f7fb0068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0af000 tx=0x7f7fbc004740 comp rx=0 tx=0).stop 2023-05-24T04:00:24.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 msgr2=0x7f7fcc1e4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fcc1e4d50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800d4a0 tx=0x7f7fc800d590 comp rx=0 tx=0).stop 2023-05-24T04:00:24.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 shutdown_connections 2023-05-24T04:00:24.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7fb00662b0 0x7f7fb0068760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7fcc13f9b0 0x7f7fcc0b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc0bafd0 0x7f7fcc1405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 --2- 172.21.15.40:0/1934398222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80088b0 0x7f7fcc1e4d50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 >> 172.21.15.40:0/1934398222 conn(0x7f7fcc0c0310 msgr2=0x7f7fcc145420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 shutdown_connections 2023-05-24T04:00:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.714+0000 7f7fd3bb8640 1 -- 172.21.15.40:0/1934398222 wait complete. 2023-05-24T04:00:24.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:24.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 Processor -- start 2023-05-24T04:00:24.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 -- start start 2023-05-24T04:00:24.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0600a75b0 0x7fd06006c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd06006c880 0x7fd060158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06014f800 con 0x7fd06014f430 2023-05-24T04:00:24.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06006b7b0 con 0x7fd06006c880 2023-05-24T04:00:24.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd066af7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600bf8c0 con 0x7fd0600a75b0 2023-05-24T04:00:24.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0600a75b0 0x7fd06006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd065094640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd06006c880 0x7fd060158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd064893640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd06014f430 0x7fd060070a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:52874/0 (socket says 172.21.15.40:52874) 2023-05-24T04:00:24.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd064893640 1 -- 172.21.15.40:0/2600004908 learned_addr learned my addr 172.21.15.40:0/2600004908 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:24.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd05ffff640 1 -- 172.21.15.40:0/2600004908 >> v2:172.21.15.67:3300/0 conn(0x7fd06006c880 msgr2=0x7fd060158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd05ffff640 1 --2- 172.21.15.40:0/2600004908 >> v2:172.21.15.67:3300/0 conn(0x7fd06006c880 0x7fd060158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd05ffff640 1 -- 172.21.15.40:0/2600004908 >> v1:172.21.15.67:6789/0 conn(0x7fd06014f430 legacy=0x7fd060070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd05ffff640 1 -- 172.21.15.40:0/2600004908 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600bfdf0 con 0x7fd0600a75b0 2023-05-24T04:00:24.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.858+0000 7fd065094640 1 --2- 172.21.15.40:0/2600004908 >> v2:172.21.15.67:3300/0 conn(0x7fd06006c880 0x7fd060158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:24.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 --2- 172.21.15.40:0/2600004908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0600a75b0 0x7fd06006c340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0097c0 tx=0x7fd04c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebea881d3575f382 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05f7fe640 1 -- 172.21.15.40:0/2600004908 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0ab660 con 0x7fd0600a75b0 2023-05-24T04:00:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05f7fe640 1 -- 172.21.15.40:0/2600004908 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0ab7c0 con 0x7fd0600a75b0 2023-05-24T04:00:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05f7fe640 1 -- 172.21.15.40:0/2600004908 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0abb50 con 0x7fd0600a75b0 2023-05-24T04:00:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- 172.21.15.40:0/2600004908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0600a75b0 msgr2=0x7fd06006c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 --2- 172.21.15.40:0/2600004908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0600a75b0 0x7fd06006c340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0097c0 tx=0x7fd04c01c460 comp rx=0 tx=0).stop 2023-05-24T04:00:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- 172.21.15.40:0/2600004908 shutdown_connections 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 --2- 172.21.15.40:0/2600004908 >> v2:172.21.15.67:3300/0 conn(0x7fd06006c880 0x7fd060158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 --2- 172.21.15.40:0/2600004908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0600a75b0 0x7fd06006c340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- 172.21.15.40:0/2600004908 >> 172.21.15.40:0/2600004908 conn(0x7fd0600a4210 msgr2=0x7fd0600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- 172.21.15.40:0/2600004908 shutdown_connections 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- 172.21.15.40:0/2600004908 wait complete. 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 Processor -- start 2023-05-24T04:00:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- start start 2023-05-24T04:00:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd06006c880 0x7fd0600bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 0x7fd06014cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd06014f430 0x7fd0601eac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0601ea7e0 con 0x7fd0600a75b0 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600be4e0 con 0x7fd06014f430 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd066af7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014d490 con 0x7fd06006c880 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 0x7fd06014cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 0x7fd06014cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47894/0 (socket says 172.21.15.40:47894) 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 -- 172.21.15.40:0/1373387118 learned_addr learned my addr 172.21.15.40:0/1373387118 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd064893640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd06006c880 0x7fd0600bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd065094640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd06014f430 0x7fd0601eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 -- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd06006c880 msgr2=0x7fd0600bdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd06006c880 0x7fd0600bdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 -- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd06014f430 msgr2=0x7fd0601eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd06014f430 0x7fd0601eac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.862+0000 7fd05ffff640 1 -- 172.21.15.40:0/1373387118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009a70 con 0x7fd0600a75b0 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05ffff640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 0x7fd06014cf50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd04c01a090 tx=0x7fd04c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0b5810 con 0x7fd0600a75b0 2023-05-24T04:00:24.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0b5970 con 0x7fd0600a75b0 2023-05-24T04:00:24.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c009420 con 0x7fd0600a75b0 2023-05-24T04:00:24.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0b5d00 con 0x7fd0600a75b0 2023-05-24T04:00:24.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06006b070 con 0x7fd0600a75b0 2023-05-24T04:00:24.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd060071190 con 0x7fd0600a75b0 2023-05-24T04:00:24.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd04c0a9070 con 0x7fd0600a75b0 2023-05-24T04:00:24.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05d7fa640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd0440662b0 0x7fd044068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:24.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd04c11eb80 con 0x7fd0600a75b0 2023-05-24T04:00:24.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd064893640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd0440662b0 0x7fd044068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:24.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.866+0000 7fd064893640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd0440662b0 0x7fd044068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd054000f70 tx=0x7fd054009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:24.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:24.870+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd04c0ebc70 con 0x7fd0600a75b0 2023-05-24T04:00:25.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.022+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd06006b200 con 0x7fd0600a75b0 2023-05-24T04:00:25.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.022+0000 7fd05d7fa640 1 -- 172.21.15.40:0/1373387118 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd04c0b5e60 con 0x7fd0600a75b0 2023-05-24T04:00:25.029 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:25.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd0440662b0 msgr2=0x7fd044068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd0440662b0 0x7fd044068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd054000f70 tx=0x7fd054009040 comp rx=0 tx=0).stop 2023-05-24T04:00:25.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 msgr2=0x7fd06014cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 0x7fd06014cf50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd04c01a090 tx=0x7fd04c01aca0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 shutdown_connections 2023-05-24T04:00:25.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd0440662b0 0x7fd044068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd06014f430 0x7fd0601eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0600a75b0 0x7fd06014cf50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 --2- 172.21.15.40:0/1373387118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd06006c880 0x7fd0600bdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 >> 172.21.15.40:0/1373387118 conn(0x7fd0600a4210 msgr2=0x7fd0601469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 shutdown_connections 2023-05-24T04:00:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.026+0000 7fd066af7640 1 -- 172.21.15.40:0/1373387118 wait complete. 2023-05-24T04:00:25.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 Processor -- start 2023-05-24T04:00:25.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 -- start start 2023-05-24T04:00:25.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c8151d70 0x7fc0c80a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 0x7fc0c80a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c814f730 con 0x7fc0c8152140 2023-05-24T04:00:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c80a5360 con 0x7fc0c8151d70 2023-05-24T04:00:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0ce0c3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c806eb50 con 0x7fc0c80a4860 2023-05-24T04:00:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc0c8152140 0x7fc0c814f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45152/0 (socket says 172.21.15.40:45152) 2023-05-24T04:00:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c6ffd640 1 -- 172.21.15.40:0/719960148 learned_addr learned my addr 172.21.15.40:0/719960148 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:25.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c7fff640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 0x7fc0c80a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/719960148 >> v2:172.21.15.67:3300/0 conn(0x7fc0c8151d70 0x7fc0c80a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445429218 0 0) 0x7fc0c814f730 con 0x7fc0c8152140 2023-05-24T04:00:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b4003530 con 0x7fc0c8152140 2023-05-24T04:00:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3372700244 0 0) 0x7fc0b4003530 con 0x7fc0c8152140 2023-05-24T04:00:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 msgr2=0x7fc0c80a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 0x7fc0c80a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 >> v2:172.21.15.67:3300/0 conn(0x7fc0c8151d70 msgr2=0x7fc0c80a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 --2- 172.21.15.40:0/719960148 >> v2:172.21.15.67:3300/0 conn(0x7fc0c8151d70 0x7fc0c80a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c806f030 con 0x7fc0c8152140 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fc0b00016a0 con 0x7fc0c8152140 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 >> v1:172.21.15.40:6789/0 conn(0x7fc0c8152140 legacy=0x7fc0c814f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b4003980 0x7fc0b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b40043b0 0x7fc0b4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 0x7fc0b4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80a5360 con 0x7fc0b4003980 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c806eb50 con 0x7fc0b40043b0 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b400b990 con 0x7fc0c80a4860 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b4003980 0x7fc0b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c6ffd640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b40043b0 0x7fc0b4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 -- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 msgr2=0x7fc0b4004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c80a4860 0x7fc0b4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 -- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b40043b0 msgr2=0x7fc0b4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:25.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b40043b0 0x7fc0b4004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.166+0000 7fc0c77fe640 1 -- 172.21.15.40:0/719960148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4003530 con 0x7fc0b4003980 2023-05-24T04:00:25.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b4003980 0x7fc0b4003d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009b10 tx=0x7fc0b801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ff5c3680033e9d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80a5570 con 0x7fc0b4003980 2023-05-24T04:00:25.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80a56d0 con 0x7fc0b4003980 2023-05-24T04:00:25.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c67fc640 1 -- 172.21.15.40:0/719960148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80a5a80 con 0x7fc0b4003980 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/719960148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b4003980 msgr2=0x7fc0b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/719960148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b4003980 0x7fc0b4003d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009b10 tx=0x7fc0b801ca90 comp rx=0 tx=0).stop 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c7fff640 1 -- 172.21.15.40:0/719960148 reap_dead start 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/719960148 shutdown_connections 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/719960148 >> 172.21.15.40:0/719960148 conn(0x7fc0c80c0310 msgr2=0x7fc0c80c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/719960148 shutdown_connections 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/719960148 wait complete. 2023-05-24T04:00:25.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 Processor -- start 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- start start 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b4003980 0x7fc0c8147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c806be30 0x7fc0c813f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 0x7fc0c81ea270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8148130 con 0x7fc0c813f600 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8146260 con 0x7fc0c806be30 2023-05-24T04:00:25.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0ce0c3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c81476d0 con 0x7fc0b4003980 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 0x7fc0c81ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 0x7fc0c81ea270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47918/0 (socket says 172.21.15.40:47918) 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c7fff640 1 -- 172.21.15.40:0/2856814335 learned_addr learned my addr 172.21.15.40:0/2856814335 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.170+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b4003980 0x7fc0c8147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c6ffd640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c806be30 0x7fc0c813f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c7fff640 1 -- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b4003980 msgr2=0x7fc0c8147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c7fff640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b4003980 0x7fc0c8147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c7fff640 1 -- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c806be30 msgr2=0x7fc0c813f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c7fff640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c806be30 0x7fc0c813f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c7fff640 1 -- 172.21.15.40:0/2856814335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c8158fd0 con 0x7fc0c813f600 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c7fff640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 0x7fc0c81ea270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8152510 tx=0x7fc0c000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0010040 con 0x7fc0c813f600 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0014810 con 0x7fc0c813f600 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c8158e40 con 0x7fc0c813f600 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0009b10 con 0x7fc0c813f600 2023-05-24T04:00:25.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c8159160 con 0x7fc0c813f600 2023-05-24T04:00:25.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c8146480 con 0x7fc0c813f600 2023-05-24T04:00:25.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0c0014bc0 con 0x7fc0c813f600 2023-05-24T04:00:25.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0bffff640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0a8066280 0x7fc0a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0c0083fb0 con 0x7fc0c813f600 2023-05-24T04:00:25.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0a8066280 0x7fc0a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.174+0000 7fc0c77fe640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0a8066280 0x7fc0a8068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80af000 tx=0x7fc0b80046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.178+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc0c00511d0 con 0x7fc0c813f600 2023-05-24T04:00:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.330+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0c81474e0 con 0x7fc0c813f600 2023-05-24T04:00:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.330+0000 7fc0bffff640 1 -- 172.21.15.40:0/2856814335 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0c0018020 con 0x7fc0c813f600 2023-05-24T04:00:25.340 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:25.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0a8066280 msgr2=0x7fc0a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0a8066280 0x7fc0a8068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80af000 tx=0x7fc0b80046d0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 msgr2=0x7fc0c81ea270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 0x7fc0c81ea270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8152510 tx=0x7fc0c000ef10 comp rx=0 tx=0).stop 2023-05-24T04:00:25.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 shutdown_connections 2023-05-24T04:00:25.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc0a8066280 0x7fc0a8068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c813f600 0x7fc0c81ea270 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c806be30 0x7fc0c813f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 --2- 172.21.15.40:0/2856814335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b4003980 0x7fc0c8147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 >> 172.21.15.40:0/2856814335 conn(0x7fc0c80c0310 msgr2=0x7fc0c814c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 shutdown_connections 2023-05-24T04:00:25.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.334+0000 7fc0ce0c3640 1 -- 172.21.15.40:0/2856814335 wait complete. 2023-05-24T04:00:25.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:00:25.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 Processor -- start 2023-05-24T04:00:25.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 -- start start 2023-05-24T04:00:25.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51080c0e20 0x7f510814b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f510814eee0 0x7f5108155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080bd750 con 0x7f51080714c0 2023-05-24T04:00:25.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510806fe00 con 0x7f510814eee0 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510ce69640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080a4800 con 0x7f51080c0e20 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f5106d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f510814eee0 0x7f5108155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f5106d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f510814eee0 0x7f5108155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47924/0 (socket says 172.21.15.40:47924) 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f5106d9d640 1 -- 172.21.15.40:0/70339847 learned_addr learned my addr 172.21.15.40:0/70339847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.466+0000 7f510659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f51080714c0 0x7f510814e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45154/0 (socket says 172.21.15.40:45154) 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f5106d9d640 1 -- 172.21.15.40:0/70339847 >> v2:172.21.15.67:3300/0 conn(0x7f51080c0e20 msgr2=0x7f510814b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f5106d9d640 1 --2- 172.21.15.40:0/70339847 >> v2:172.21.15.67:3300/0 conn(0x7f51080c0e20 0x7f510814b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f5106d9d640 1 -- 172.21.15.40:0/70339847 >> v1:172.21.15.40:6789/0 conn(0x7f51080714c0 legacy=0x7f510814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f5106d9d640 1 -- 172.21.15.40:0/70339847 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080a4ae0 con 0x7f510814eee0 2023-05-24T04:00:25.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f5106d9d640 1 --2- 172.21.15.40:0/70339847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f510814eee0 0x7f5108155b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f510806e570 tx=0x7f510001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9e4e0687b0a2db server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510559a640 1 -- 172.21.15.40:0/70339847 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000a56e0 con 0x7f510814eee0 2023-05-24T04:00:25.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510559a640 1 -- 172.21.15.40:0/70339847 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51000a5840 con 0x7f510814eee0 2023-05-24T04:00:25.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510559a640 1 -- 172.21.15.40:0/70339847 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000a5bd0 con 0x7f510814eee0 2023-05-24T04:00:25.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 -- 172.21.15.40:0/70339847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f510814eee0 msgr2=0x7f5108155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 --2- 172.21.15.40:0/70339847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f510814eee0 0x7f5108155b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f510806e570 tx=0x7f510001c910 comp rx=0 tx=0).stop 2023-05-24T04:00:25.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 -- 172.21.15.40:0/70339847 shutdown_connections 2023-05-24T04:00:25.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 --2- 172.21.15.40:0/70339847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f510814eee0 0x7f5108155b60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 --2- 172.21.15.40:0/70339847 >> v2:172.21.15.67:3300/0 conn(0x7f51080c0e20 0x7f510814b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 -- 172.21.15.40:0/70339847 >> 172.21.15.40:0/70339847 conn(0x7f51080c0310 msgr2=0x7f51080c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 -- 172.21.15.40:0/70339847 shutdown_connections 2023-05-24T04:00:25.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.470+0000 7f510ce69640 1 -- 172.21.15.40:0/70339847 wait complete. 2023-05-24T04:00:25.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 Processor -- start 2023-05-24T04:00:25.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- start start 2023-05-24T04:00:25.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 0x7f51081e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51080c0e20 0x7f5108147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f510814eee0 0x7f51081e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51081e8760 con 0x7f51080714c0 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108147aa0 con 0x7f510814eee0 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51081e8430 con 0x7f51080c0e20 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 0x7f51081e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 0x7f51081e5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47926/0 (socket says 172.21.15.40:47926) 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 -- 172.21.15.40:0/4246772903 learned_addr learned my addr 172.21.15.40:0/4246772903 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:25.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f5105d9b640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51080c0e20 0x7f5108147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f5106d9d640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f510814eee0 0x7f51081e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 -- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51080c0e20 msgr2=0x7f5108147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51080c0e20 0x7f5108147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 -- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f510814eee0 msgr2=0x7f51081e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f510814eee0 0x7f51081e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 -- 172.21.15.40:0/4246772903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100009b30 con 0x7f51080714c0 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f5106d9d640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f510814eee0 0x7f51081e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:25.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510659c640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 0x7f51081e5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c490 tx=0x7f50f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8007480 con 0x7f51080714c0 2023-05-24T04:00:25.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f80075e0 con 0x7f51080714c0 2023-05-24T04:00:25.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8004a10 con 0x7f51080714c0 2023-05-24T04:00:25.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51080a2e40 con 0x7f51080714c0 2023-05-24T04:00:25.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5108071890 con 0x7f51080714c0 2023-05-24T04:00:25.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51080a2fd0 con 0x7f51080714c0 2023-05-24T04:00:25.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50f8004b70 con 0x7f51080714c0 2023-05-24T04:00:25.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.474+0000 7f50f6ffd640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50e8066280 0x7f50e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.478+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50f8083220 con 0x7f51080714c0 2023-05-24T04:00:25.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.478+0000 7f5105d9b640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50e8066280 0x7f50e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.478+0000 7f5105d9b640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50e8066280 0x7f50e8068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.478+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f51080a2fd0 con 0x7f51080714c0 2023-05-24T04:00:25.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.626+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51080a2fd0 con 0x7f51080714c0 2023-05-24T04:00:25.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.626+0000 7f50f6ffd640 1 -- 172.21.15.40:0/4246772903 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51080a2fd0 con 0x7f51080714c0 2023-05-24T04:00:25.633 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:00:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50e8066280 msgr2=0x7f50e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50e8066280 0x7f50e8068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 msgr2=0x7f51081e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 0x7f51081e5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c490 tx=0x7f50f800c950 comp rx=0 tx=0).stop 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 shutdown_connections 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f50e8066280 0x7f50e8068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f510814eee0 0x7f51081e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51080c0e20 0x7f5108147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 --2- 172.21.15.40:0/4246772903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51080714c0 0x7f51081e5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 >> 172.21.15.40:0/4246772903 conn(0x7f51080c0310 msgr2=0x7f51080bf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 shutdown_connections 2023-05-24T04:00:25.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.630+0000 7f510ce69640 1 -- 172.21.15.40:0/4246772903 wait complete. 2023-05-24T04:00:25.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:00:25.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.762+0000 7f563290c640 1 Processor -- start 2023-05-24T04:00:25.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.762+0000 7f563290c640 1 -- start start 2023-05-24T04:00:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.762+0000 7f563290c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0a3df0 0x7f562c0c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.762+0000 7f563290c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f562c0c3f60 0x7f562c152340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562c0b7e80 con 0x7f562c0bf010 2023-05-24T04:00:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c0a3890 con 0x7f562c0c3f60 2023-05-24T04:00:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0bb560 con 0x7f562c0a3df0 2023-05-24T04:00:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f562c0c3f60 0x7f562c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f562c0c3f60 0x7f562c152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47938/0 (socket says 172.21.15.40:47938) 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 -- 172.21.15.40:0/469558878 learned_addr learned my addr 172.21.15.40:0/469558878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f562b7fe640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0a3df0 0x7f562c0c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 -- 172.21.15.40:0/469558878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0a3df0 msgr2=0x7f562c0c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0a3df0 0x7f562c0c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 -- 172.21.15.40:0/469558878 >> v1:172.21.15.67:6789/0 conn(0x7f562c0bf010 legacy=0x7f562c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 -- 172.21.15.40:0/469558878 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0c34c0 con 0x7f562c0c3f60 2023-05-24T04:00:25.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f562b7fe640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0a3df0 0x7f562c0c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f5630ea9640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0c3f60 0x7f562c152340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5624009e50 tx=0x7f562401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c791f60261177fc6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f562affd640 1 -- 172.21.15.40:0/469558878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240a5750 con 0x7f562c0c3f60 2023-05-24T04:00:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f562affd640 1 -- 172.21.15.40:0/469558878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56240a58b0 con 0x7f562c0c3f60 2023-05-24T04:00:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f562affd640 1 -- 172.21.15.40:0/469558878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240a5c40 con 0x7f562c0c3f60 2023-05-24T04:00:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- 172.21.15.40:0/469558878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0c3f60 msgr2=0x7f562c152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0c3f60 0x7f562c152340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5624009e50 tx=0x7f562401c980 comp rx=0 tx=0).stop 2023-05-24T04:00:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- 172.21.15.40:0/469558878 shutdown_connections 2023-05-24T04:00:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0c3f60 0x7f562c152340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 --2- 172.21.15.40:0/469558878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0a3df0 0x7f562c0c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- 172.21.15.40:0/469558878 >> 172.21.15.40:0/469558878 conn(0x7f562c0a62d0 msgr2=0x7f562c0a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- 172.21.15.40:0/469558878 shutdown_connections 2023-05-24T04:00:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.766+0000 7f563290c640 1 -- 172.21.15.40:0/469558878 wait complete. 2023-05-24T04:00:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 Processor -- start 2023-05-24T04:00:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- start start 2023-05-24T04:00:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562c0a3df0 0x7f562c150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 0x7f562c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0c3f60 0x7f562c0bab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0b9770 con 0x7f562c0bf010 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c14ea20 con 0x7f562c0a3df0 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0bb090 con 0x7f562c0c3f60 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 0x7f562c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 0x7f562c14e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47952/0 (socket says 172.21.15.40:47952) 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 -- 172.21.15.40:0/24676831 learned_addr learned my addr 172.21.15.40:0/24676831 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5630ea9640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0c3f60 0x7f562c0bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562bfff640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562c0a3df0 0x7f562c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 -- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0c3f60 msgr2=0x7f562c0bab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0c3f60 0x7f562c0bab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 -- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562c0a3df0 msgr2=0x7f562c150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562c0a3df0 0x7f562c150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 -- 172.21.15.40:0/24676831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624009b30 con 0x7f562c0bf010 2023-05-24T04:00:25.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5630ea9640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0c3f60 0x7f562c0bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:25.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f562b7fe640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 0x7f562c14e4e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f562000c820 tx=0x7f562000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620007a30 con 0x7f562c0bf010 2023-05-24T04:00:25.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5620007b90 con 0x7f562c0bf010 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562c0c2ed0 con 0x7f562c0bf010 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56200113f0 con 0x7f562c0bf010 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562c0c2d40 con 0x7f562c0bf010 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562c15b9f0 con 0x7f562c0bf010 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5620011550 con 0x7f562c0bf010 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.770+0000 7f5628ff9640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5618066280 0x7f5618068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:25.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.774+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5620084180 con 0x7f562c0bf010 2023-05-24T04:00:25.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.774+0000 7f562bfff640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5618066280 0x7f5618068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:25.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.774+0000 7f562bfff640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5618066280 0x7f5618068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f561c000f70 tx=0x7f561c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:25.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.778+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f56200513a0 con 0x7f562c0bf010 2023-05-24T04:00:25.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f562c066d70 con 0x7f562c0bf010 2023-05-24T04:00:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f5628ff9640 1 -- 172.21.15.40:0/24676831 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56200549c0 con 0x7f562c0bf010 2023-05-24T04:00:25.931 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5618066280 msgr2=0x7f5618068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5618066280 0x7f5618068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f561c000f70 tx=0x7f561c009040 comp rx=0 tx=0).stop 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 msgr2=0x7f562c14e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 0x7f562c14e4e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f562000c820 tx=0x7f562000cce0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 shutdown_connections 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5618066280 0x7f5618068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f562c0c3f60 0x7f562c0bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f562c0bf010 0x7f562c14e4e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 --2- 172.21.15.40:0/24676831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562c0a3df0 0x7f562c150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:25.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 >> 172.21.15.40:0/24676831 conn(0x7f562c0a62d0 msgr2=0x7f562c0c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:25.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 shutdown_connections 2023-05-24T04:00:25.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:25.926+0000 7f563290c640 1 -- 172.21.15.40:0/24676831 wait complete. 2023-05-24T04:00:25.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:00:26.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.054+0000 7fe50037a640 1 Processor -- start 2023-05-24T04:00:26.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 -- start start 2023-05-24T04:00:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4f80bef60 0x7fe4f80c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4f80a3da0 0x7fe4f80c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80c4220 con 0x7fe4f80a3da0 2023-05-24T04:00:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80b8040 con 0x7fe4f80bef60 2023-05-24T04:00:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe50037a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80b7df0 con 0x7fe4f806aa70 2023-05-24T04:00:26.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fe116640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4f80bef60 0x7fe4f80c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fe917640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4f80a3da0 0x7fe4f80c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4f80a3da0 0x7fe4f80c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47964/0 (socket says 172.21.15.40:47964) 2023-05-24T04:00:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 -- 172.21.15.40:0/1725228142 learned_addr learned my addr 172.21.15.40:0/1725228142 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fe917640 1 --2- 172.21.15.40:0/1725228142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58416/0 (socket says 172.21.15.40:58416) 2023-05-24T04:00:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 -- 172.21.15.40:0/1725228142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 msgr2=0x7fe4f806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 --2- 172.21.15.40:0/1725228142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 -- 172.21.15.40:0/1725228142 >> v2:172.21.15.67:3300/0 conn(0x7fe4f80bef60 msgr2=0x7fe4f80c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 --2- 172.21.15.40:0/1725228142 >> v2:172.21.15.67:3300/0 conn(0x7fe4f80bef60 0x7fe4f80c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 -- 172.21.15.40:0/1725228142 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80a38d0 con 0x7fe4f80a3da0 2023-05-24T04:00:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd915640 1 --2- 172.21.15.40:0/1725228142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80a3da0 0x7fe4f80c27c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80c21f0 tx=0x7fe4ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2da3e2760f06f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.058+0000 7fe4fd114640 1 -- 172.21.15.40:0/1725228142 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0a7070 con 0x7fe4f80a3da0 2023-05-24T04:00:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fd114640 1 -- 172.21.15.40:0/1725228142 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0ab430 con 0x7fe4f80a3da0 2023-05-24T04:00:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fd114640 1 -- 172.21.15.40:0/1725228142 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0ab7c0 con 0x7fe4f80a3da0 2023-05-24T04:00:26.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/1725228142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80a3da0 msgr2=0x7fe4f80c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- 172.21.15.40:0/1725228142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80a3da0 0x7fe4f80c27c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80c21f0 tx=0x7fe4ec01c450 comp rx=0 tx=0).stop 2023-05-24T04:00:26.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/1725228142 shutdown_connections 2023-05-24T04:00:26.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- 172.21.15.40:0/1725228142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- 172.21.15.40:0/1725228142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80a3da0 0x7fe4f80c27c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- 172.21.15.40:0/1725228142 >> v2:172.21.15.67:3300/0 conn(0x7fe4f80bef60 0x7fe4f80c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/1725228142 >> 172.21.15.40:0/1725228142 conn(0x7fe4f8065bb0 msgr2=0x7fe4f80a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/1725228142 shutdown_connections 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/1725228142 wait complete. 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 Processor -- start 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- start start 2023-05-24T04:00:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f80bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f80a3da0 0x7fe4f814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 0x7fe4f80bb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80bac80 con 0x7fe4f80bef60 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80ba880 con 0x7fe4f80a3da0 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80ba210 con 0x7fe4f806aa70 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 0x7fe4f80bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 0x7fe4f80bb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47966/0 (socket says 172.21.15.40:47966) 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 -- 172.21.15.40:0/114965803 learned_addr learned my addr 172.21.15.40:0/114965803 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe116640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f80bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fd915640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f80a3da0 0x7fe4f814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 -- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 msgr2=0x7fe4f80bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f80bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 -- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f80a3da0 msgr2=0x7fe4f814c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f80a3da0 0x7fe4f814c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 -- 172.21.15.40:0/114965803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0094d0 con 0x7fe4f80bef60 2023-05-24T04:00:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4fe917640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 0x7fe4f80bb990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000efc0 tx=0x7fe4f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0014480 con 0x7fe4f80bef60 2023-05-24T04:00:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000f040 con 0x7fe4f80bef60 2023-05-24T04:00:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f80c3eb0 con 0x7fe4f80bef60 2023-05-24T04:00:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0014820 con 0x7fe4f80bef60 2023-05-24T04:00:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.062+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f80c2d00 con 0x7fe4f80bef60 2023-05-24T04:00:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.066+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f80bb440 con 0x7fe4f80bef60 2023-05-24T04:00:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.066+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4f0014980 con 0x7fe4f80bef60 2023-05-24T04:00:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.066+0000 7fe4eaffd640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4dc066280 0x7fe4dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.066+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe4f0084b00 con 0x7fe4f80bef60 2023-05-24T04:00:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.066+0000 7fe4fe116640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4dc066280 0x7fe4dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.066+0000 7fe4fe116640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4dc066280 0x7fe4dc068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40099d0 tx=0x7fe4f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.070+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe4f0051c90 con 0x7fe4f80bef60 2023-05-24T04:00:26.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.262+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4f80b9d00 con 0x7fe4f80bef60 2023-05-24T04:00:26.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.262+0000 7fe4eaffd640 1 -- 172.21.15.40:0/114965803 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3291 (secure 0 0 0) 0x7fe4f0018cf0 con 0x7fe4f80bef60 2023-05-24T04:00:26.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:26.268 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:19.661783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T04:00:26.268 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-05-24T04:00:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4dc066280 msgr2=0x7fe4dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4dc066280 0x7fe4dc068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40099d0 tx=0x7fe4f4008040 comp rx=0 tx=0).stop 2023-05-24T04:00:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 msgr2=0x7fe4f80bb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 0x7fe4f80bb990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000efc0 tx=0x7fe4f000c490 comp rx=0 tx=0).stop 2023-05-24T04:00:26.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 shutdown_connections 2023-05-24T04:00:26.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4dc066280 0x7fe4dc068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80bef60 0x7fe4f80bb990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f80a3da0 0x7fe4f814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 --2- 172.21.15.40:0/114965803 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4f806aa70 0x7fe4f80bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 >> 172.21.15.40:0/114965803 conn(0x7fe4f8065bb0 msgr2=0x7fe4f8158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 shutdown_connections 2023-05-24T04:00:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.266+0000 7fe50037a640 1 -- 172.21.15.40:0/114965803 wait complete. 2023-05-24T04:00:26.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:26.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.406+0000 7f7ecab7d640 1 Processor -- start 2023-05-24T04:00:26.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ecab7d640 1 -- start start 2023-05-24T04:00:26.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ecab7d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7ec40c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ecab7d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ec40c4070 0x7f7ec4151f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ecab7d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40c2660 con 0x7f7ec40befa0 2023-05-24T04:00:26.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ecab7d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec40a3dc0 con 0x7f7ec40c4070 2023-05-24T04:00:26.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ecab7d640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40c44d0 con 0x7f7ec40a37e0 2023-05-24T04:00:26.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec8919640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ec40befa0 0x7f7ec40c28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45160/0 (socket says 172.21.15.40:45160) 2023-05-24T04:00:26.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec8919640 1 -- 172.21.15.40:0/2742701555 learned_addr learned my addr 172.21.15.40:0/2742701555 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:26.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7ec40c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec911a640 1 --2- 172.21.15.40:0/2742701555 >> v2:172.21.15.67:3300/0 conn(0x7f7ec40c4070 0x7f7ec4151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186421897 0 0) 0x7f7ec40c2660 con 0x7f7ec40befa0 2023-05-24T04:00:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eac003530 con 0x7f7ec40befa0 2023-05-24T04:00:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701483855 0 0) 0x7f7eac003530 con 0x7f7ec40befa0 2023-05-24T04:00:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 msgr2=0x7f7ec40c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7ec40c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 >> v2:172.21.15.67:3300/0 conn(0x7f7ec40c4070 msgr2=0x7f7ec4151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 --2- 172.21.15.40:0/2742701555 >> v2:172.21.15.67:3300/0 conn(0x7f7ec40c4070 0x7f7ec4151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40c3670 con 0x7f7ec40befa0 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f7eb4001680 con 0x7f7ec40befa0 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 >> v1:172.21.15.40:6789/0 conn(0x7f7ec40befa0 legacy=0x7f7ec40c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eac003980 0x7f7eac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eac0047d0 0x7f7eac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7eac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40c44d0 con 0x7f7eac0047d0 2023-05-24T04:00:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac00b990 con 0x7f7eac003980 2023-05-24T04:00:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac00bb50 con 0x7f7ec40a37e0 2023-05-24T04:00:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eac0047d0 0x7f7eac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec911a640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7eac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec8919640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eac003980 0x7f7eac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 -- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 msgr2=0x7f7eac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7eac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 -- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eac003980 msgr2=0x7f7eac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eac003980 0x7f7eac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec3fff640 1 -- 172.21.15.40:0/2742701555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac003530 con 0x7f7eac0047d0 2023-05-24T04:00:26.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec911a640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a37e0 0x7f7eac005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:26.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.410+0000 7f7ec8919640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eac003980 0x7f7eac003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eac0047d0 0x7f7eac004c40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ae0 tx=0x7f7eb801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a15ecc402b762f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80a5640 con 0x7f7eac0047d0 2023-05-24T04:00:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb80a57a0 con 0x7f7eac0047d0 2023-05-24T04:00:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec37fe640 1 -- 172.21.15.40:0/2742701555 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80a5b50 con 0x7f7eac0047d0 2023-05-24T04:00:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- 172.21.15.40:0/2742701555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eac0047d0 msgr2=0x7f7eac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/2742701555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eac0047d0 0x7f7eac004c40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ae0 tx=0x7f7eb801ca50 comp rx=0 tx=0).stop 2023-05-24T04:00:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec911a640 1 -- 172.21.15.40:0/2742701555 reap_dead start 2023-05-24T04:00:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- 172.21.15.40:0/2742701555 shutdown_connections 2023-05-24T04:00:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- 172.21.15.40:0/2742701555 >> 172.21.15.40:0/2742701555 conn(0x7f7ec4066220 msgr2=0x7f7ec40a62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- 172.21.15.40:0/2742701555 shutdown_connections 2023-05-24T04:00:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- 172.21.15.40:0/2742701555 wait complete. 2023-05-24T04:00:26.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 Processor -- start 2023-05-24T04:00:26.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- start start 2023-05-24T04:00:26.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 0x7f7ec40bccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a3190 0x7f7ec41e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ec40bd570 0x7f7ec4150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40bd200 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec414f500 con 0x7f7ec40bd570 2023-05-24T04:00:26.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ecab7d640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec414f9a0 con 0x7f7ec40a3190 2023-05-24T04:00:26.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 0x7f7ec40bccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 0x7f7ec40bccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47976/0 (socket says 172.21.15.40:47976) 2023-05-24T04:00:26.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 -- 172.21.15.40:0/3900933722 learned_addr learned my addr 172.21.15.40:0/3900933722 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a3190 0x7f7ec41e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec911a640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ec40bd570 0x7f7ec4150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 -- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a3190 msgr2=0x7f7ec41e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a3190 0x7f7ec41e9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 -- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ec40bd570 msgr2=0x7f7ec4150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ec40bd570 0x7f7ec4150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.414+0000 7f7ec8919640 1 -- 172.21.15.40:0/3900933722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40bb480 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec8919640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 0x7f7ec40bccc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4000f70 tx=0x7f7eb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40074e0 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4007640 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec40aa620 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4004a10 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec40bb610 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec40a5610 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7eb4004b70 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec17fa640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7eb00662b0 0x7f7eb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7eb4083b40 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7eb00662b0 0x7f7eb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.418+0000 7f7ec3fff640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7eb00662b0 0x7f7eb0068760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80af000 tx=0x7f7eb80a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.422+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7eb4050d60 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.582+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec40a49b0 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ec17fa640 1 -- 172.21.15.40:0/3900933722 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f7eb4019090 con 0x7f7ec40a2dc0 2023-05-24T04:00:26.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:26.590 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:26.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7eb00662b0 msgr2=0x7f7eb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7eb00662b0 0x7f7eb0068760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80af000 tx=0x7f7eb80a7040 comp rx=0 tx=0).stop 2023-05-24T04:00:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 msgr2=0x7f7ec40bccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 0x7f7ec40bccc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4000f70 tx=0x7f7eb400dc90 comp rx=0 tx=0).stop 2023-05-24T04:00:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 shutdown_connections 2023-05-24T04:00:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7eb00662b0 0x7f7eb0068760 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ec40bd570 0x7f7ec4150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ec40a3190 0x7f7ec41e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 --2- 172.21.15.40:0/3900933722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec40a2dc0 0x7f7ec40bccc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 >> 172.21.15.40:0/3900933722 conn(0x7f7eac0047d0 msgr2=0x7f7ec406b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:26.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 shutdown_connections 2023-05-24T04:00:26.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.586+0000 7f7ecab7d640 1 -- 172.21.15.40:0/3900933722 wait complete. 2023-05-24T04:00:26.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:26.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:26.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 Processor -- start 2023-05-24T04:00:26.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 -- start start 2023-05-24T04:00:26.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf780bedc0 0x7fbf780bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf780c4080 0x7fbf780c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780a3a90 con 0x7fbf780c0e30 2023-05-24T04:00:26.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780a37f0 con 0x7fbf780bedc0 2023-05-24T04:00:26.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf7d49e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780aa610 con 0x7fbf780c4080 2023-05-24T04:00:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf76ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf780bedc0 0x7fbf780bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf777fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbf780c0e30 0x7fbf7806ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45168/0 (socket says 172.21.15.40:45168) 2023-05-24T04:00:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf777fe640 1 -- 172.21.15.40:0/2642797418 learned_addr learned my addr 172.21.15.40:0/2642797418 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf6ffff640 1 --2- 172.21.15.40:0/2642797418 >> v2:172.21.15.67:3300/0 conn(0x7fbf780c4080 0x7fbf780c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf76ffd640 1 -- 172.21.15.40:0/2642797418 >> v2:172.21.15.67:3300/0 conn(0x7fbf780c4080 msgr2=0x7fbf780c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf767fc640 1 -- 172.21.15.40:0/2642797418 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478982124 0 0) 0x7fbf780a3a90 con 0x7fbf780c0e30 2023-05-24T04:00:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf76ffd640 1 --2- 172.21.15.40:0/2642797418 >> v2:172.21.15.67:3300/0 conn(0x7fbf780c4080 0x7fbf780c08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf76ffd640 1 -- 172.21.15.40:0/2642797418 >> v1:172.21.15.40:6789/0 conn(0x7fbf780c0e30 legacy=0x7fbf7806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.734+0000 7fbf76ffd640 1 -- 172.21.15.40:0/2642797418 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780c44e0 con 0x7fbf780bedc0 2023-05-24T04:00:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf76ffd640 1 --2- 172.21.15.40:0/2642797418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780bedc0 0x7fbf780bf190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbf780c0040 tx=0x7fbf6801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d68870a9d521a69 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf767fc640 1 -- 172.21.15.40:0/2642797418 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680ab600 con 0x7fbf780bedc0 2023-05-24T04:00:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf767fc640 1 -- 172.21.15.40:0/2642797418 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680a7050 con 0x7fbf780bedc0 2023-05-24T04:00:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf767fc640 1 -- 172.21.15.40:0/2642797418 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680ab980 con 0x7fbf780bedc0 2023-05-24T04:00:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/2642797418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780bedc0 msgr2=0x7fbf780bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/2642797418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780bedc0 0x7fbf780bf190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbf780c0040 tx=0x7fbf6801c460 comp rx=0 tx=0).stop 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/2642797418 shutdown_connections 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/2642797418 >> v2:172.21.15.67:3300/0 conn(0x7fbf780c4080 0x7fbf780c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/2642797418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780bedc0 0x7fbf780bf190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/2642797418 >> 172.21.15.40:0/2642797418 conn(0x7fbf780a6340 msgr2=0x7fbf780a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/2642797418 shutdown_connections 2023-05-24T04:00:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/2642797418 wait complete. 2023-05-24T04:00:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 Processor -- start 2023-05-24T04:00:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- start start 2023-05-24T04:00:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780bedc0 0x7fbf780b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780c0e30 0x7fbf78158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 0x7fbf781525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b9f10 con 0x7fbf780c4080 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780b87e0 con 0x7fbf780c0e30 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78159060 con 0x7fbf780bedc0 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 0x7fbf781525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 0x7fbf781525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47984/0 (socket says 172.21.15.40:47984) 2023-05-24T04:00:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 -- 172.21.15.40:0/1218555689 learned_addr learned my addr 172.21.15.40:0/1218555689 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf76ffd640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780bedc0 0x7fbf780b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf6ffff640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780c0e30 0x7fbf78158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 -- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780bedc0 msgr2=0x7fbf780b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780bedc0 0x7fbf780b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 -- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780c0e30 msgr2=0x7fbf78158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780c0e30 0x7fbf78158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 -- 172.21.15.40:0/1218555689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009420 con 0x7fbf780c4080 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf777fe640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 0x7fbf781525e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000c780 tx=0x7fbf7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000ce90 con 0x7fbf780c4080 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7000a640 con 0x7fbf780c4080 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000a9d0 con 0x7fbf780c4080 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf780a40f0 con 0x7fbf780c4080 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.738+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf780a3f60 con 0x7fbf780c4080 2023-05-24T04:00:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.742+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7815b400 con 0x7fbf780c4080 2023-05-24T04:00:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.742+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf7000ab30 con 0x7fbf780c4080 2023-05-24T04:00:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.742+0000 7fbf6f7fe640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbf58066280 0x7fbf58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.742+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf700835c0 con 0x7fbf780c4080 2023-05-24T04:00:26.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.742+0000 7fbf76ffd640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbf58066280 0x7fbf58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:26.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.742+0000 7fbf76ffd640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbf58066280 0x7fbf58068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf680ad000 tx=0x7fbf68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:26.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.746+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbf70050750 con 0x7fbf780c4080 2023-05-24T04:00:26.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.894+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf7804ddd0 con 0x7fbf780c4080 2023-05-24T04:00:26.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf6f7fe640 1 -- 172.21.15.40:0/1218555689 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf70053d70 con 0x7fbf780c4080 2023-05-24T04:00:26.902 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbf58066280 msgr2=0x7fbf58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbf58066280 0x7fbf58068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf680ad000 tx=0x7fbf68008040 comp rx=0 tx=0).stop 2023-05-24T04:00:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 msgr2=0x7fbf781525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 0x7fbf781525e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000c780 tx=0x7fbf7000cc40 comp rx=0 tx=0).stop 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 shutdown_connections 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbf58066280 0x7fbf58068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf780c4080 0x7fbf781525e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780c0e30 0x7fbf78158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 --2- 172.21.15.40:0/1218555689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780bedc0 0x7fbf780b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 >> 172.21.15.40:0/1218555689 conn(0x7fbf780a6340 msgr2=0x7fbf7806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 shutdown_connections 2023-05-24T04:00:26.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:26.898+0000 7fbf7d49e640 1 -- 172.21.15.40:0/1218555689 wait complete. 2023-05-24T04:00:26.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 Processor -- start 2023-05-24T04:00:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 -- start start 2023-05-24T04:00:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32d414bc80 0x7f32d40a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 0x7f32d40bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d4071ad0 con 0x7f32d4071220 2023-05-24T04:00:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d40a5040 con 0x7f32d414bc80 2023-05-24T04:00:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32da05f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4070ab0 con 0x7f32d4071670 2023-05-24T04:00:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32caffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32d4071220 0x7f32d40bcd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45176/0 (socket says 172.21.15.40:45176) 2023-05-24T04:00:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32caffd640 1 -- 172.21.15.40:0/3812757179 learned_addr learned my addr 172.21.15.40:0/3812757179 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 0x7f32d40bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d37fe640 1 --2- 172.21.15.40:0/3812757179 >> v2:172.21.15.67:3300/0 conn(0x7f32d414bc80 0x7f32d40a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492797994 0 0) 0x7f32d4071ad0 con 0x7f32d4071220 2023-05-24T04:00:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c0003530 con 0x7f32d4071220 2023-05-24T04:00:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664998014 0 0) 0x7f32c0003530 con 0x7f32d4071220 2023-05-24T04:00:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 msgr2=0x7f32d40bd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 0x7f32d40bd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 >> v2:172.21.15.67:3300/0 conn(0x7f32d414bc80 msgr2=0x7f32d40a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 --2- 172.21.15.40:0/3812757179 >> v2:172.21.15.67:3300/0 conn(0x7f32d414bc80 0x7f32d40a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d414d0f0 con 0x7f32d4071220 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f32bc001680 con 0x7f32d4071220 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 >> v1:172.21.15.40:6789/0 conn(0x7f32d4071220 legacy=0x7f32d40bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32c0003980 0x7f32c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 0x7f32c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c0004d10 0x7f32c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40a5040 con 0x7f32c0004d10 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4070ab0 con 0x7f32c0003980 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c000ba10 con 0x7f32d4071670 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c0004d10 0x7f32c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d37fe640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32c0003980 0x7f32c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32caffd640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 0x7f32c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 -- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 msgr2=0x7f32c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4071670 0x7f32c00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 -- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32c0003980 msgr2=0x7f32c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32c0003980 0x7f32c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.038+0000 7f32d3fff640 1 -- 172.21.15.40:0/3812757179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0003530 con 0x7f32c0004d10 2023-05-24T04:00:27.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d3fff640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c0004d10 0x7f32c0005180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009fc0 tx=0x7f32cc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e4fabb7e822dba server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0a5c50 con 0x7f32c0004d10 2023-05-24T04:00:27.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc00f040 con 0x7f32c0004d10 2023-05-24T04:00:27.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d2ffd640 1 -- 172.21.15.40:0/3812757179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0ad440 con 0x7f32c0004d10 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- 172.21.15.40:0/3812757179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c0004d10 msgr2=0x7f32c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 --2- 172.21.15.40:0/3812757179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c0004d10 0x7f32c0005180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009fc0 tx=0x7f32cc01cc60 comp rx=0 tx=0).stop 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d3fff640 1 -- 172.21.15.40:0/3812757179 reap_dead start 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- 172.21.15.40:0/3812757179 shutdown_connections 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- 172.21.15.40:0/3812757179 >> 172.21.15.40:0/3812757179 conn(0x7f32d40c0310 msgr2=0x7f32d40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- 172.21.15.40:0/3812757179 shutdown_connections 2023-05-24T04:00:27.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- 172.21.15.40:0/3812757179 wait complete. 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 Processor -- start 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- start start 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 0x7f32d414a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4146dd0 0x7f32d4142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d414ad30 0x7f32d4142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d414df10 con 0x7f32d413a070 2023-05-24T04:00:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4143a30 con 0x7f32d414ad30 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32da05f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4141cd0 con 0x7f32d4146dd0 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 0x7f32d414a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 0x7f32d414a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48012/0 (socket says 172.21.15.40:48012) 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 -- 172.21.15.40:0/1336716465 learned_addr learned my addr 172.21.15.40:0/1336716465 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32caffd640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4146dd0 0x7f32d4142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d3fff640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d414ad30 0x7f32d4142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 -- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4146dd0 msgr2=0x7f32d4142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4146dd0 0x7f32d4142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 -- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d414ad30 msgr2=0x7f32d4142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d414ad30 0x7f32d4142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.042+0000 7f32d37fe640 1 -- 172.21.15.40:0/1336716465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d414c050 con 0x7f32d413a070 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32caffd640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4146dd0 0x7f32d4142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d3fff640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d414ad30 0x7f32d4142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d37fe640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 0x7f32d414a7f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f32c4011660 tx=0x7f32c4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400f960 con 0x7f32d413a070 2023-05-24T04:00:27.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c400fac0 con 0x7f32d413a070 2023-05-24T04:00:27.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d406b1d0 con 0x7f32d413a070 2023-05-24T04:00:27.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400fe30 con 0x7f32d413a070 2023-05-24T04:00:27.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d414cd50 con 0x7f32d413a070 2023-05-24T04:00:27.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d40bcb90 con 0x7f32d413a070 2023-05-24T04:00:27.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32c4015460 con 0x7f32d413a070 2023-05-24T04:00:27.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d0ff9640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32b4066280 0x7f32b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32c4084500 con 0x7f32d413a070 2023-05-24T04:00:27.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32caffd640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32b4066280 0x7f32b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.046+0000 7f32caffd640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32b4066280 0x7f32b4068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f32bc000c10 tx=0x7f32bc0047f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.050+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f32c4051740 con 0x7f32d413a070 2023-05-24T04:00:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f32d404ddd0 con 0x7f32d413a070 2023-05-24T04:00:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32d0ff9640 1 -- 172.21.15.40:0/1336716465 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32c4054d60 con 0x7f32d413a070 2023-05-24T04:00:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32b4066280 msgr2=0x7f32b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32b4066280 0x7f32b4068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f32bc000c10 tx=0x7f32bc0047f0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 msgr2=0x7f32d414a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 0x7f32d414a7f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f32c4011660 tx=0x7f32c4011b20 comp rx=0 tx=0).stop 2023-05-24T04:00:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 shutdown_connections 2023-05-24T04:00:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32b4066280 0x7f32b4068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d414ad30 0x7f32d4142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32d4146dd0 0x7f32d4142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 --2- 172.21.15.40:0/1336716465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d413a070 0x7f32d414a7f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 >> 172.21.15.40:0/1336716465 conn(0x7f32d40c0310 msgr2=0x7f32d4148560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 shutdown_connections 2023-05-24T04:00:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.206+0000 7f32da05f640 1 -- 172.21.15.40:0/1336716465 wait complete. 2023-05-24T04:00:27.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:27.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4338a6a640 1 Processor -- start 2023-05-24T04:00:27.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4338a6a640 1 -- start start 2023-05-24T04:00:27.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4338a6a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43341526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4338a6a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433406b010 con 0x7f433406bba0 2023-05-24T04:00:27.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4338a6a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433406b730 con 0x7f43340b5c10 2023-05-24T04:00:27.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4338a6a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433406ada0 con 0x7f43340be6f0 2023-05-24T04:00:27.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4329d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f433406bba0 0x7f4334070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45182/0 (socket says 172.21.15.40:45182) 2023-05-24T04:00:27.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.342+0000 7f4329d9b640 1 -- 172.21.15.40:0/2446060140 learned_addr learned my addr 172.21.15.40:0/2446060140 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f433259c640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43341526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307608074 0 0) 0x7f433406b010 con 0x7f433406bba0 2023-05-24T04:00:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4320003530 con 0x7f433406bba0 2023-05-24T04:00:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658171411 0 0) 0x7f4320003530 con 0x7f433406bba0 2023-05-24T04:00:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 msgr2=0x7f43341526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43341526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 >> v1:172.21.15.67:6789/0 conn(0x7f43340b5c10 legacy=0x7f4334159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334152100 con 0x7f433406bba0 2023-05-24T04:00:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f431c001680 con 0x7f433406bba0 2023-05-24T04:00:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 >> v1:172.21.15.40:6789/0 conn(0x7f433406bba0 legacy=0x7f4334070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4320004d10 0x7f4320005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433406ada0 con 0x7f4320003fe0 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432000bba0 con 0x7f4320004d10 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432000bd60 con 0x7f43340be6f0 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f433259c640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4332d9d640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4320004d10 0x7f4320005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 -- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 msgr2=0x7f43200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 -- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4320004d10 msgr2=0x7f4320005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4320004d10 0x7f4320005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 -- 172.21.15.40:0/2446060140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320003530 con 0x7f4320003fe0 2023-05-24T04:00:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f433259c640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43340be6f0 0x7f43200039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4329d9b640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43200047d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f431c00c190 tx=0x7f431c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b21bf117c888339 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0a5b00 con 0x7f4320003fe0 2023-05-24T04:00:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c0a5c60 con 0x7f4320003fe0 2023-05-24T04:00:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4331d9b640 1 -- 172.21.15.40:0/2446060140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c005b20 con 0x7f4320003fe0 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4338a6a640 1 -- 172.21.15.40:0/2446060140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 msgr2=0x7f43200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4338a6a640 1 --2- 172.21.15.40:0/2446060140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43200047d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f431c00c190 tx=0x7f431c01cc00 comp rx=0 tx=0).stop 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4332d9d640 1 -- 172.21.15.40:0/2446060140 reap_dead start 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4338a6a640 1 -- 172.21.15.40:0/2446060140 shutdown_connections 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4338a6a640 1 -- 172.21.15.40:0/2446060140 >> 172.21.15.40:0/2446060140 conn(0x7f43340c2540 msgr2=0x7f43340c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4338a6a640 1 -- 172.21.15.40:0/2446060140 shutdown_connections 2023-05-24T04:00:27.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.346+0000 7f4338a6a640 1 -- 172.21.15.40:0/2446060140 wait complete. 2023-05-24T04:00:27.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 Processor -- start 2023-05-24T04:00:27.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- start start 2023-05-24T04:00:27.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43340a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43341e7ab0 0x7f4334148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43341e7ee0 0x7f4334148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43341ea9d0 con 0x7f4320003fe0 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43341e7620 con 0x7f43341e7ee0 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43341e7040 con 0x7f43341e7ab0 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43340a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43340a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48024/0 (socket says 172.21.15.40:48024) 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 -- 172.21.15.40:0/274511018 learned_addr learned my addr 172.21.15.40:0/274511018 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4329d9b640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43341e7ab0 0x7f4334148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4332d9d640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43341e7ee0 0x7f4334148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 -- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43341e7ab0 msgr2=0x7f4334148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43341e7ab0 0x7f4334148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 -- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43341e7ee0 msgr2=0x7f4334148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43341e7ee0 0x7f4334148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 -- 172.21.15.40:0/274511018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334071b10 con 0x7f4320003fe0 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4332d9d640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43341e7ee0 0x7f4334148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f433259c640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43340a67f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f432400e870 tx=0x7f432400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400c870 con 0x7f4320003fe0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400c9d0 con 0x7f4320003fe0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4334071980 con 0x7f4320003fe0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400cd40 con 0x7f4320003fe0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433415ab50 con 0x7f4320003fe0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334066d70 con 0x7f4320003fe0 2023-05-24T04:00:27.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4324013410 con 0x7f4320003fe0 2023-05-24T04:00:27.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.350+0000 7f432b7fe640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4314066280 0x7f4314068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.354+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4324083d20 con 0x7f4320003fe0 2023-05-24T04:00:27.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.354+0000 7f4329d9b640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4314066280 0x7f4314068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.354+0000 7f4329d9b640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4314066280 0x7f4314068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ab000 tx=0x7f431c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.354+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4324088070 con 0x7f4320003fe0 2023-05-24T04:00:27.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.510+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4334072010 con 0x7f4320003fe0 2023-05-24T04:00:27.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f432b7fe640 1 -- 172.21.15.40:0/274511018 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f432400ee60 con 0x7f4320003fe0 2023-05-24T04:00:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4314066280 msgr2=0x7f4314068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4314066280 0x7f4314068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ab000 tx=0x7f431c0a7070 comp rx=0 tx=0).stop 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 msgr2=0x7f43340a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43340a67f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f432400e870 tx=0x7f432400ed30 comp rx=0 tx=0).stop 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 shutdown_connections 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4314066280 0x7f4314068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43341e7ee0 0x7f4334148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43341e7ab0 0x7f4334148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 --2- 172.21.15.40:0/274511018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4320003fe0 0x7f43340a67f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 >> 172.21.15.40:0/274511018 conn(0x7f43340c2540 msgr2=0x7f433414f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 shutdown_connections 2023-05-24T04:00:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.514+0000 7f4338a6a640 1 -- 172.21.15.40:0/274511018 wait complete. 2023-05-24T04:00:27.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:00:27.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 Processor -- start 2023-05-24T04:00:27.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 -- start start 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e1414bc80 0x7f5e140a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5e14071220 0x7f5e14071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e140bcd20 0x7f5e140bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e140a5040 con 0x7f5e1414bc80 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e14070ab0 con 0x7f5e14071220 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e18ba0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1414d0f0 con 0x7f5e140bcd20 2023-05-24T04:00:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e1414bc80 0x7f5e140a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e1414bc80 0x7f5e140a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48032/0 (socket says 172.21.15.40:48032) 2023-05-24T04:00:27.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 -- 172.21.15.40:0/2833084307 learned_addr learned my addr 172.21.15.40:0/2833084307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:27.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e11d9b640 1 --2- 172.21.15.40:0/2833084307 >> v2:172.21.15.67:3300/0 conn(0x7f5e14071220 0x7f5e14071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e12d9d640 1 --2- 172.21.15.40:0/2833084307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e140bcd20 0x7f5e140bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 -- 172.21.15.40:0/2833084307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e140bcd20 msgr2=0x7f5e140bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 --2- 172.21.15.40:0/2833084307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e140bcd20 0x7f5e140bd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 -- 172.21.15.40:0/2833084307 >> v2:172.21.15.67:3300/0 conn(0x7f5e14071220 msgr2=0x7f5e14071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 --2- 172.21.15.40:0/2833084307 >> v2:172.21.15.67:3300/0 conn(0x7f5e14071220 0x7f5e14071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.646+0000 7f5e1259c640 1 -- 172.21.15.40:0/2833084307 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14070d00 con 0x7f5e1414bc80 2023-05-24T04:00:27.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e1259c640 1 --2- 172.21.15.40:0/2833084307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1414bc80 0x7f5e140a33a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e1406e540 tx=0x7f5e0401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5a72f2c4f7f301 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e1159a640 1 -- 172.21.15.40:0/2833084307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e040ac620 con 0x7f5e1414bc80 2023-05-24T04:00:27.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e1159a640 1 -- 172.21.15.40:0/2833084307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e040ac780 con 0x7f5e1414bc80 2023-05-24T04:00:27.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e1159a640 1 -- 172.21.15.40:0/2833084307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e040acb10 con 0x7f5e1414bc80 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2833084307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1414bc80 msgr2=0x7f5e140a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2833084307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1414bc80 0x7f5e140a33a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e1406e540 tx=0x7f5e0401c3e0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2833084307 shutdown_connections 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2833084307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e140bcd20 0x7f5e140bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2833084307 >> v2:172.21.15.67:3300/0 conn(0x7f5e14071220 0x7f5e14071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2833084307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1414bc80 0x7f5e140a33a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2833084307 >> 172.21.15.40:0/2833084307 conn(0x7f5e140c0310 msgr2=0x7f5e140c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2833084307 shutdown_connections 2023-05-24T04:00:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2833084307 wait complete. 2023-05-24T04:00:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 Processor -- start 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- start start 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e14071220 0x7f5e14138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 0x7f5e141eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e1414bc80 0x7f5e141ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1413f800 con 0x7f5e140bcd20 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140be110 con 0x7f5e1414bc80 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e18ba0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141ea920 con 0x7f5e14071220 2023-05-24T04:00:27.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 0x7f5e141eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 0x7f5e141eac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48042/0 (socket says 172.21.15.40:48042) 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 -- 172.21.15.40:0/2710870823 learned_addr learned my addr 172.21.15.40:0/2710870823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e12d9d640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e1414bc80 0x7f5e141ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e1259c640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e14071220 0x7f5e14138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 -- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e14071220 msgr2=0x7f5e14138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e14071220 0x7f5e14138900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 -- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e1414bc80 msgr2=0x7f5e141ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e1414bc80 0x7f5e141ea3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.650+0000 7f5e11d9b640 1 -- 172.21.15.40:0/2710870823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040094d0 con 0x7f5e140bcd20 2023-05-24T04:00:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e11d9b640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 0x7f5e141eac00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800c7f0 tx=0x7f5e0800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08004220 con 0x7f5e140bcd20 2023-05-24T04:00:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08004380 con 0x7f5e140bcd20 2023-05-24T04:00:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1414cd50 con 0x7f5e140bcd20 2023-05-24T04:00:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08003860 con 0x7f5e140bcd20 2023-05-24T04:00:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1414c050 con 0x7f5e140bcd20 2023-05-24T04:00:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e141500d0 con 0x7f5e140bcd20 2023-05-24T04:00:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e080039c0 con 0x7f5e140bcd20 2023-05-24T04:00:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e02ffd640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5df4066280 0x7f5df4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e1259c640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5df4066280 0x7f5df4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e08083d20 con 0x7f5e140bcd20 2023-05-24T04:00:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.654+0000 7f5e1259c640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5df4066280 0x7f5df4068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e040ae000 tx=0x7f5e04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.658+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5e08050f40 con 0x7f5e140bcd20 2023-05-24T04:00:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e1404ddd0 con 0x7f5e140bcd20 2023-05-24T04:00:27.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e02ffd640 1 -- 172.21.15.40:0/2710870823 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e0801e0a0 con 0x7f5e140bcd20 2023-05-24T04:00:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:00:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5df4066280 msgr2=0x7f5df4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5df4066280 0x7f5df4068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e040ae000 tx=0x7f5e04008040 comp rx=0 tx=0).stop 2023-05-24T04:00:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 msgr2=0x7f5e141eac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 0x7f5e141eac00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800c7f0 tx=0x7f5e0800ccb0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 shutdown_connections 2023-05-24T04:00:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5df4066280 0x7f5df4068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e1414bc80 0x7f5e141ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e140bcd20 0x7f5e141eac00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 --2- 172.21.15.40:0/2710870823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5e14071220 0x7f5e14138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 >> 172.21.15.40:0/2710870823 conn(0x7f5e140c0310 msgr2=0x7f5e14147de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 shutdown_connections 2023-05-24T04:00:27.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.806+0000 7f5e18ba0640 1 -- 172.21.15.40:0/2710870823 wait complete. 2023-05-24T04:00:27.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:00:27.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.934+0000 7fa45499e640 1 Processor -- start 2023-05-24T04:00:27.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa45499e640 1 -- start start 2023-05-24T04:00:27.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa45499e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa45014c1b0 0x7fa450070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa45499e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4500bd4f0 0x7fa45006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa45499e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500be160 con 0x7fa450070fe0 2023-05-24T04:00:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa45499e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500be8c0 con 0x7fa4500bd4f0 2023-05-24T04:00:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa45499e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500a7ea0 con 0x7fa45014c1b0 2023-05-24T04:00:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa450070fe0 0x7fa45006e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45190/0 (socket says 172.21.15.40:45190) 2023-05-24T04:00:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44ed9d640 1 -- 172.21.15.40:0/2773774550 learned_addr learned my addr 172.21.15.40:0/2773774550 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/2773774550 >> v2:172.21.15.40:3300/0 conn(0x7fa4500bd4f0 0x7fa45006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44e59c640 1 --2- 172.21.15.40:0/2773774550 >> v2:172.21.15.67:3300/0 conn(0x7fa45014c1b0 0x7fa450070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44d59a640 1 -- 172.21.15.40:0/2773774550 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265220374 0 0) 0x7fa4480014a0 con 0x7fa450070fe0 2023-05-24T04:00:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44d59a640 1 -- 172.21.15.40:0/2773774550 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa438003530 con 0x7fa450070fe0 2023-05-24T04:00:27.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44dd9b640 1 -- 172.21.15.40:0/2773774550 >> v2:172.21.15.67:3300/0 conn(0x7fa45014c1b0 msgr2=0x7fa450070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:27.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/2773774550 >> v2:172.21.15.67:3300/0 conn(0x7fa45014c1b0 0x7fa450070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44dd9b640 1 -- 172.21.15.40:0/2773774550 >> v1:172.21.15.40:6789/0 conn(0x7fa450070fe0 legacy=0x7fa45006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44dd9b640 1 -- 172.21.15.40:0/2773774550 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45014c580 con 0x7fa4500bd4f0 2023-05-24T04:00:27.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/2773774550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4500bd4f0 0x7fa45006dee0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa4500662a0 tx=0x7fa44001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b626a6e46e95f395 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44d59a640 1 -- 172.21.15.40:0/2773774550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400ac620 con 0x7fa4500bd4f0 2023-05-24T04:00:27.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44d59a640 1 -- 172.21.15.40:0/2773774550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4400ac780 con 0x7fa4500bd4f0 2023-05-24T04:00:27.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.938+0000 7fa44d59a640 1 -- 172.21.15.40:0/2773774550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400acaf0 con 0x7fa4500bd4f0 2023-05-24T04:00:27.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/2773774550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4500bd4f0 msgr2=0x7fa45006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 --2- 172.21.15.40:0/2773774550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4500bd4f0 0x7fa45006dee0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa4500662a0 tx=0x7fa44001c3a0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/2773774550 shutdown_connections 2023-05-24T04:00:27.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 --2- 172.21.15.40:0/2773774550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4500bd4f0 0x7fa45006dee0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 --2- 172.21.15.40:0/2773774550 >> v2:172.21.15.67:3300/0 conn(0x7fa45014c1b0 0x7fa450070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/2773774550 >> 172.21.15.40:0/2773774550 conn(0x7fa4500c2540 msgr2=0x7fa4500c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:27.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/2773774550 shutdown_connections 2023-05-24T04:00:27.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/2773774550 wait complete. 2023-05-24T04:00:27.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 Processor -- start 2023-05-24T04:00:27.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- start start 2023-05-24T04:00:27.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 0x7fa45006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45014c1b0 0x7fa450144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa45006bb60 0x7fa4501ea640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500bc0e0 con 0x7fa450070fe0 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45006b880 con 0x7fa45014c1b0 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500bc330 con 0x7fa45006bb60 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 0x7fa45006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 0x7fa45006ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48056/0 (socket says 172.21.15.40:48056) 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 -- 172.21.15.40:0/1027167596 learned_addr learned my addr 172.21.15.40:0/1027167596 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44ed9d640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa45006bb60 0x7fa4501ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45014c1b0 0x7fa450144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 -- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa45006bb60 msgr2=0x7fa4501ea640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa45006bb60 0x7fa4501ea640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 -- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45014c1b0 msgr2=0x7fa450144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45014c1b0 0x7fa450144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 -- 172.21.15.40:0/1027167596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440009420 con 0x7fa450070fe0 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44ed9d640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa45006bb60 0x7fa4501ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45014c1b0 0x7fa450144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa44e59c640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 0x7fa45006ad30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d5f0 tx=0x7fa44400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440125f0 con 0x7fa450070fe0 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa444012750 con 0x7fa450070fe0 2023-05-24T04:00:27.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4500a55a0 con 0x7fa450070fe0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444012ae0 con 0x7fa450070fe0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.942+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4500a83f0 con 0x7fa450070fe0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.946+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4500a5730 con 0x7fa450070fe0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.946+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa444012c40 con 0x7fa450070fe0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.946+0000 7fa43effd640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa430066280 0x7fa430068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.946+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa444084de0 con 0x7fa450070fe0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.946+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa430066280 0x7fa430068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.946+0000 7fa44dd9b640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa430066280 0x7fa430068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4400ae000 tx=0x7fa4400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:27.950+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa444052050 con 0x7fa450070fe0 2023-05-24T04:00:28.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.098+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4500a5730 con 0x7fa450070fe0 2023-05-24T04:00:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa43effd640 1 -- 172.21.15.40:0/1027167596 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4500a5730 con 0x7fa450070fe0 2023-05-24T04:00:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa430066280 msgr2=0x7fa430068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa430066280 0x7fa430068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4400ae000 tx=0x7fa4400a7000 comp rx=0 tx=0).stop 2023-05-24T04:00:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 msgr2=0x7fa45006ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 0x7fa45006ad30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d5f0 tx=0x7fa44400dab0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 shutdown_connections 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa430066280 0x7fa430068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa45006bb60 0x7fa4501ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45014c1b0 0x7fa450144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 --2- 172.21.15.40:0/1027167596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa450070fe0 0x7fa45006ad30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 >> 172.21.15.40:0/1027167596 conn(0x7fa4500c2540 msgr2=0x7fa4500befc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 shutdown_connections 2023-05-24T04:00:28.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.102+0000 7fa45499e640 1 -- 172.21.15.40:0/1027167596 wait complete. 2023-05-24T04:00:28.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:00:28.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 Processor -- start 2023-05-24T04:00:28.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 -- start start 2023-05-24T04:00:28.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3a80bef60 0x7fb3a80c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a80a3da0 0x7fb3a80c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a806aa70 0x7fb3a806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80c4220 con 0x7fb3a80bef60 2023-05-24T04:00:28.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80b8040 con 0x7fb3a806aa70 2023-05-24T04:00:28.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3ad93e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b7df0 con 0x7fb3a80a3da0 2023-05-24T04:00:28.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3a80bef60 0x7fb3a80c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3a80bef60 0x7fb3a80c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48064/0 (socket says 172.21.15.40:48064) 2023-05-24T04:00:28.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 -- 172.21.15.40:0/3690135745 learned_addr learned my addr 172.21.15.40:0/3690135745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:28.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a77fe640 1 --2- 172.21.15.40:0/3690135745 >> v2:172.21.15.67:3300/0 conn(0x7fb3a806aa70 0x7fb3a806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a67fc640 1 --2- 172.21.15.40:0/3690135745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a80a3da0 0x7fb3a80c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 -- 172.21.15.40:0/3690135745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a80a3da0 msgr2=0x7fb3a80c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 --2- 172.21.15.40:0/3690135745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a80a3da0 0x7fb3a80c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 -- 172.21.15.40:0/3690135745 >> v2:172.21.15.67:3300/0 conn(0x7fb3a806aa70 msgr2=0x7fb3a806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 --2- 172.21.15.40:0/3690135745 >> v2:172.21.15.67:3300/0 conn(0x7fb3a806aa70 0x7fb3a806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a6ffd640 1 -- 172.21.15.40:0/3690135745 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80a38d0 con 0x7fb3a80bef60 2023-05-24T04:00:28.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.242+0000 7fb3a77fe640 1 --2- 172.21.15.40:0/3690135745 >> v2:172.21.15.67:3300/0 conn(0x7fb3a806aa70 0x7fb3a806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:28.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3a6ffd640 1 --2- 172.21.15.40:0/3690135745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80bef60 0x7fb3a80c11c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009e50 tx=0x7fb3a001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b542f5c429211dc6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3a5ffb640 1 -- 172.21.15.40:0/3690135745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00a57c0 con 0x7fb3a80bef60 2023-05-24T04:00:28.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3a5ffb640 1 -- 172.21.15.40:0/3690135745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a00a5920 con 0x7fb3a80bef60 2023-05-24T04:00:28.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3a5ffb640 1 -- 172.21.15.40:0/3690135745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00a5cb0 con 0x7fb3a80bef60 2023-05-24T04:00:28.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 -- 172.21.15.40:0/3690135745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80bef60 msgr2=0x7fb3a80c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/3690135745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80bef60 0x7fb3a80c11c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009e50 tx=0x7fb3a001c920 comp rx=0 tx=0).stop 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 -- 172.21.15.40:0/3690135745 shutdown_connections 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/3690135745 >> v2:172.21.15.67:3300/0 conn(0x7fb3a806aa70 0x7fb3a806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/3690135745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a80a3da0 0x7fb3a80c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/3690135745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80bef60 0x7fb3a80c11c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 -- 172.21.15.40:0/3690135745 >> 172.21.15.40:0/3690135745 conn(0x7fb3a8065bb0 msgr2=0x7fb3a80a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 -- 172.21.15.40:0/3690135745 shutdown_connections 2023-05-24T04:00:28.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 -- 172.21.15.40:0/3690135745 wait complete. 2023-05-24T04:00:28.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 Processor -- start 2023-05-24T04:00:28.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.246+0000 7fb3ad93e640 1 -- start start 2023-05-24T04:00:28.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a806aa70 0x7fb3a814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 0x7fb3a80b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a80bef60 0x7fb3a814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80a58b0 con 0x7fb3a80a3da0 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80baa90 con 0x7fb3a80bef60 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b9d60 con 0x7fb3a806aa70 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 0x7fb3a80b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 0x7fb3a80b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48070/0 (socket says 172.21.15.40:48070) 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 -- 172.21.15.40:0/1024070766 learned_addr learned my addr 172.21.15.40:0/1024070766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:28.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a77fe640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a80bef60 0x7fb3a814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a6ffd640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a806aa70 0x7fb3a814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 -- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a806aa70 msgr2=0x7fb3a814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a806aa70 0x7fb3a814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 -- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a80bef60 msgr2=0x7fb3a814a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a80bef60 0x7fb3a814a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 -- 172.21.15.40:0/1024070766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a0009b30 con 0x7fb3a80a3da0 2023-05-24T04:00:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a67fc640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 0x7fb3a80b73e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb39000c7f0 tx=0x7fb39000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390004220 con 0x7fb3a80a3da0 2023-05-24T04:00:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb390004380 con 0x7fb3a80a3da0 2023-05-24T04:00:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a80c3eb0 con 0x7fb3a80a3da0 2023-05-24T04:00:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390003840 con 0x7fb3a80a3da0 2023-05-24T04:00:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a80c2d00 con 0x7fb3a80a3da0 2023-05-24T04:00:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a80bb440 con 0x7fb3a80a3da0 2023-05-24T04:00:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb390003bb0 con 0x7fb3a80a3da0 2023-05-24T04:00:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb39ffff640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb388066280 0x7fb388068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb3a6ffd640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb388066280 0x7fb388068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.250+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb390083f60 con 0x7fb3a80a3da0 2023-05-24T04:00:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.254+0000 7fb3a6ffd640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb388066280 0x7fb388068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00ae000 tx=0x7fb3a00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.258+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb3900510f0 con 0x7fb3a80a3da0 2023-05-24T04:00:28.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.434+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3a80b9f20 con 0x7fb3a80a3da0 2023-05-24T04:00:28.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb39ffff640 1 -- 172.21.15.40:0/1024070766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3291 (secure 0 0 0) 0x7fb39001e090 con 0x7fb3a80a3da0 2023-05-24T04:00:28.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:19.661783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T04:00:28.442 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-05-24T04:00:28.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb388066280 msgr2=0x7fb388068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb388066280 0x7fb388068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00ae000 tx=0x7fb3a00a7070 comp rx=0 tx=0).stop 2023-05-24T04:00:28.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 msgr2=0x7fb3a80b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 0x7fb3a80b73e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb39000c7f0 tx=0x7fb39000ccb0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 shutdown_connections 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb388066280 0x7fb388068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a80bef60 0x7fb3a814a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3a80a3da0 0x7fb3a80b73e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 --2- 172.21.15.40:0/1024070766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a806aa70 0x7fb3a814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 >> 172.21.15.40:0/1024070766 conn(0x7fb3a8065bb0 msgr2=0x7fb3a80a4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:28.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 shutdown_connections 2023-05-24T04:00:28.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.438+0000 7fb3ad93e640 1 -- 172.21.15.40:0/1024070766 wait complete. 2023-05-24T04:00:28.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 Processor -- start 2023-05-24T04:00:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 -- start start 2023-05-24T04:00:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 0x7f67f8150300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f8146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f814c2b0 con 0x7f67f8146550 2023-05-24T04:00:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f814c580 con 0x7f67f80c1500 2023-05-24T04:00:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67fd54f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8150840 con 0x7f67f80b68c0 2023-05-24T04:00:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f8146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f6ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 0x7f67f8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f8146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:58554/0 (socket says 172.21.15.40:58554) 2023-05-24T04:00:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f6ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 0x7f67f8150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:53734/0 (socket says 172.21.15.40:53734) 2023-05-24T04:00:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 -- 172.21.15.40:0/406494832 learned_addr learned my addr 172.21.15.40:0/406494832 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f77fe640 1 --1- 172.21.15.40:0/406494832 >> v1:172.21.15.67:6789/0 conn(0x7f67f8146550 0x7f67f814ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:52904/0 (socket says 172.21.15.40:52904) 2023-05-24T04:00:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 -- 172.21.15.40:0/406494832 >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 msgr2=0x7f67f8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 --2- 172.21.15.40:0/406494832 >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 0x7f67f8150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 -- 172.21.15.40:0/406494832 >> v1:172.21.15.67:6789/0 conn(0x7f67f8146550 legacy=0x7f67f814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f67fc640 1 -- 172.21.15.40:0/406494832 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80b62b0 con 0x7f67f80b68c0 2023-05-24T04:00:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.562+0000 7f67f6ffd640 1 --2- 172.21.15.40:0/406494832 >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 0x7f67f8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 --2- 172.21.15.40:0/406494832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f8146010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009870 tx=0x7f67ec01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9db980b984ba840 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f5ffb640 1 -- 172.21.15.40:0/406494832 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0a6040 con 0x7f67f80b68c0 2023-05-24T04:00:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f5ffb640 1 -- 172.21.15.40:0/406494832 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0aa400 con 0x7f67f80b68c0 2023-05-24T04:00:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f5ffb640 1 -- 172.21.15.40:0/406494832 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0aa790 con 0x7f67f80b68c0 2023-05-24T04:00:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- 172.21.15.40:0/406494832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 msgr2=0x7f67f8146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 --2- 172.21.15.40:0/406494832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f8146010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009870 tx=0x7f67ec01c540 comp rx=0 tx=0).stop 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- 172.21.15.40:0/406494832 shutdown_connections 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 --2- 172.21.15.40:0/406494832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f8146010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 --2- 172.21.15.40:0/406494832 >> v2:172.21.15.67:3300/0 conn(0x7f67f80c1500 0x7f67f8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- 172.21.15.40:0/406494832 >> 172.21.15.40:0/406494832 conn(0x7f67f806a670 msgr2=0x7f67f80c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- 172.21.15.40:0/406494832 shutdown_connections 2023-05-24T04:00:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- 172.21.15.40:0/406494832 wait complete. 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 Processor -- start 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- start start 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f81500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 0x7f67f80b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f8146550 0x7f67f813af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8142280 con 0x7f67f80c1500 2023-05-24T04:00:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81e1ad0 con 0x7f67f8146550 2023-05-24T04:00:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67fd54f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8141d60 con 0x7f67f80b68c0 2023-05-24T04:00:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 0x7f67f80b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 0x7f67f80b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48080/0 (socket says 172.21.15.40:48080) 2023-05-24T04:00:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 -- 172.21.15.40:0/1987499108 learned_addr learned my addr 172.21.15.40:0/1987499108 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f6ffd640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f81500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f77fe640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f8146550 0x7f67f813af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 -- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 msgr2=0x7f67f81500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f81500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 -- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f8146550 msgr2=0x7f67f813af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.566+0000 7f67f67fc640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f8146550 0x7f67f813af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67f67fc640 1 -- 172.21.15.40:0/1987499108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e800d850 con 0x7f67f80c1500 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67f67fc640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 0x7f67f80b7580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f67ec01cde0 tx=0x7f67ec01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0bd5f0 con 0x7f67f80c1500 2023-05-24T04:00:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0bd770 con 0x7f67f80c1500 2023-05-24T04:00:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec0094d0 con 0x7f67f80c1500 2023-05-24T04:00:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0bdb20 con 0x7f67f80c1500 2023-05-24T04:00:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f814d120 con 0x7f67f80c1500 2023-05-24T04:00:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f80b6d30 con 0x7f67f80c1500 2023-05-24T04:00:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67ec0b33f0 con 0x7f67f80c1500 2023-05-24T04:00:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67df7fe640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67e40662b0 0x7f67e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f67ec11e4a0 con 0x7f67f80c1500 2023-05-24T04:00:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67f6ffd640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67e40662b0 0x7f67e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.570+0000 7f67f6ffd640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67e40662b0 0x7f67e4068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e800dce0 tx=0x7f67e800f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.574+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f67ec0eb740 con 0x7f67f80c1500 2023-05-24T04:00:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.722+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67f80674e0 con 0x7f67f80c1500 2023-05-24T04:00:28.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67df7fe640 1 -- 172.21.15.40:0/1987499108 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f67ec0eed60 con 0x7f67f80c1500 2023-05-24T04:00:28.734 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:02.317023+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67e40662b0 msgr2=0x7f67e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67e40662b0 0x7f67e4068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e800dce0 tx=0x7f67e800f040 comp rx=0 tx=0).stop 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 msgr2=0x7f67f80b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 0x7f67f80b7580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f67ec01cde0 tx=0x7f67ec01ad80 comp rx=0 tx=0).stop 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 shutdown_connections 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67e40662b0 0x7f67e4068760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f8146550 0x7f67f813af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f80c1500 0x7f67f80b7580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 --2- 172.21.15.40:0/1987499108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f80b68c0 0x7f67f81500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 >> 172.21.15.40:0/1987499108 conn(0x7f67f806a670 msgr2=0x7f67f80bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 shutdown_connections 2023-05-24T04:00:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.730+0000 7f67fd54f640 1 -- 172.21.15.40:0/1987499108 wait complete. 2023-05-24T04:00:28.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:00:28.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 Processor -- start 2023-05-24T04:00:28.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 -- start start 2023-05-24T04:00:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 0x7ff2b40c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2b40a3da0 0x7ff2b40c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40b8040 con 0x7ff2b406aa70 2023-05-24T04:00:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40c4220 con 0x7ff2b40a3da0 2023-05-24T04:00:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ba949640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b7df0 con 0x7ff2b40bef60 2023-05-24T04:00:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b8ee6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff2b406aa70 0x7ff2b406af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45202/0 (socket says 172.21.15.40:45202) 2023-05-24T04:00:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b8ee6640 1 -- 172.21.15.40:0/3510045443 learned_addr learned my addr 172.21.15.40:0/3510045443 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158247692 0 0) 0x7ff2ac0014a0 con 0x7ff2b406aa70 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ab7fe640 1 --2- 172.21.15.40:0/3510045443 >> v2:172.21.15.67:3300/0 conn(0x7ff2b40a3da0 0x7ff2b40c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a0003530 con 0x7ff2b406aa70 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b3fff640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 0x7ff2b40c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793180565 0 0) 0x7ff2a0003530 con 0x7ff2b406aa70 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 msgr2=0x7ff2b40c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 0x7ff2b40c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 >> v2:172.21.15.67:3300/0 conn(0x7ff2b40a3da0 msgr2=0x7ff2b40c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 --2- 172.21.15.40:0/3510045443 >> v2:172.21.15.67:3300/0 conn(0x7ff2b40a3da0 0x7ff2b40c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40a38d0 con 0x7ff2b406aa70 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7ff2ac001b90 con 0x7ff2b406aa70 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 >> v1:172.21.15.40:6789/0 conn(0x7ff2b406aa70 legacy=0x7ff2b406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 0x7ff2a0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2a0003fb0 0x7ff2a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c4220 con 0x7ff2a0004d10 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b7df0 con 0x7ff2a0003fb0 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a000bb20 con 0x7ff2b40bef60 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.862+0000 7ff2ab7fe640 1 --2- 172.21.15.40:0/3510045443 >> v2:172.21.15.67:3300/0 conn(0x7ff2b40a3da0 0x7ff2b40c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b3fff640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 0x7ff2a0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ab7fe640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2a0003fb0 0x7ff2a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 -- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 msgr2=0x7ff2a0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40bef60 0x7ff2a0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 -- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2a0003fb0 msgr2=0x7ff2a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2a0003fb0 0x7ff2a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 -- 172.21.15.40:0/3510045443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0003530 con 0x7ff2a0004d10 2023-05-24T04:00:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00a7e0 tx=0x7ff2ac01fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d949f8efa9c9beb server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0aa670 con 0x7ff2a0004d10 2023-05-24T04:00:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0aa7f0 con 0x7ff2a0004d10 2023-05-24T04:00:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b37fe640 1 -- 172.21.15.40:0/3510045443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0aabe0 con 0x7ff2a0004d10 2023-05-24T04:00:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ba949640 1 -- 172.21.15.40:0/3510045443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a0004d10 msgr2=0x7ff2a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ba949640 1 --2- 172.21.15.40:0/3510045443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00a7e0 tx=0x7ff2ac01fa40 comp rx=0 tx=0).stop 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2b8ee6640 1 -- 172.21.15.40:0/3510045443 reap_dead start 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ba949640 1 -- 172.21.15.40:0/3510045443 shutdown_connections 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ba949640 1 -- 172.21.15.40:0/3510045443 >> 172.21.15.40:0/3510045443 conn(0x7ff2b4065bb0 msgr2=0x7ff2b40a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ba949640 1 -- 172.21.15.40:0/3510045443 shutdown_connections 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.866+0000 7ff2ba949640 1 -- 172.21.15.40:0/3510045443 wait complete. 2023-05-24T04:00:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 Processor -- start 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- start start 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40b9e80 0x7ff2b40a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 0x7ff2b40b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b40a8350 0x7ff2b40b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c1760 con 0x7ff2b40a76a0 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40aa090 con 0x7ff2b40a8350 2023-05-24T04:00:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c19b0 con 0x7ff2b40b9e80 2023-05-24T04:00:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 0x7ff2b40b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 0x7ff2b40b81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48096/0 (socket says 172.21.15.40:48096) 2023-05-24T04:00:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 -- 172.21.15.40:0/689707149 learned_addr learned my addr 172.21.15.40:0/689707149 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b3fff640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40b9e80 0x7ff2b40a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b8ee6640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b40a8350 0x7ff2b40b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 -- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40b9e80 msgr2=0x7ff2b40a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40b9e80 0x7ff2b40a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 -- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b40a8350 msgr2=0x7ff2b40b8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b40a8350 0x7ff2b40b8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 -- 172.21.15.40:0/689707149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40c2d00 con 0x7ff2b40a76a0 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ab7fe640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 0x7ff2b40b81e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff29c010890 tx=0x7ff29c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00cb40 con 0x7ff2b40a76a0 2023-05-24T04:00:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00cca0 con 0x7ff2b40a76a0 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40bf6f0 con 0x7ff2b40a76a0 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c015690 con 0x7ff2b40a76a0 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b40c3eb0 con 0x7ff2b40a76a0 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b40be180 con 0x7ff2b40a76a0 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff29c0157f0 con 0x7ff2b40a76a0 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.870+0000 7ff2b17fa640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff2940662b0 0x7ff294068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.874+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff29c084520 con 0x7ff2b40a76a0 2023-05-24T04:00:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.874+0000 7ff2b3fff640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff2940662b0 0x7ff294068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.874+0000 7ff2b3fff640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff2940662b0 0x7ff294068760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400b810 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:28.878+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff29c0516b0 con 0x7ff2b40a76a0 2023-05-24T04:00:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2b404ddd0 con 0x7ff2b40a76a0 2023-05-24T04:00:29.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2b17fa640 1 -- 172.21.15.40:0/689707149 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3291 (secure 0 0 0) 0x7ff29c054cd0 con 0x7ff2b40a76a0 2023-05-24T04:00:29.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:19.661783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T04:00:29.068 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-05-24T04:00:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff2940662b0 msgr2=0x7ff294068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff2940662b0 0x7ff294068760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400b810 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2023-05-24T04:00:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 msgr2=0x7ff2b40b81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 0x7ff2b40b81e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff29c010890 tx=0x7ff29c010d50 comp rx=0 tx=0).stop 2023-05-24T04:00:29.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 shutdown_connections 2023-05-24T04:00:29.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff2940662b0 0x7ff294068760 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b40a8350 0x7ff2b40b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b40a76a0 0x7ff2b40b81e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 --2- 172.21.15.40:0/689707149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2b40b9e80 0x7ff2b40a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 >> 172.21.15.40:0/689707149 conn(0x7ff2b4065bb0 msgr2=0x7ff2b40c0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 shutdown_connections 2023-05-24T04:00:29.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.062+0000 7ff2ba949640 1 -- 172.21.15.40:0/689707149 wait complete. 2023-05-24T04:00:29.285 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-24T03:59:57.892410+0000', 'modified': '2023-05-24T04:00:19.661783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6833/3554538206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 3554538206}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 3554538206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-24T04:00:29.285 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-24T04:00:29.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-24T04:00:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59f49f640 1 Processor -- start 2023-05-24T04:00:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59f49f640 1 -- start start 2023-05-24T04:00:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59f49f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5980a3290 0x7fd598071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59f49f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59814b240 con 0x7fd59814bfe0 2023-05-24T04:00:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59f49f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59806ea20 con 0x7fd59814aa30 2023-05-24T04:00:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59f49f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd598071d50 con 0x7fd5980a3290 2023-05-24T04:00:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59da3c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd59814bfe0 0x7fd59806ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45206/0 (socket says 172.21.15.40:45206) 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59da3c640 1 -- 172.21.15.40:0/3031837818 learned_addr learned my addr 172.21.15.40:0/3031837818 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3031837818 >> v2:172.21.15.67:3300/0 conn(0x7fd5980a3290 0x7fd598071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032044867 0 0) 0x7fd59814b240 con 0x7fd59814bfe0 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd584003530 con 0x7fd59814bfe0 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451594738 0 0) 0x7fd584003530 con 0x7fd59814bfe0 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 >> v2:172.21.15.67:3300/0 conn(0x7fd5980a3290 msgr2=0x7fd598071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 --2- 172.21.15.40:0/3031837818 >> v2:172.21.15.67:3300/0 conn(0x7fd5980a3290 0x7fd598071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 >> v1:172.21.15.67:6789/0 conn(0x7fd59814aa30 legacy=0x7fd598071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59806bfa0 con 0x7fd59814bfe0 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fd590001a00 con 0x7fd59814bfe0 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 >> v1:172.21.15.40:6789/0 conn(0x7fd59814bfe0 legacy=0x7fd59806ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd584003980 0x7fd584003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5840047d0 0x7fd584004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd584005180 0x7fd58400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598071d50 con 0x7fd584003980 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58400c000 con 0x7fd5840047d0 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58400c1c0 con 0x7fd584005180 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd584003980 0x7fd584003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5840047d0 0x7fd584004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd584005180 0x7fd58400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59d23b640 1 -- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd584005180 msgr2=0x7fd58400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd584005180 0x7fd58400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59d23b640 1 -- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5840047d0 msgr2=0x7fd584004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5840047d0 0x7fd584004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59d23b640 1 -- 172.21.15.40:0/3031837818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584003530 con 0x7fd584003980 2023-05-24T04:00:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.410+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd584005180 0x7fd58400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59da3c640 1 -- 172.21.15.40:0/3031837818 reap_dead start 2023-05-24T04:00:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd584003980 0x7fd584003d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd594001780 tx=0x7fd59401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563aa670f0214eb6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940052d0 con 0x7fd584003980 2023-05-24T04:00:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5940a7050 con 0x7fd584003980 2023-05-24T04:00:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd58ffff640 1 -- 172.21.15.40:0/3031837818 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594003600 con 0x7fd584003980 2023-05-24T04:00:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 -- 172.21.15.40:0/3031837818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd584003980 msgr2=0x7fd584003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd584003980 0x7fd584003d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd594001780 tx=0x7fd59401c3e0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 -- 172.21.15.40:0/3031837818 shutdown_connections 2023-05-24T04:00:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3031837818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd584003980 0x7fd584003d90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 -- 172.21.15.40:0/3031837818 >> 172.21.15.40:0/3031837818 conn(0x7fd5980c0280 msgr2=0x7fd5980c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 -- 172.21.15.40:0/3031837818 shutdown_connections 2023-05-24T04:00:29.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 -- 172.21.15.40:0/3031837818 wait complete. 2023-05-24T04:00:29.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.414+0000 7fd59f49f640 1 Processor -- start 2023-05-24T04:00:29.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 -- start start 2023-05-24T04:00:29.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd584003980 0x7fd5980bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59813eac0 0x7fd59814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 0x7fd59814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59813e3e0 con 0x7fd59813e570 2023-05-24T04:00:29.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598147670 con 0x7fd584003980 2023-05-24T04:00:29.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981e9ae0 con 0x7fd59813eac0 2023-05-24T04:00:29.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 0x7fd59814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 0x7fd59814e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48118/0 (socket says 172.21.15.40:48118) 2023-05-24T04:00:29.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 -- 172.21.15.40:0/3724814686 learned_addr learned my addr 172.21.15.40:0/3724814686 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59813eac0 0x7fd59814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd584003980 0x7fd5980bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 -- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59813eac0 msgr2=0x7fd59814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59813eac0 0x7fd59814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 -- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd584003980 msgr2=0x7fd5980bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd584003980 0x7fd5980bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 -- 172.21.15.40:0/3724814686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598071aa0 con 0x7fd59813e570 2023-05-24T04:00:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59813eac0 0x7fd59814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 0x7fd59814e170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd590001590 tx=0x7fd59000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd58dffb640 1 -- 172.21.15.40:0/3724814686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590007070 con 0x7fd59813e570 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd58dffb640 1 -- 172.21.15.40:0/3724814686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5900071d0 con 0x7fd59813e570 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd598071910 con 0x7fd59813e570 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd58dffb640 1 -- 172.21.15.40:0/3724814686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590007560 con 0x7fd59813e570 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59806ef40 con 0x7fd59813e570 2023-05-24T04:00:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd58dffb640 1 -- 172.21.15.40:0/3724814686 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5900076c0 con 0x7fd59813e570 2023-05-24T04:00:29.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd58dffb640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd57c066280 0x7fd57c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd58dffb640 1 -- 172.21.15.40:0/3724814686 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd590083aa0 con 0x7fd59813e570 2023-05-24T04:00:29.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.418+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd57c066280 0x7fd57c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd57c066280 0x7fd57c068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd594001750 tx=0x7fd5940011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 Processor -- start 2023-05-24T04:00:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- start start 2023-05-24T04:00:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c5c80 0x559d722c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 0x559d722c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d7218dc30 con 0x559d722c6590 2023-05-24T04:00:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d720c7e20 con 0x559d722c6ea0 2023-05-24T04:00:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d7211b4f0 con 0x559d722c5c80 2023-05-24T04:00:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 0x559d722c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 0x559d722c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48132/0 (socket says 172.21.15.40:48132) 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 -- 172.21.15.40:0/1386669497 learned_addr learned my addr 172.21.15.40:0/1386669497 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59da3c640 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59d23b640 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c5c80 0x559d722c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 -- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c5c80 msgr2=0x559d722c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c5c80 0x559d722c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 -- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 msgr2=0x559d723095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 -- 172.21.15.40:0/1386669497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d720d9530 con 0x559d722c6590 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 0x559d722c6960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd588009a90 tx=0x7fd588009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c3723645f14b8a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd582ffd640 1 -- 172.21.15.40:0/1386669497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588006be0 con 0x559d722c6590 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd582ffd640 1 -- 172.21.15.40:0/1386669497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588012e40 con 0x559d722c6590 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd582ffd640 1 -- 172.21.15.40:0/1386669497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588015650 con 0x559d722c6590 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- 172.21.15.40:0/1386669497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 msgr2=0x559d722c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 0x559d722c6960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd588009a90 tx=0x7fd588009190 comp rx=0 tx=0).stop 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- 172.21.15.40:0/1386669497 shutdown_connections 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c6590 0x559d722c6960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/1386669497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c5c80 0x559d722c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- 172.21.15.40:0/1386669497 >> 172.21.15.40:0/1386669497 conn(0x559d722c2180 msgr2=0x559d722c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- 172.21.15.40:0/1386669497 shutdown_connections 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- 172.21.15.40:0/1386669497 wait complete. 2023-05-24T04:00:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- start start 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 Processor -- start 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d72114590 con 0x559d722c5c80 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d720d11c0 con 0x559d722c6ea0 2023-05-24T04:00:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d720d0e60 con 0x559d722c6590 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd5a25c4000 10 client.0 _ll_register_callbacks cb 0x559d722b1790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59d23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.422+0000 7fd59d23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48148/0 (socket says 172.21.15.40:48148) 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 -- 172.21.15.40:0/3226930145 learned_addr learned my addr 172.21.15.40:0/3226930145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 -- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 msgr2=0x559d722ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 -- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 msgr2=0x559d723002f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723002f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 -- 172.21.15.40:0/3226930145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5880096c0 con 0x559d722c5c80 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722cc070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd59401c8c0 tx=0x7fd594019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d236a628badc929 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 1 -- 172.21.15.40:0/3226930145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940069e0 con 0x559d722c5c80 2023-05-24T04:00:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 1 -- 172.21.15.40:0/3226930145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd594006b40 con 0x559d722c5c80 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d720e3e40 con 0x559d722c5c80 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 1 -- 172.21.15.40:0/3226930145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd594006d00 con 0x559d722c5c80 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 10 client.4797 fetch_fsmap learned FSMap version 8 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x559d71e10890 con 0x559d722c5c80 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 1 -- 172.21.15.40:0/3226930145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d720e3e40 con 0x559d722c5c80 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 1 -- 172.21.15.40:0/3226930145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 2152+0+0 (secure 0 0 0) 0x7fd5940c1070 con 0x559d722c5c80 2023-05-24T04:00:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 10 client.4797 fetch_fsmap finished waiting for FSMap version 8 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 10 client.4797 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 20 client.4797 populate_metadata read hostname 'smithi040' 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d722fec80 0x559d722ff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 4 client.4797 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 --> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d72144210 con 0x559d722fec80 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d722fec80 0x559d722ff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d722fec80 0x559d722ff050 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cec81118269f4f0 server_cookie=e6259911c435f1c4 in_seq=0 out_seq=0 2023-05-24T04:00:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 10 client.4797 ms_handle_connect on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 1 -- 172.21.15.40:0/3226930145 <== mds.0 v2:172.21.15.67:6832/3554538206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559d72144210 con 0x559d722fec80 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 10 client.4797 handle_command_reply: tid=0 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 client.4797 shutdown 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 msgr2=0x559d722cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722cc070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd59401c8c0 tx=0x7fd594019180 comp rx=0 tx=0).stop 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 shutdown_connections 2023-05-24T04:00:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d722fec80 0x559d722ff050 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d723002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3226930145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722cc070 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd577fff640 0 client.4797 ms_handle_reset on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 >> 172.21.15.40:0/3226930145 conn(0x559d722c2180 msgr2=0x559d722c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 shutdown_connections 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3226930145 wait complete. 2023-05-24T04:00:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.426+0000 7fd5a25c4000 20 client.4797 trim_cache size 0 max 16384 2023-05-24T04:00:29.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 Processor -- start 2023-05-24T04:00:29.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 -- start start 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722fd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d722fd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d71dd1940 con 0x559d722c5c80 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d720de740 con 0x559d722c6ea0 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d71e111b0 con 0x559d722c6590 2023-05-24T04:00:29.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48162/0 (socket says 172.21.15.40:48162) 2023-05-24T04:00:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 -- 172.21.15.40:0/3391972889 learned_addr learned my addr 172.21.15.40:0/3391972889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 -- 172.21.15.40:0/3391972889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 msgr2=0x559d722fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 -- 172.21.15.40:0/3391972889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 msgr2=0x559d722fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d722fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.442+0000 7fd59d23b640 1 -- 172.21.15.40:0/3391972889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d720d97e0 con 0x559d722c5c80 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722fcdc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd59401cc80 tx=0x7fd5940ba070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93aa7d51ed6b92b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5837fe640 1 -- 172.21.15.40:0/3391972889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940067e0 con 0x559d722c5c80 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5837fe640 1 -- 172.21.15.40:0/3391972889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5940be040 con 0x559d722c5c80 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5837fe640 1 -- 172.21.15.40:0/3391972889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594006b40 con 0x559d722c5c80 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3391972889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 msgr2=0x559d722fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722fcdc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd59401cc80 tx=0x7fd5940ba070 comp rx=0 tx=0).stop 2023-05-24T04:00:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3391972889 shutdown_connections 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6ea0 0x559d722fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6590 0x559d722fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3391972889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d722fcdc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3391972889 >> 172.21.15.40:0/3391972889 conn(0x559d722c2180 msgr2=0x559d722c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3391972889 shutdown_connections 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3391972889 wait complete. 2023-05-24T04:00:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- start start 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 Processor -- start 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d7232a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6590 0x559d7232ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6ea0 0x559d7232b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d72111da0 con 0x559d722c5c80 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d720d6240 con 0x559d722c6590 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d720db790 con 0x559d722c6ea0 2023-05-24T04:00:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 10 client.0 _ll_register_callbacks cb 0x559d720b44c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T04:00:29.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d7232a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d7232a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48168/0 (socket says 172.21.15.40:48168) 2023-05-24T04:00:29.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 -- 172.21.15.40:0/3441125256 learned_addr learned my addr 172.21.15.40:0/3441125256 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:29.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6590 0x559d7232ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 -- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6ea0 msgr2=0x559d7232b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59da3c640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6ea0 0x559d7232b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6ea0 0x559d7232b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 -- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6590 msgr2=0x559d7232ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6590 0x559d7232ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 -- 172.21.15.40:0/3441125256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d71e10890 con 0x559d722c5c80 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6590 0x559d7232ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:29.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59d23b640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d7232a750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd59401c950 tx=0x7fd594007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b642ed946eee7292 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd577fff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd577fff640 1 -- 172.21.15.40:0/3441125256 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940d7070 con 0x559d722c5c80 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd577fff640 1 -- 172.21.15.40:0/3441125256 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd594003810 con 0x559d722c5c80 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d720e3a70 con 0x559d722c5c80 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd577fff640 1 -- 172.21.15.40:0/3441125256 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5940039d0 con 0x559d722c5c80 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 10 client.4803 fetch_fsmap learned FSMap version 8 2023-05-24T04:00:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x559d720bf060 con 0x559d722c5c80 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd577fff640 1 -- 172.21.15.40:0/3441125256 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d720e3a70 con 0x559d722c5c80 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd577fff640 1 -- 172.21.15.40:0/3441125256 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 2152+0+0 (secure 0 0 0) 0x7fd5940da020 con 0x559d722c5c80 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 10 client.4803 fetch_fsmap finished waiting for FSMap version 8 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 10 client.4803 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 20 client.4803 populate_metadata read hostname 'smithi040' 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d72318340 0x559d72318710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 4 client.4803 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-05-24T04:00:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 --> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d7210d570 con 0x559d72318340 2023-05-24T04:00:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.446+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d72318340 0x559d72318710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd577fff640 10 client.4803 ms_handle_connect on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59ca3a640 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d72318340 0x559d72318710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d9eb405a600304e server_cookie=a38b8c562f2947ce in_seq=0 out_seq=0 2023-05-24T04:00:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd577fff640 1 -- 172.21.15.40:0/3441125256 <== mds.0 v2:172.21.15.67:6832/3554538206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x559d7210d570 con 0x559d72318340 2023-05-24T04:00:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd577fff640 10 client.4803 handle_command_reply: tid=0 2023-05-24T04:00:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 client.4803 shutdown 2023-05-24T04:00:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 msgr2=0x559d7232a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d7232a750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd59401c950 tx=0x7fd594007c90 comp rx=0 tx=0).stop 2023-05-24T04:00:29.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 shutdown_connections 2023-05-24T04:00:29.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:6832/3554538206,v1:172.21.15.67:6833/3554538206] conn(0x559d72318340 0x559d72318710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559d722c6ea0 0x559d7232b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559d722c6590 0x559d7232ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd577fff640 0 client.4803 ms_handle_reset on v2:172.21.15.67:6832/3554538206 2023-05-24T04:00:29.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 --2- 172.21.15.40:0/3441125256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559d722c5c80 0x559d7232a750 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 >> 172.21.15.40:0/3441125256 conn(0x559d722c2180 msgr2=0x559d722ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 shutdown_connections 2023-05-24T04:00:29.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 1 -- 172.21.15.40:0/3441125256 wait complete. 2023-05-24T04:00:29.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd5a25c4000 20 client.4803 trim_cache size 0 max 16384 2023-05-24T04:00:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:00:29.469 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "b4b82cba-0383-492a-85bf-0de09746a380", 2023-05-24T04:00:29.470 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-05-24T04:00:29.470 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4279, 2023-05-24T04:00:29.470 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-05-24T04:00:29.470 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-05-24T04:00:29.471 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-05-24T04:00:29.471 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 31.553781797999999, 2023-05-24T04:00:29.471 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2023-05-24T04:00:29.472 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 27, 2023-05-24T04:00:29.472 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 27, 2023-05-24T04:00:29.472 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 35.857504394999999 2023-05-24T04:00:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:00:29.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd57c066280 msgr2=0x7fd57c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd57c066280 0x7fd57c068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd594001750 tx=0x7fd5940011a0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 msgr2=0x7fd59814e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 0x7fd59814e170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd590001590 tx=0x7fd59000dd10 comp rx=0 tx=0).stop 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 shutdown_connections 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd57c066280 0x7fd57c068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd59813e570 0x7fd59814e170 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59813eac0 0x7fd59814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 --2- 172.21.15.40:0/3724814686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd584003980 0x7fd5980bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:29.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 >> 172.21.15.40:0/3724814686 conn(0x7fd5980c0280 msgr2=0x7fd598149050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:29.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 shutdown_connections 2023-05-24T04:00:29.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:29.450+0000 7fd59f49f640 1 -- 172.21.15.40:0/3724814686 wait complete. 2023-05-24T04:00:29.477 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-24T04:00:29.487 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-24T04:00:29.487 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}, 'client.2': {}} 2023-05-24T04:00:29.488 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-24T04:00:29.488 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T04:00:29.488 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:29.489 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-24T04:00:29.489 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T04:00:29.489 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:29.489 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-24T04:00:29.489 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T04:00:29.490 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:29.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.490 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-05-24T04:00:29.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.497 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-05-24T04:00:29.558 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-05-24T04:00:29.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:00:29.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.560 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-05-24T04:00:29.567 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-24T04:00:29.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-24T04:00:29.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2023-05-24T04:00:29.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.822 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-05-24T04:00:29.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:29.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-05-24T04:00:29.889 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-05-24T04:00:29.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:00:29.890 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-24T04:00:29.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T04:00:30.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.022+0000 7f0766189640 1 Processor -- start 2023-05-24T04:00:30.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.022+0000 7f0766189640 1 -- start start 2023-05-24T04:00:30.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f0766189640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f076014aa30 0x7f0760071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f0766189640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07600a3290 0x7f0760071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f0766189640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076014b240 con 0x7f076014bfe0 2023-05-24T04:00:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f0766189640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076006e810 con 0x7f076014aa30 2023-05-24T04:00:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f0766189640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076006ea20 con 0x7f07600a3290 2023-05-24T04:00:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075effd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07600a3290 0x7f0760071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f076014aa30 0x7f0760071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:30.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f076014bfe0 0x7f076006ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:52918/0 (socket says 172.21.15.40:52918) 2023-05-24T04:00:30.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075ffff640 1 -- 172.21.15.40:0/3483984744 learned_addr learned my addr 172.21.15.40:0/3483984744 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:30.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075f7fe640 1 -- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07600a3290 msgr2=0x7f0760071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:30.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075f7fe640 1 --2- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07600a3290 0x7f0760071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075f7fe640 1 -- 172.21.15.40:0/3483984744 >> v1:172.21.15.67:6789/0 conn(0x7f076014bfe0 legacy=0x7f076006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:30.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075f7fe640 1 -- 172.21.15.40:0/3483984744 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076006bfa0 con 0x7f076014aa30 2023-05-24T04:00:30.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.026+0000 7f075f7fe640 1 --2- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014aa30 0x7f0760071100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f075000ba60 tx=0x7f075001eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=534c4e57a026c7d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:30.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075e7fc640 1 -- 172.21.15.40:0/3483984744 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500a7a30 con 0x7f076014aa30 2023-05-24T04:00:30.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075e7fc640 1 -- 172.21.15.40:0/3483984744 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500a7b90 con 0x7f076014aa30 2023-05-24T04:00:30.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075e7fc640 1 -- 172.21.15.40:0/3483984744 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500af440 con 0x7f076014aa30 2023-05-24T04:00:30.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014aa30 msgr2=0x7f0760071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:30.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 --2- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014aa30 0x7f0760071100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f075000ba60 tx=0x7f075001eb50 comp rx=0 tx=0).stop 2023-05-24T04:00:30.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/3483984744 shutdown_connections 2023-05-24T04:00:30.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 --2- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07600a3290 0x7f0760071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 --2- 172.21.15.40:0/3483984744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014aa30 0x7f0760071100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/3483984744 >> 172.21.15.40:0/3483984744 conn(0x7f07600c0280 msgr2=0x7f07600c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/3483984744 shutdown_connections 2023-05-24T04:00:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/3483984744 wait complete. 2023-05-24T04:00:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 Processor -- start 2023-05-24T04:00:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- start start 2023-05-24T04:00:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 0x7f07600a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014bfe0 0x7f07600be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07601ee9d0 0x7f07601eb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07601eeef0 con 0x7f076014aa30 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07601eaa50 con 0x7f076014bfe0 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07601eafd0 con 0x7f07601ee9d0 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 0x7f07600a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 0x7f07600a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48176/0 (socket says 172.21.15.40:48176) 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 -- 172.21.15.40:0/4121775395 learned_addr learned my addr 172.21.15.40:0/4121775395 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075ffff640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07601ee9d0 0x7f07601eb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075effd640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014bfe0 0x7f07600be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 -- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07601ee9d0 msgr2=0x7f07601eb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07601ee9d0 0x7f07601eb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 -- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014bfe0 msgr2=0x7f07600be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014bfe0 0x7f07600be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 -- 172.21.15.40:0/4121775395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075000b6c0 con 0x7f076014aa30 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075ffff640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07601ee9d0 0x7f07601eb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f075f7fe640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 0x7f07600a3ca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f075000ba60 tx=0x7f075001b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:30.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500afdd0 con 0x7f076014aa30 2023-05-24T04:00:30.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500b9440 con 0x7f076014aa30 2023-05-24T04:00:30.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076014af90 con 0x7f076014aa30 2023-05-24T04:00:30.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500b97f0 con 0x7f076014aa30 2023-05-24T04:00:30.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.030+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076014ae00 con 0x7f076014aa30 2023-05-24T04:00:30.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.034+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076006cb60 con 0x7f076014aa30 2023-05-24T04:00:30.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.034+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07500b9950 con 0x7f076014aa30 2023-05-24T04:00:30.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.034+0000 7f0747fff640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f074c0662b0 0x7f074c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:30.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.034+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f075011f230 con 0x7f076014aa30 2023-05-24T04:00:30.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.034+0000 7f075effd640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f074c0662b0 0x7f074c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:30.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.034+0000 7f075effd640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f074c0662b0 0x7f074c068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f076014a300 tx=0x7f0754008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:30.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.038+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f07500ec480 con 0x7f076014aa30 2023-05-24T04:00:30.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.226+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f076004ddd0 con 0x7f076014aa30 2023-05-24T04:00:30.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.226+0000 7f0747fff640 1 -- 172.21.15.40:0/4121775395 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f07500efaa0 con 0x7f076014aa30 2023-05-24T04:00:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T04:00:30.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f074c0662b0 msgr2=0x7f074c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:30.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f074c0662b0 0x7f074c068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f076014a300 tx=0x7f0754008040 comp rx=0 tx=0).stop 2023-05-24T04:00:30.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 msgr2=0x7f07600a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:30.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 0x7f07600a3ca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f075000ba60 tx=0x7f075001b8f0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 shutdown_connections 2023-05-24T04:00:30.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f074c0662b0 0x7f074c068760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07601ee9d0 0x7f07601eb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076014bfe0 0x7f07600be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 --2- 172.21.15.40:0/4121775395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f076014aa30 0x7f07600a3ca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:30.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 >> 172.21.15.40:0/4121775395 conn(0x7f07600c0280 msgr2=0x7f07600c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:30.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 shutdown_connections 2023-05-24T04:00:30.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:30.230+0000 7f0766189640 1 -- 172.21.15.40:0/4121775395 wait complete. 2023-05-24T04:00:30.251 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T04:00:30.251 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T04:00:30.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2023-05-24T04:00:30.252 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-24T04:00:30.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:30.252 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T04:00:30.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T04:00:30.252 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T04:00:30.253 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-24T04:00:30.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.253 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2023-05-24T04:00:30.260 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T04:00:30.260 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T04:00:30.260 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T04:00:30.260 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:30.260 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2023-05-24T04:00:30.260 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:30.261 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42413sec preferred_lft 42413sec 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:30.262 INFO:teuthology.orchestra.run.smithi121.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-24T04:00:30.263 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 02:42:9c:cf:d4:9d brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:30.263 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-24T04:00:30.263 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:30.263 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T04:00:30.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.264 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:30.264 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:30.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2023-05-24T04:00:30.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2023-05-24T04:00:30.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2023-05-24T04:00:30.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T04:00:30.265 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:30.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.342 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T04:00:30.395 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-05-24T04:00:30.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.397 DEBUG:teuthology.orchestra.run.smithi121:> route 2023-05-24T04:00:30.444 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2023-05-24T04:00:30.445 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T04:00:30.445 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-24T04:00:30.446 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T04:00:30.446 INFO:teuthology.orchestra.run.smithi121.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-24T04:00:30.446 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T04:00:30.446 INFO:teuthology.orchestra.run.smithi121.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:30.447 INFO:teuthology.orchestra.run.smithi121.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:30.447 INFO:teuthology.orchestra.run.smithi121.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:30.447 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T04:00:30.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.448 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:30.449 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:30.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T04:00:30.450 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T04:00:30.450 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T04:00:30.450 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:30.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.518 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-05-24T04:00:30.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.564 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2023-05-24T04:00:30.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.612 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:30.612 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:30.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-24T04:00:30.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-24T04:00:30.613 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:30.678 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-24T04:00:30.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.679 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:30.679 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:30.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-24T04:00:30.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T04:00:30.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-24T04:00:30.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-24T04:00:30.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-24T04:00:30.681 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:30.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:30.775 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-05-24T04:00:30.775 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-05-24T04:00:30.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2023-05-24T04:00:30.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T04:00:30.776 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-05-24T04:00:30.794 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-24T04:00:30.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:30.794 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:30.838 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-24T04:00:30.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:30.839 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:30.886 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2023-05-24T04:00:30.943 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:30.944 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:30.998 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:30.999 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:31.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:31.000 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2023-05-24T04:00:31.047 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-24T04:00:31.047 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-24T04:00:31.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2023-05-24T04:00:31.105 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:31.106 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:31.157 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:31.158 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:31.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:31.159 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2023-05-24T04:00:31.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2023-05-24T04:00:31.156+0000 7f67e208f580 -1 init, newargv = 0x56391eeb2000 newargc=15 2023-05-24T04:00:31.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[32525]: starting ceph client 2023-05-24T04:00:31.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[32525]: starting fuse 2023-05-24T04:00:32.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2023-05-24T04:00:32.285 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:32.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:32.344 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:32.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:32.345 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2023-05-24T04:00:32.391 INFO:teuthology.orchestra.run.smithi121.stdout:45 2023-05-24T04:00:32.391 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-05-24T04:00:32.392 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2023-05-24T04:00:32.392 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2023-05-24T04:00:32.392 DEBUG:teuthology.orchestra.run.smithi121:> import re 2023-05-24T04:00:32.392 DEBUG:teuthology.orchestra.run.smithi121:> import os 2023-05-24T04:00:32.393 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2023-05-24T04:00:32.393 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:32.393 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2023-05-24T04:00:32.393 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-24T04:00:32.394 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2023-05-24T04:00:32.394 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-24T04:00:32.394 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:32.395 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2023-05-24T04:00:32.395 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2023-05-24T04:00:32.395 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2023-05-24T04:00:32.396 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2023-05-24T04:00:32.396 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:32.396 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2023-05-24T04:00:32.396 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-24T04:00:32.397 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-24T04:00:32.397 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-24T04:00:32.397 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2023-05-24T04:00:32.397 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2023-05-24T04:00:32.398 DEBUG:teuthology.orchestra.run.smithi121:> return f 2023-05-24T04:00:32.398 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-24T04:00:32.398 DEBUG:teuthology.orchestra.run.smithi121:> 2023-05-24T04:00:32.398 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2023-05-24T04:00:32.399 DEBUG:teuthology.orchestra.run.smithi121:> ' 2023-05-24T04:00:32.518 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.32525.asok 2023-05-24T04:00:32.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-05-24T04:00:32 stdin-killer ERROR: exiting normally with 0 2023-05-24T04:00:32.531 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32525.asok 2023-05-24T04:00:32.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:32.531 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32525.asok status 2023-05-24T04:00:32.686 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-05-24T04:00:32.686 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2023-05-24T04:00:32.686 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "fa0e62c4a1d8e4a737d9cbe50224f70009b79b28", 2023-05-24T04:00:32.686 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 18.0.0-4167-gfa0e62c4 (fa0e62c4a1d8e4a737d9cbe50224f70009b79b28) reef (dev)", 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "32525", 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:32.687 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4812, 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4812 2023-05-24T04:00:32.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:0", 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1794298533 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2023-05-24T04:00:32.689 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:0", 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1794298533 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4812 172.21.15.121:0/1794298533", 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "172.21.15.121:0/1794298533", 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 8, 2023-05-24T04:00:32.690 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 27, 2023-05-24T04:00:32.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2023-05-24T04:00:32.691 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2023-05-24T04:00:32.691 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2023-05-24T04:00:32.691 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-05-24T04:00:32.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T04:00:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.830+0000 7f2f691f0640 1 Processor -- start 2023-05-24T04:00:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.830+0000 7f2f691f0640 1 -- start start 2023-05-24T04:00:32.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f691f0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f64151c70 0x7f2f64152040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f691f0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 0x7f2f6414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f691f0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f64152580 con 0x7f2f640a3690 2023-05-24T04:00:32.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f691f0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6406ee00 con 0x7f2f64151c70 2023-05-24T04:00:32.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f691f0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6406c1d0 con 0x7f2f640a4a30 2023-05-24T04:00:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f6259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2f640a3690 0x7f2f6406bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56712/0 (socket says 172.21.15.40:56712) 2023-05-24T04:00:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f6259c640 1 -- 172.21.15.40:0/3700526864 learned_addr learned my addr 172.21.15.40:0/3700526864 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:32.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f6359e640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 0x7f2f6414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/3700526864 >> v2:172.21.15.67:3300/0 conn(0x7f2f64151c70 0x7f2f64152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369677916 0 0) 0x7f2f64152580 con 0x7f2f640a3690 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f50003530 con 0x7f2f640a3690 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3641364781 0 0) 0x7f2f50003530 con 0x7f2f640a3690 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 msgr2=0x7f2f6414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 0x7f2f6414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 >> v2:172.21.15.67:3300/0 conn(0x7f2f64151c70 msgr2=0x7f2f64152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 --2- 172.21.15.40:0/3700526864 >> v2:172.21.15.67:3300/0 conn(0x7f2f64151c70 0x7f2f64152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f64152820 con 0x7f2f640a3690 2023-05-24T04:00:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f2f4c001680 con 0x7f2f640a3690 2023-05-24T04:00:32.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 >> v1:172.21.15.40:6789/0 conn(0x7f2f640a3690 legacy=0x7f2f6406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:32.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f50003980 0x7f2f50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 0x7f2f500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f50004d10 0x7f2f50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6406ee00 con 0x7f2f50003980 2023-05-24T04:00:32.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6406c1d0 con 0x7f2f50004d10 2023-05-24T04:00:32.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5000b990 con 0x7f2f640a4a30 2023-05-24T04:00:32.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f50003980 0x7f2f50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f6259c640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 0x7f2f500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f6359e640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f50004d10 0x7f2f50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 -- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 msgr2=0x7f2f500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:32.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f640a4a30 0x7f2f500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:32.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 -- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f50004d10 msgr2=0x7f2f50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:32.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f50004d10 0x7f2f50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:32.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.834+0000 7f2f62d9d640 1 -- 172.21.15.40:0/3700526864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50003530 con 0x7f2f50003980 2023-05-24T04:00:32.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.838+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f50003980 0x7f2f50003d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009fc0 tx=0x7f2f5401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53ba6c709996553 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:32.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540a5c80 con 0x7f2f50003980 2023-05-24T04:00:32.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400f040 con 0x7f2f50003980 2023-05-24T04:00:32.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f61d9b640 1 -- 172.21.15.40:0/3700526864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540ad440 con 0x7f2f50003980 2023-05-24T04:00:32.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/3700526864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f50003980 msgr2=0x7f2f50003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:32.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 --2- 172.21.15.40:0/3700526864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f50003980 0x7f2f50003d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009fc0 tx=0x7f2f5401cc10 comp rx=0 tx=0).stop 2023-05-24T04:00:32.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6359e640 1 -- 172.21.15.40:0/3700526864 reap_dead start 2023-05-24T04:00:32.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/3700526864 shutdown_connections 2023-05-24T04:00:32.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/3700526864 >> 172.21.15.40:0/3700526864 conn(0x7f2f640c0280 msgr2=0x7f2f640c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:32.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/3700526864 shutdown_connections 2023-05-24T04:00:32.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/3700526864 wait complete. 2023-05-24T04:00:32.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 Processor -- start 2023-05-24T04:00:32.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- start start 2023-05-24T04:00:32.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f64147310 0x7f2f641560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 0x7f2f640b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f641479c0 0x7f2f640ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64151680 con 0x7f2f64156630 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640bb2a0 con 0x7f2f641479c0 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640bb580 con 0x7f2f64147310 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 0x7f2f640b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 0x7f2f640b9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40252/0 (socket says 172.21.15.40:40252) 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 -- 172.21.15.40:0/2260092036 learned_addr learned my addr 172.21.15.40:0/2260092036 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f64147310 0x7f2f641560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6359e640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f641479c0 0x7f2f640ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 -- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f64147310 msgr2=0x7f2f641560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f64147310 0x7f2f641560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 -- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f641479c0 msgr2=0x7f2f640ba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f641479c0 0x7f2f640ba2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 -- 172.21.15.40:0/2260092036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f64158ef0 con 0x7f2f64156630 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f64147310 0x7f2f641560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6359e640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f641479c0 0x7f2f640ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f6259c640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 0x7f2f640b9d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0070e0 tx=0x7f2f4c0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:32.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00f9c0 con 0x7f2f64156630 2023-05-24T04:00:32.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c00fb20 con 0x7f2f64156630 2023-05-24T04:00:32.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64158d60 con 0x7f2f64156630 2023-05-24T04:00:32.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00fed0 con 0x7f2f64156630 2023-05-24T04:00:32.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.842+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f64159080 con 0x7f2f64156630 2023-05-24T04:00:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.846+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f640b9a90 con 0x7f2f64156630 2023-05-24T04:00:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.846+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f4c01d460 con 0x7f2f64156630 2023-05-24T04:00:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.846+0000 7f2f5b7fe640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2f440662b0 0x7f2f44068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.846+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f4c084160 con 0x7f2f64156630 2023-05-24T04:00:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.846+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2f440662b0 0x7f2f44068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.846+0000 7f2f62d9d640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2f440662b0 0x7f2f44068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f540af000 tx=0x7f2f540a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:32.850+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2f640b9a90 con 0x7f2f64156630 2023-05-24T04:00:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.034+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f640bb740 con 0x7f2f64156630 2023-05-24T04:00:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.034+0000 7f2f5b7fe640 1 -- 172.21.15.40:0/2260092036 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2f4c051380 con 0x7f2f64156630 2023-05-24T04:00:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T04:00:33.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2f440662b0 msgr2=0x7f2f44068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:33.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2f440662b0 0x7f2f44068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f540af000 tx=0x7f2f540a7040 comp rx=0 tx=0).stop 2023-05-24T04:00:33.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 msgr2=0x7f2f640b9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 0x7f2f640b9d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0070e0 tx=0x7f2f4c0075a0 comp rx=0 tx=0).stop 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 shutdown_connections 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2f440662b0 0x7f2f44068760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f641479c0 0x7f2f640ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f64156630 0x7f2f640b9d70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 --2- 172.21.15.40:0/2260092036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f64147310 0x7f2f641560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 >> 172.21.15.40:0/2260092036 conn(0x7f2f640c0280 msgr2=0x7f2f6406bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 shutdown_connections 2023-05-24T04:00:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:33.038+0000 7f2f691f0640 1 -- 172.21.15.40:0/2260092036 wait complete. 2023-05-24T04:00:33.058 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T04:00:33.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T04:00:33.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-05-24T04:00:33.059 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-24T04:00:33.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:33.059 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T04:00:33.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T04:00:33.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T04:00:33.060 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-24T04:00:33.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.061 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-05-24T04:00:33.067 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T04:00:33.067 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:33.068 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:33.069 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42423sec preferred_lft 42423sec 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:5d:3a:06:93 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-24T04:00:33.070 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:33.071 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T04:00:33.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.071 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-05-24T04:00:33.071 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-05-24T04:00:33.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2023-05-24T04:00:33.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2023-05-24T04:00:33.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2023-05-24T04:00:33.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T04:00:33.073 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-05-24T04:00:33.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.148 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T04:00:33.199 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-05-24T04:00:33.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.201 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-05-24T04:00:33.265 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-05-24T04:00:33.265 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T04:00:33.266 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-24T04:00:33.266 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T04:00:33.266 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-24T04:00:33.266 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T04:00:33.266 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:33.267 INFO:teuthology.orchestra.run.smithi155.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:33.267 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:33.267 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T04:00:33.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.268 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-05-24T04:00:33.268 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-05-24T04:00:33.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T04:00:33.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T04:00:33.269 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T04:00:33.269 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-05-24T04:00:33.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.342 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-05-24T04:00:33.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.390 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2023-05-24T04:00:33.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.437 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-05-24T04:00:33.437 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-05-24T04:00:33.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-24T04:00:33.438 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-24T04:00:33.438 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-05-24T04:00:33.503 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-24T04:00:33.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.504 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-05-24T04:00:33.504 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-05-24T04:00:33.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-24T04:00:33.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T04:00:33.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-24T04:00:33.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-24T04:00:33.506 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-24T04:00:33.506 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-05-24T04:00:33.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.610 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-05-24T04:00:33.611 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-05-24T04:00:33.611 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-05-24T04:00:33.611 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T04:00:33.611 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-05-24T04:00:33.630 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-24T04:00:33.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:33.630 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:33.677 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-24T04:00:33.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:33.679 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:33.724 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2023-05-24T04:00:33.781 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:33.781 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:33.836 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:33.837 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:33.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.838 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2023-05-24T04:00:33.885 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-24T04:00:33.885 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-24T04:00:33.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2023-05-24T04:00:33.944 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:33.944 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:33.995 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:33.996 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:33.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:33.997 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2023-05-24T04:00:34.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:2023-05-24T04:00:34.022+0000 7fc7c865c580 -1 init, newargv = 0x557f93ca3f80 newargc=15 2023-05-24T04:00:34.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[32304]: starting ceph client 2023-05-24T04:00:34.036 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[32304]: starting fuse 2023-05-24T04:00:35.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2023-05-24T04:00:35.151 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:35.151 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:35.203 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:35.204 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:35.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:35.205 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2023-05-24T04:00:35.254 INFO:teuthology.orchestra.run.smithi155.stdout:45 2023-05-24T04:00:35.254 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-05-24T04:00:35.254 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2023-05-24T04:00:35.255 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2023-05-24T04:00:35.255 DEBUG:teuthology.orchestra.run.smithi155:> import re 2023-05-24T04:00:35.255 DEBUG:teuthology.orchestra.run.smithi155:> import os 2023-05-24T04:00:35.255 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2023-05-24T04:00:35.256 DEBUG:teuthology.orchestra.run.smithi155:> 2023-05-24T04:00:35.256 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2023-05-24T04:00:35.256 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-24T04:00:35.256 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2023-05-24T04:00:35.257 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-24T04:00:35.257 DEBUG:teuthology.orchestra.run.smithi155:> 2023-05-24T04:00:35.257 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2023-05-24T04:00:35.257 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2023-05-24T04:00:35.258 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2023-05-24T04:00:35.258 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2023-05-24T04:00:35.258 DEBUG:teuthology.orchestra.run.smithi155:> 2023-05-24T04:00:35.258 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2023-05-24T04:00:35.258 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-24T04:00:35.259 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-24T04:00:35.259 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-24T04:00:35.259 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2023-05-24T04:00:35.259 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2023-05-24T04:00:35.260 DEBUG:teuthology.orchestra.run.smithi155:> return f 2023-05-24T04:00:35.260 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-24T04:00:35.260 DEBUG:teuthology.orchestra.run.smithi155:> 2023-05-24T04:00:35.260 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.1")) 2023-05-24T04:00:35.261 DEBUG:teuthology.orchestra.run.smithi155:> ' 2023-05-24T04:00:35.378 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.1.32304.asok 2023-05-24T04:00:35.382 INFO:teuthology.orchestra.run.smithi155.stderr:2023-05-24T04:00:35 stdin-killer ERROR: exiting normally with 0 2023-05-24T04:00:35.392 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32304.asok 2023-05-24T04:00:35.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:35.393 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32304.asok status 2023-05-24T04:00:35.540 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-05-24T04:00:35.541 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2023-05-24T04:00:35.541 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "fa0e62c4a1d8e4a737d9cbe50224f70009b79b28", 2023-05-24T04:00:35.541 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 18.0.0-4167-gfa0e62c4 (fa0e62c4a1d8e4a737d9cbe50224f70009b79b28) reef (dev)", 2023-05-24T04:00:35.541 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "1", 2023-05-24T04:00:35.542 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2023-05-24T04:00:35.542 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-24T04:00:35.542 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "32304", 2023-05-24T04:00:35.542 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2023-05-24T04:00:35.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-05-24T04:00:35.543 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2023-05-24T04:00:35.543 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2023-05-24T04:00:35.544 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4824, 2023-05-24T04:00:35.544 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2023-05-24T04:00:35.545 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2023-05-24T04:00:35.545 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2023-05-24T04:00:35.545 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4824 2023-05-24T04:00:35.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-05-24T04:00:35.546 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2023-05-24T04:00:35.546 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2023-05-24T04:00:35.546 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "172.21.15.155:0", 2023-05-24T04:00:35.546 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 2863135629 2023-05-24T04:00:35.546 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-05-24T04:00:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-05-24T04:00:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2023-05-24T04:00:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2023-05-24T04:00:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "172.21.15.155:0", 2023-05-24T04:00:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 2863135629 2023-05-24T04:00:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-05-24T04:00:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4824 172.21.15.155:0/2863135629", 2023-05-24T04:00:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "172.21.15.155:0/2863135629", 2023-05-24T04:00:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2023-05-24T04:00:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 8, 2023-05-24T04:00:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 27, 2023-05-24T04:00:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2023-05-24T04:00:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2023-05-24T04:00:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2023-05-24T04:00:35.550 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-05-24T04:00:35.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T04:00:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c81ab640 1 Processor -- start 2023-05-24T04:00:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c81ab640 1 -- start start 2023-05-24T04:00:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c81ab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52c0070ec0 0x7f52c014e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c81ab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00706c0 con 0x7f52c014acb0 2023-05-24T04:00:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c81ab640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00709a0 con 0x7f52c00c1500 2023-05-24T04:00:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c81ab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c014c0f0 con 0x7f52c0070ec0 2023-05-24T04:00:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c5746640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52c0070ec0 0x7f52c014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c6748640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52c014acb0 0x7f52c014ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56714/0 (socket says 172.21.15.40:56714) 2023-05-24T04:00:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c6748640 1 -- 172.21.15.40:0/27947456 learned_addr learned my addr 172.21.15.40:0/27947456 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c5746640 1 -- 172.21.15.40:0/27947456 >> v1:172.21.15.67:6789/0 conn(0x7f52c00c1500 legacy=0x7f52c014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c5746640 1 -- 172.21.15.40:0/27947456 >> v1:172.21.15.40:6789/0 conn(0x7f52c014acb0 legacy=0x7f52c014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c5746640 1 -- 172.21.15.40:0/27947456 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0071550 con 0x7f52c0070ec0 2023-05-24T04:00:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.686+0000 7f52c4f45640 1 -- 172.21.15.40:0/27947456 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478429228 0 0) 0x7f52c00706c0 con 0x7f52c014acb0 2023-05-24T04:00:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 --2- 172.21.15.40:0/27947456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0070ec0 0x7f52c014e690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097c0 tx=0x7f52b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b010b255729c7e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c4f45640 1 -- 172.21.15.40:0/27947456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00a8050 con 0x7f52c0070ec0 2023-05-24T04:00:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c4f45640 1 -- 172.21.15.40:0/27947456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b00ac5f0 con 0x7f52c0070ec0 2023-05-24T04:00:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c4f45640 1 -- 172.21.15.40:0/27947456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00ac980 con 0x7f52c0070ec0 2023-05-24T04:00:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- 172.21.15.40:0/27947456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0070ec0 msgr2=0x7f52c014e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 --2- 172.21.15.40:0/27947456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0070ec0 0x7f52c014e690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097c0 tx=0x7f52b001c480 comp rx=0 tx=0).stop 2023-05-24T04:00:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- 172.21.15.40:0/27947456 shutdown_connections 2023-05-24T04:00:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 --2- 172.21.15.40:0/27947456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0070ec0 0x7f52c014e690 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- 172.21.15.40:0/27947456 >> 172.21.15.40:0/27947456 conn(0x7f52c006a670 msgr2=0x7f52c00c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:35.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- 172.21.15.40:0/27947456 shutdown_connections 2023-05-24T04:00:35.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- 172.21.15.40:0/27947456 wait complete. 2023-05-24T04:00:35.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 Processor -- start 2023-05-24T04:00:35.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- start start 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c0070ec0 0x7f52c0143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 0x7f52c013d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c014acb0 0x7f52c013da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c01446f0 con 0x7f52c00c1500 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0144200 con 0x7f52c014acb0 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c81ab640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0143dc0 con 0x7f52c0070ec0 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 0x7f52c013d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 0x7f52c013d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40272/0 (socket says 172.21.15.40:40272) 2023-05-24T04:00:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 -- 172.21.15.40:0/4116590872 learned_addr learned my addr 172.21.15.40:0/4116590872 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 -- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c0070ec0 msgr2=0x7f52c0143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5f47640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c0070ec0 0x7f52c0143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:35.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c6748640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c014acb0 0x7f52c013da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:35.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c0070ec0 0x7f52c0143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 -- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c014acb0 msgr2=0x7f52c013da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c014acb0 0x7f52c013da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 -- 172.21.15.40:0/4116590872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0009420 con 0x7f52c00c1500 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5f47640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c0070ec0 0x7f52c0143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.690+0000 7f52c5746640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 0x7f52c013d4f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f52b001ab30 tx=0x7f52b0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0004030 con 0x7f52c00c1500 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0004190 con 0x7f52c00c1500 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c01597f0 con 0x7f52c00c1500 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0004500 con 0x7f52c00c1500 2023-05-24T04:00:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c0159660 con 0x7f52c00c1500 2023-05-24T04:00:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c0159980 con 0x7f52c00c1500 2023-05-24T04:00:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52b00b3040 con 0x7f52c00c1500 2023-05-24T04:00:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52b67fc640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f52a4066280 0x7f52a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52c5f47640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f52a4066280 0x7f52a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52b011d6b0 con 0x7f52c00c1500 2023-05-24T04:00:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.694+0000 7f52c5f47640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f52a4066280 0x7f52a4068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52c0146990 tx=0x7f52bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:35.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.698+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f52b00ea7a0 con 0x7f52c00c1500 2023-05-24T04:00:35.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f52c00674e0 con 0x7f52c00c1500 2023-05-24T04:00:35.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52b67fc640 1 -- 172.21.15.40:0/4116590872 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f52b00eddc0 con 0x7f52c00c1500 2023-05-24T04:00:35.895 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T04:00:35.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f52a4066280 msgr2=0x7f52a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f52a4066280 0x7f52a4068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52c0146990 tx=0x7f52bc009040 comp rx=0 tx=0).stop 2023-05-24T04:00:35.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 msgr2=0x7f52c013d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 0x7f52c013d4f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f52b001ab30 tx=0x7f52b0019220 comp rx=0 tx=0).stop 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 shutdown_connections 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f52a4066280 0x7f52a4068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c014acb0 0x7f52c013da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c00c1500 0x7f52c013d4f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 --2- 172.21.15.40:0/4116590872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c0070ec0 0x7f52c0143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 >> 172.21.15.40:0/4116590872 conn(0x7f52c006a670 msgr2=0x7f52c0148910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:35.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 shutdown_connections 2023-05-24T04:00:35.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:35.890+0000 7f52c81ab640 1 -- 172.21.15.40:0/4116590872 wait complete. 2023-05-24T04:00:35.914 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T04:00:35.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T04:00:35.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2023-05-24T04:00:35.918 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-24T04:00:35.918 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:35.918 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T04:00:35.919 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T04:00:35.919 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T04:00:35.919 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-24T04:00:35.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:35.920 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2023-05-24T04:00:35.926 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T04:00:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T04:00:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T04:00:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-05-24T04:00:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:35.928 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2023-05-24T04:00:35.928 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42416sec preferred_lft 42416sec 2023-05-24T04:00:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2023-05-24T04:00:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:35.930 INFO:teuthology.orchestra.run.smithi162.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-24T04:00:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 02:42:b5:fc:22:da brd ff:ff:ff:ff:ff:ff 2023-05-24T04:00:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-24T04:00:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-05-24T04:00:35.930 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T04:00:35.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:35.931 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-05-24T04:00:35.931 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-05-24T04:00:35.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2023-05-24T04:00:35.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2023-05-24T04:00:35.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2023-05-24T04:00:35.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T04:00:35.932 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-05-24T04:00:36.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.015 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T04:00:36.026 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-05-24T04:00:36.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.028 DEBUG:teuthology.orchestra.run.smithi162:> route 2023-05-24T04:00:36.096 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2023-05-24T04:00:36.097 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T04:00:36.097 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-24T04:00:36.097 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T04:00:36.097 INFO:teuthology.orchestra.run.smithi162.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-24T04:00:36.098 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T04:00:36.098 INFO:teuthology.orchestra.run.smithi162.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:36.098 INFO:teuthology.orchestra.run.smithi162.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:36.098 INFO:teuthology.orchestra.run.smithi162.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-24T04:00:36.099 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T04:00:36.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.100 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-05-24T04:00:36.100 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-05-24T04:00:36.101 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T04:00:36.101 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T04:00:36.101 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T04:00:36.102 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-05-24T04:00:36.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.169 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-05-24T04:00:36.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.229 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2023-05-24T04:00:36.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.284 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-05-24T04:00:36.284 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-05-24T04:00:36.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-24T04:00:36.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0 2023-05-24T04:00:36.285 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-05-24T04:00:36.355 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2023-05-24T04:00:36.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.355 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-05-24T04:00:36.356 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-05-24T04:00:36.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0 2023-05-24T04:00:36.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T04:00:36.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-24T04:00:36.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-24T04:00:36.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-24T04:00:36.357 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-05-24T04:00:36.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.463 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-05-24T04:00:36.464 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-05-24T04:00:36.464 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2023-05-24T04:00:36.465 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T04:00:36.465 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-05-24T04:00:36.485 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-24T04:00:36.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:36.486 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:36.533 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-24T04:00:36.534 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T04:00:36.535 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:36.586 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2023-05-24T04:00:36.650 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:36.651 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:36.709 INFO:teuthology.orchestra.run.smithi162.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:36.710 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:36.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.712 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2023-05-24T04:00:36.757 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-24T04:00:36.758 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-24T04:00:36.802 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2023-05-24T04:00:36.818 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:36.818 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:36.870 INFO:teuthology.orchestra.run.smithi162.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:36.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:36.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:36.872 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2023-05-24T04:00:36.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi162.stderr:2023-05-24T04:00:36.887+0000 7f8fc3fa3580 -1 init, newargv = 0x55d4033f90a0 newargc=15 2023-05-24T04:00:36.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi162.stderr:ceph-fuse[32313]: starting ceph client 2023-05-24T04:00:36.906 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi162.stderr:ceph-fuse[32313]: starting fuse 2023-05-24T04:00:38.003 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2023-05-24T04:00:38.020 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T04:00:38.021 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T04:00:38.077 INFO:teuthology.orchestra.run.smithi162.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T04:00:38.078 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T04:00:38.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.080 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2023-05-24T04:00:38.126 INFO:teuthology.orchestra.run.smithi162.stdout:45 2023-05-24T04:00:38.127 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-05-24T04:00:38.127 DEBUG:teuthology.orchestra.run.smithi162:> sudo stdin-killer -- python3 -c ' 2023-05-24T04:00:38.128 DEBUG:teuthology.orchestra.run.smithi162:> import glob 2023-05-24T04:00:38.129 DEBUG:teuthology.orchestra.run.smithi162:> import re 2023-05-24T04:00:38.129 DEBUG:teuthology.orchestra.run.smithi162:> import os 2023-05-24T04:00:38.129 DEBUG:teuthology.orchestra.run.smithi162:> import subprocess 2023-05-24T04:00:38.130 DEBUG:teuthology.orchestra.run.smithi162:> 2023-05-24T04:00:38.130 DEBUG:teuthology.orchestra.run.smithi162:> def _find_admin_socket(client_name): 2023-05-24T04:00:38.130 DEBUG:teuthology.orchestra.run.smithi162:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-24T04:00:38.131 DEBUG:teuthology.orchestra.run.smithi162:> files = glob.glob(asok_path) 2023-05-24T04:00:38.131 DEBUG:teuthology.orchestra.run.smithi162:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-24T04:00:38.131 DEBUG:teuthology.orchestra.run.smithi162:> 2023-05-24T04:00:38.131 DEBUG:teuthology.orchestra.run.smithi162:> # Given a non-glob path, it better be there 2023-05-24T04:00:38.133 DEBUG:teuthology.orchestra.run.smithi162:> if "*" not in asok_path: 2023-05-24T04:00:38.133 DEBUG:teuthology.orchestra.run.smithi162:> assert(len(files) == 1) 2023-05-24T04:00:38.133 DEBUG:teuthology.orchestra.run.smithi162:> return files[0] 2023-05-24T04:00:38.133 DEBUG:teuthology.orchestra.run.smithi162:> 2023-05-24T04:00:38.134 DEBUG:teuthology.orchestra.run.smithi162:> for f in files: 2023-05-24T04:00:38.134 DEBUG:teuthology.orchestra.run.smithi162:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-24T04:00:38.135 DEBUG:teuthology.orchestra.run.smithi162:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-24T04:00:38.135 DEBUG:teuthology.orchestra.run.smithi162:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-24T04:00:38.135 DEBUG:teuthology.orchestra.run.smithi162:> contents = proc_f.read() 2023-05-24T04:00:38.135 DEBUG:teuthology.orchestra.run.smithi162:> if mountpoint in contents: 2023-05-24T04:00:38.136 DEBUG:teuthology.orchestra.run.smithi162:> return f 2023-05-24T04:00:38.136 DEBUG:teuthology.orchestra.run.smithi162:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-24T04:00:38.136 DEBUG:teuthology.orchestra.run.smithi162:> 2023-05-24T04:00:38.136 DEBUG:teuthology.orchestra.run.smithi162:> print(_find_admin_socket("client.2")) 2023-05-24T04:00:38.137 DEBUG:teuthology.orchestra.run.smithi162:> ' 2023-05-24T04:00:38.249 INFO:teuthology.orchestra.run.smithi162.stdout:/var/run/ceph/ceph-client.2.32313.asok 2023-05-24T04:00:38.253 INFO:teuthology.orchestra.run.smithi162.stderr:2023-05-24T04:00:38 stdin-killer ERROR: exiting normally with 0 2023-05-24T04:00:38.262 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.32313.asok 2023-05-24T04:00:38.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.263 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.32313.asok status 2023-05-24T04:00:38.417 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2023-05-24T04:00:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: "metadata": { 2023-05-24T04:00:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_sha1": "fa0e62c4a1d8e4a737d9cbe50224f70009b79b28", 2023-05-24T04:00:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 18.0.0-4167-gfa0e62c4 (fa0e62c4a1d8e4a737d9cbe50224f70009b79b28) reef (dev)", 2023-05-24T04:00:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: "entity_id": "2", 2023-05-24T04:00:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: "hostname": "smithi162", 2023-05-24T04:00:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-24T04:00:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: "pid": "32313", 2023-05-24T04:00:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: "root": "/" 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_count": 0, 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_pinned_count": 0, 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4839, 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "inst": { 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "name": { 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "client", 2023-05-24T04:00:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: "num": 4839 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "172.21.15.162:0", 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 277488785 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: } 2023-05-24T04:00:38.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "172.21.15.162:0", 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 277488785 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inst_str": "client.4839 172.21.15.162:0/277488785", 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "addr_str": "172.21.15.162:0/277488785", 2023-05-24T04:00:38.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inode_count": 1, 2023-05-24T04:00:38.422 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_epoch": 8, 2023-05-24T04:00:38.422 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch": 27, 2023-05-24T04:00:38.422 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch_barrier": 0, 2023-05-24T04:00:38.422 INFO:teuthology.orchestra.run.smithi162.stdout: "blocklisted": false, 2023-05-24T04:00:38.422 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs" 2023-05-24T04:00:38.423 INFO:teuthology.orchestra.run.smithi162.stdout:} 2023-05-24T04:00:38.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.431 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2023-05-24T04:00:38.432 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:38.439 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2023-05-24T04:00:38.440 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:38.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:38.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.498 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2023-05-24T04:00:38.498 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:38.506 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2023-05-24T04:00:38.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:38.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-24T04:00:38.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.563 DEBUG:teuthology.orchestra.run.smithi162:> stat --file-system '--printf=%T 2023-05-24T04:00:38.563 DEBUG:teuthology.orchestra.run.smithi162:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:38.571 INFO:teuthology.orchestra.run.smithi162.stdout:fuseblk 2023-05-24T04:00:38.571 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:38.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:38.572 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-24T04:00:38.626 INFO:teuthology.run_tasks:Running task pexec... 2023-05-24T04:00:38.638 INFO:teuthology.task.pexec:Executing custom commands... 2023-05-24T04:00:38.638 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi121.front.sepia.ceph.com 2023-05-24T04:00:38.639 DEBUG:teuthology.orchestra.run.smithi121:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-05-24T04:00:38.639 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi155.front.sepia.ceph.com 2023-05-24T04:00:38.640 DEBUG:teuthology.orchestra.run.smithi155:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-05-24T04:00:38.640 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi162.front.sepia.ceph.com 2023-05-24T04:00:38.640 DEBUG:teuthology.orchestra.run.smithi162:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-05-24T04:00:38.673 INFO:teuthology.orchestra.run.smithi155.stderr:--2023-05-24 04:00:38-- http://download.ceph.com/qa/ior.tbz2 2023-05-24T04:00:38.675 INFO:teuthology.orchestra.run.smithi155.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-05-24T04:00:38.693 INFO:teuthology.orchestra.run.smithi121.stderr:--2023-05-24 04:00:38-- http://download.ceph.com/qa/ior.tbz2 2023-05-24T04:00:38.694 INFO:teuthology.orchestra.run.smithi162.stderr:--2023-05-24 04:00:38-- http://download.ceph.com/qa/ior.tbz2 2023-05-24T04:00:38.694 INFO:teuthology.orchestra.run.smithi121.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-05-24T04:00:38.695 INFO:teuthology.orchestra.run.smithi162.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-05-24T04:00:38.713 INFO:teuthology.orchestra.run.smithi155.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-05-24T04:00:38.731 INFO:teuthology.orchestra.run.smithi121.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-05-24T04:00:38.732 INFO:teuthology.orchestra.run.smithi162.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-05-24T04:00:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:HTTP request sent, awaiting response... 200 OK 2023-05-24T04:00:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:Length: 819271 (800K) [application/octet-stream] 2023-05-24T04:00:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:Saving to: 'ior.tbz2' 2023-05-24T04:00:38.750 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-05-24T04:00:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:HTTP request sent, awaiting response... 200 OK 2023-05-24T04:00:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:Length: 819271 (800K) [application/octet-stream] 2023-05-24T04:00:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:Saving to: 'ior.tbz2' 2023-05-24T04:00:38.778 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-05-24T04:00:38.779 INFO:teuthology.orchestra.run.smithi162.stderr:HTTP request sent, awaiting response... 200 OK 2023-05-24T04:00:38.779 INFO:teuthology.orchestra.run.smithi162.stderr:Length: 819271 (800K) [application/octet-stream] 2023-05-24T04:00:38.779 INFO:teuthology.orchestra.run.smithi162.stderr:Saving to: 'ior.tbz2' 2023-05-24T04:00:38.780 INFO:teuthology.orchestra.run.smithi162.stderr: 2023-05-24T04:00:38.839 INFO:teuthology.orchestra.run.smithi155.stderr: 0K .......... .......... .......... .......... .......... 6% 559K 1s 2023-05-24T04:00:38.860 INFO:teuthology.orchestra.run.smithi121.stderr: 0K .......... .......... .......... .......... .......... 6% 598K 1s 2023-05-24T04:00:38.863 INFO:teuthology.orchestra.run.smithi162.stderr: 0K .......... .......... .......... .......... .......... 6% 597K 1s 2023-05-24T04:00:38.876 INFO:teuthology.orchestra.run.smithi155.stderr: 50K .......... .......... .......... .......... .......... 12% 1.37M 1s 2023-05-24T04:00:38.876 INFO:teuthology.orchestra.run.smithi155.stderr: 100K .......... .......... .......... .......... .......... 18% 67.6M 1s 2023-05-24T04:00:38.877 INFO:teuthology.orchestra.run.smithi155.stderr: 150K .......... .......... .......... .......... .......... 24% 85.6M 0s 2023-05-24T04:00:38.899 INFO:teuthology.orchestra.run.smithi121.stderr: 50K .......... .......... .......... .......... .......... 12% 1.38M 1s 2023-05-24T04:00:38.899 INFO:teuthology.orchestra.run.smithi121.stderr: 100K .......... .......... .......... .......... .......... 18% 46.2M 1s 2023-05-24T04:00:38.900 INFO:teuthology.orchestra.run.smithi121.stderr: 150K .......... .......... .......... .......... .......... 24% 55.8M 0s 2023-05-24T04:00:38.902 INFO:teuthology.orchestra.run.smithi162.stderr: 50K .......... .......... .......... .......... .......... 12% 1.40M 1s 2023-05-24T04:00:38.902 INFO:teuthology.orchestra.run.smithi162.stderr: 100K .......... .......... .......... .......... .......... 18% 33.1M 1s 2023-05-24T04:00:38.903 INFO:teuthology.orchestra.run.smithi162.stderr: 150K .......... .......... .......... .......... .......... 24% 86.9M 0s 2023-05-24T04:00:38.921 INFO:teuthology.orchestra.run.smithi155.stderr: 200K .......... .......... .......... .......... .......... 31% 1.40M 0s 2023-05-24T04:00:38.921 INFO:teuthology.orchestra.run.smithi155.stderr: 250K .......... .......... .......... .......... .......... 37% 97.8M 0s 2023-05-24T04:00:38.922 INFO:teuthology.orchestra.run.smithi155.stderr: 300K .......... .......... .......... .......... .......... 43% 132M 0s 2023-05-24T04:00:38.922 INFO:teuthology.orchestra.run.smithi155.stderr: 350K .......... .......... .......... .......... .......... 49% 80.0M 0s 2023-05-24T04:00:38.936 INFO:teuthology.orchestra.run.smithi121.stderr: 200K .......... .......... .......... .......... .......... 31% 1.40M 0s 2023-05-24T04:00:38.937 INFO:teuthology.orchestra.run.smithi121.stderr: 250K .......... .......... .......... .......... .......... 37% 76.1M 0s 2023-05-24T04:00:38.937 INFO:teuthology.orchestra.run.smithi121.stderr: 300K .......... .......... .......... .......... .......... 43% 30.6M 0s 2023-05-24T04:00:38.937 INFO:teuthology.orchestra.run.smithi121.stderr: 350K .......... .......... .......... .......... .......... 49% 64.7M 0s 2023-05-24T04:00:38.941 INFO:teuthology.orchestra.run.smithi162.stderr: 200K .......... .......... .......... .......... .......... 31% 1.38M 0s 2023-05-24T04:00:38.941 INFO:teuthology.orchestra.run.smithi162.stderr: 250K .......... .......... .......... .......... .......... 37% 31.8M 0s 2023-05-24T04:00:38.941 INFO:teuthology.orchestra.run.smithi162.stderr: 300K .......... .......... .......... .......... .......... 43% 61.1M 0s 2023-05-24T04:00:38.942 INFO:teuthology.orchestra.run.smithi162.stderr: 350K .......... .......... .......... .......... .......... 49% 36.4M 0s 2023-05-24T04:00:38.950 INFO:teuthology.orchestra.run.smithi155.stderr: 400K .......... .......... .......... .......... .......... 56% 1.44M 0s 2023-05-24T04:00:38.950 INFO:teuthology.orchestra.run.smithi155.stderr: 450K .......... .......... .......... .......... .......... 62% 112M 0s 2023-05-24T04:00:38.951 INFO:teuthology.orchestra.run.smithi155.stderr: 500K .......... .......... .......... .......... .......... 68% 163M 0s 2023-05-24T04:00:38.951 INFO:teuthology.orchestra.run.smithi155.stderr: 550K .......... .......... .......... .......... .......... 74% 129M 0s 2023-05-24T04:00:38.951 INFO:teuthology.orchestra.run.smithi155.stderr: 600K .......... .......... .......... .......... .......... 81% 95.7M 0s 2023-05-24T04:00:38.951 INFO:teuthology.orchestra.run.smithi155.stderr: 650K .......... .......... .......... .......... .......... 87% 107M 0s 2023-05-24T04:00:38.951 INFO:teuthology.orchestra.run.smithi155.stderr: 700K .......... .......... .......... .......... .......... 93% 41.3M 0s 2023-05-24T04:00:38.952 INFO:teuthology.orchestra.run.smithi155.stderr: 750K .......... .......... .......... .......... .......... 99% 39.2M 0s 2023-05-24T04:00:38.953 INFO:teuthology.orchestra.run.smithi155.stderr: 800K 100% 132G=0.2s 2023-05-24T04:00:38.953 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-05-24T04:00:38.953 INFO:teuthology.orchestra.run.smithi155.stderr:2023-05-24 04:00:38 (3.88 MB/s) - 'ior.tbz2' saved [819271/819271] 2023-05-24T04:00:38.953 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-05-24T04:00:38.971 INFO:teuthology.orchestra.run.smithi121.stderr: 400K .......... .......... .......... .......... .......... 56% 1.53M 0s 2023-05-24T04:00:38.971 INFO:teuthology.orchestra.run.smithi121.stderr: 450K .......... .......... .......... .......... .......... 62% 124M 0s 2023-05-24T04:00:38.971 INFO:teuthology.orchestra.run.smithi121.stderr: 500K .......... .......... .......... .......... .......... 68% 53.3M 0s 2023-05-24T04:00:38.972 INFO:teuthology.orchestra.run.smithi121.stderr: 550K .......... .......... .......... .......... .......... 74% 55.8M 0s 2023-05-24T04:00:38.972 INFO:teuthology.orchestra.run.smithi121.stderr: 600K .......... .......... .......... .......... .......... 81% 63.7M 0s 2023-05-24T04:00:38.974 INFO:teuthology.orchestra.run.smithi121.stderr: 650K .......... .......... .......... .......... .......... 87% 17.0M 0s 2023-05-24T04:00:38.974 INFO:teuthology.orchestra.run.smithi121.stderr: 700K .......... .......... .......... .......... .......... 93% 39.4M 0s 2023-05-24T04:00:38.976 INFO:teuthology.orchestra.run.smithi162.stderr: 400K .......... .......... .......... .......... .......... 56% 1.53M 0s 2023-05-24T04:00:38.976 INFO:teuthology.orchestra.run.smithi162.stderr: 450K .......... .......... .......... .......... .......... 62% 49.2M 0s 2023-05-24T04:00:38.977 INFO:teuthology.orchestra.run.smithi162.stderr: 500K .......... .......... .......... .......... .......... 68% 71.3M 0s 2023-05-24T04:00:38.977 INFO:teuthology.orchestra.run.smithi162.stderr: 550K .......... .......... .......... .......... .......... 74% 11.7M 0s 2023-05-24T04:00:38.978 INFO:teuthology.orchestra.run.smithi121.stderr: 750K .......... .......... .......... .......... .......... 99% 15.8M 0s 2023-05-24T04:00:38.978 INFO:teuthology.orchestra.run.smithi121.stderr: 800K 100% 132G=0.2s 2023-05-24T04:00:38.978 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-05-24T04:00:38.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-05-24 04:00:38 (3.89 MB/s) - 'ior.tbz2' saved [819271/819271] 2023-05-24T04:00:38.978 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-05-24T04:00:38.979 INFO:teuthology.orchestra.run.smithi162.stderr: 600K .......... .......... .......... .......... .......... 81% 23.9M 0s 2023-05-24T04:00:38.979 INFO:teuthology.orchestra.run.smithi162.stderr: 650K .......... .......... .......... .......... .......... 87% 19.3M 0s 2023-05-24T04:00:38.981 INFO:teuthology.orchestra.run.smithi162.stderr: 700K .......... .......... .......... .......... .......... 93% 25.2M 0s 2023-05-24T04:00:38.982 INFO:teuthology.orchestra.run.smithi162.stderr: 750K .......... .......... .......... .......... .......... 99% 36.9M 0s 2023-05-24T04:00:38.982 INFO:teuthology.orchestra.run.smithi162.stderr: 800K 100% 132G=0.2s 2023-05-24T04:00:38.982 INFO:teuthology.orchestra.run.smithi162.stderr: 2023-05-24T04:00:38.983 INFO:teuthology.orchestra.run.smithi162.stderr:2023-05-24 04:00:38 (3.80 MB/s) - 'ior.tbz2' saved [819271/819271] 2023-05-24T04:00:38.983 INFO:teuthology.orchestra.run.smithi162.stderr: 2023-05-24T04:00:38.991 INFO:teuthology.orchestra.run.smithi155.stdout:ior/ 2023-05-24T04:00:38.991 INFO:teuthology.orchestra.run.smithi155.stdout:ior/aclocal.m4 2023-05-24T04:00:38.991 INFO:teuthology.orchestra.run.smithi155.stdout:ior/Makefile 2023-05-24T04:00:38.991 INFO:teuthology.orchestra.run.smithi155.stdout:ior/testing/ 2023-05-24T04:00:38.991 INFO:teuthology.orchestra.run.smithi155.stdout:ior/testing/IOR-tester.README 2023-05-24T04:00:38.991 INFO:teuthology.orchestra.run.smithi155.stdout:ior/testing/hintsFile 2023-05-24T04:00:38.992 INFO:teuthology.orchestra.run.smithi155.stdout:ior/testing/IOR-tester.py 2023-05-24T04:00:38.992 INFO:teuthology.orchestra.run.smithi155.stdout:ior/hosts 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/ 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/config.guess 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/ax_prog_cc_mpi.m4 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/x_ac_meta.m4 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/config.sub 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/missing 2023-05-24T04:00:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/depcomp 2023-05-24T04:00:38.994 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config/install-sh 2023-05-24T04:00:38.994 INFO:teuthology.orchestra.run.smithi155.stdout:ior/scripts/ 2023-05-24T04:00:38.994 INFO:teuthology.orchestra.run.smithi155.stdout:ior/scripts/run_script.cnl 2023-05-24T04:00:38.994 INFO:teuthology.orchestra.run.smithi155.stdout:ior/scripts/run_script.linux 2023-05-24T04:00:38.995 INFO:teuthology.orchestra.run.smithi155.stdout:ior/scripts/exampleScript 2023-05-24T04:00:38.995 INFO:teuthology.orchestra.run.smithi155.stdout:ior/configure 2023-05-24T04:00:38.996 INFO:teuthology.orchestra.run.smithi155.stdout:ior/Makefile.in 2023-05-24T04:00:38.997 INFO:teuthology.orchestra.run.smithi155.stdout:ior/COPYRIGHT 2023-05-24T04:00:38.997 INFO:teuthology.orchestra.run.smithi155.stdout:ior/configure.ac 2023-05-24T04:00:38.997 INFO:teuthology.orchestra.run.smithi155.stdout:ior/bootstrap 2023-05-24T04:00:38.997 INFO:teuthology.orchestra.run.smithi155.stdout:ior/ChangeLog 2023-05-24T04:00:38.997 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/ 2023-05-24T04:00:38.997 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/utilities.c 2023-05-24T04:00:38.998 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/Makefile 2023-05-24T04:00:38.998 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori-MPIIO.c 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/stamp-h1 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori-POSIX.c 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/parse_options.h 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/Makefile.in 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/config.h.in 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori-POSIX.o 2023-05-24T04:00:38.999 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/ior 2023-05-24T04:00:39.020 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/ior.c 2023-05-24T04:00:39.020 INFO:teuthology.orchestra.run.smithi121.stdout:ior/ 2023-05-24T04:00:39.021 INFO:teuthology.orchestra.run.smithi121.stdout:ior/aclocal.m4 2023-05-24T04:00:39.021 INFO:teuthology.orchestra.run.smithi121.stdout:ior/Makefile 2023-05-24T04:00:39.021 INFO:teuthology.orchestra.run.smithi121.stdout:ior/testing/ 2023-05-24T04:00:39.021 INFO:teuthology.orchestra.run.smithi121.stdout:ior/testing/IOR-tester.README 2023-05-24T04:00:39.021 INFO:teuthology.orchestra.run.smithi121.stdout:ior/testing/hintsFile 2023-05-24T04:00:39.021 INFO:teuthology.orchestra.run.smithi121.stdout:ior/testing/IOR-tester.py 2023-05-24T04:00:39.023 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/config.h 2023-05-24T04:00:39.023 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/utilities.h 2023-05-24T04:00:39.023 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/ior.h 2023-05-24T04:00:39.023 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori-MPIIO.o 2023-05-24T04:00:39.023 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/iordef.h 2023-05-24T04:00:39.023 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/utilities.o 2023-05-24T04:00:39.024 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/parse_options.o 2023-05-24T04:00:39.024 INFO:teuthology.orchestra.run.smithi121.stdout:ior/hosts 2023-05-24T04:00:39.024 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/ 2023-05-24T04:00:39.024 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/config.guess 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/ax_prog_cc_mpi.m4 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/x_ac_meta.m4 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/config.sub 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/missing 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/depcomp 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config/install-sh 2023-05-24T04:00:39.025 INFO:teuthology.orchestra.run.smithi121.stdout:ior/scripts/ 2023-05-24T04:00:39.026 INFO:teuthology.orchestra.run.smithi121.stdout:ior/scripts/run_script.cnl 2023-05-24T04:00:39.026 INFO:teuthology.orchestra.run.smithi121.stdout:ior/scripts/run_script.linux 2023-05-24T04:00:39.026 INFO:teuthology.orchestra.run.smithi121.stdout:ior/scripts/exampleScript 2023-05-24T04:00:39.026 INFO:teuthology.orchestra.run.smithi121.stdout:ior/configure 2023-05-24T04:00:39.029 INFO:teuthology.orchestra.run.smithi121.stdout:ior/Makefile.in 2023-05-24T04:00:39.029 INFO:teuthology.orchestra.run.smithi121.stdout:ior/COPYRIGHT 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/configure.ac 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/bootstrap 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/ChangeLog 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/ 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/utilities.c 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/Makefile 2023-05-24T04:00:39.030 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori-MPIIO.c 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/stamp-h1 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori-POSIX.c 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/parse_options.h 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/Makefile.in 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/config.h.in 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori-POSIX.o 2023-05-24T04:00:39.031 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/ior 2023-05-24T04:00:39.032 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/parse_options.c 2023-05-24T04:00:39.032 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/Makefile.am 2023-05-24T04:00:39.032 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/ 2023-05-24T04:00:39.032 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/aiori-HDF5.Po 2023-05-24T04:00:39.032 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/aiori-MPIIO.Po 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/aiori-NCMPI.Po 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/parse_options.Po 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/aiori-POSIX.Po 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/ior.Po 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/.deps/utilities.Po 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori-HDF5.c 2023-05-24T04:00:39.033 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/win/ 2023-05-24T04:00:39.034 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/win/getopt.h 2023-05-24T04:00:39.034 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/win/getopt.c 2023-05-24T04:00:39.034 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori-NCMPI.c 2023-05-24T04:00:39.034 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/aiori.h 2023-05-24T04:00:39.034 INFO:teuthology.orchestra.run.smithi155.stdout:ior/src/ior.o 2023-05-24T04:00:39.034 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config.log 2023-05-24T04:00:39.036 INFO:teuthology.orchestra.run.smithi162.stdout:ior/ 2023-05-24T04:00:39.036 INFO:teuthology.orchestra.run.smithi162.stdout:ior/aclocal.m4 2023-05-24T04:00:39.036 INFO:teuthology.orchestra.run.smithi162.stdout:ior/Makefile 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/testing/ 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/testing/IOR-tester.README 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/testing/hintsFile 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/testing/IOR-tester.py 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/hosts 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/ 2023-05-24T04:00:39.037 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/config.guess 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/ax_prog_cc_mpi.m4 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/x_ac_meta.m4 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/config.sub 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/missing 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/depcomp 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config/install-sh 2023-05-24T04:00:39.038 INFO:teuthology.orchestra.run.smithi162.stdout:ior/scripts/ 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/scripts/run_script.cnl 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/scripts/run_script.linux 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/scripts/exampleScript 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/configure 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/Makefile.in 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/COPYRIGHT 2023-05-24T04:00:39.039 INFO:teuthology.orchestra.run.smithi162.stdout:ior/configure.ac 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/bootstrap 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/ChangeLog 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/ 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/utilities.c 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/Makefile 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori-MPIIO.c 2023-05-24T04:00:39.040 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/stamp-h1 2023-05-24T04:00:39.041 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori-POSIX.c 2023-05-24T04:00:39.041 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/parse_options.h 2023-05-24T04:00:39.041 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/Makefile.in 2023-05-24T04:00:39.041 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/config.h.in 2023-05-24T04:00:39.041 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori-POSIX.o 2023-05-24T04:00:39.041 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/ior 2023-05-24T04:00:39.046 INFO:teuthology.orchestra.run.smithi155.stdout:ior/README 2023-05-24T04:00:39.046 INFO:teuthology.orchestra.run.smithi155.stdout:ior/Makefile.am 2023-05-24T04:00:39.046 INFO:teuthology.orchestra.run.smithi155.stdout:ior/config.status 2023-05-24T04:00:39.050 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/ 2023-05-24T04:00:39.050 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/Makefile 2023-05-24T04:00:39.050 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/Makefile.in 2023-05-24T04:00:39.050 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/cbif.o 2023-05-24T04:00:39.050 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/cbif 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/cbif.c 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/Makefile.am 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/.deps/ 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/contrib/.deps/cbif.Po 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/ 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/branches/ 2023-05-24T04:00:39.051 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/HEAD 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/info/ 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/info/exclude 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/ 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/tags/ 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/heads/ 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/heads/master 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/remotes/ 2023-05-24T04:00:39.052 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/remotes/origin/ 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/refs/remotes/origin/HEAD 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/config 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/logs/ 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/logs/HEAD 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/logs/refs/ 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/logs/refs/heads/ 2023-05-24T04:00:39.053 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/logs/refs/heads/master 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/packed-refs 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/ 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/pre-commit.sample 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/pre-rebase.sample 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/post-update.sample 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/pre-applypatch.sample 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/commit-msg.sample 2023-05-24T04:00:39.054 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/applypatch-msg.sample 2023-05-24T04:00:39.055 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/prepare-commit-msg.sample 2023-05-24T04:00:39.055 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/hooks/update.sample 2023-05-24T04:00:39.055 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/objects/ 2023-05-24T04:00:39.055 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/objects/info/ 2023-05-24T04:00:39.055 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/objects/pack/ 2023-05-24T04:00:39.055 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.pack 2023-05-24T04:00:39.057 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.idx 2023-05-24T04:00:39.057 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/description 2023-05-24T04:00:39.057 INFO:teuthology.orchestra.run.smithi155.stdout:ior/.git/index 2023-05-24T04:00:39.057 INFO:teuthology.orchestra.run.smithi155.stdout:ior/META 2023-05-24T04:00:39.058 INFO:teuthology.orchestra.run.smithi155.stdout:ior/doc/ 2023-05-24T04:00:39.058 INFO:teuthology.orchestra.run.smithi155.stdout:ior/doc/Makefile 2023-05-24T04:00:39.058 INFO:teuthology.orchestra.run.smithi155.stdout:ior/doc/Makefile.in 2023-05-24T04:00:39.058 INFO:teuthology.orchestra.run.smithi155.stdout:ior/doc/USER_GUIDE 2023-05-24T04:00:39.058 INFO:teuthology.orchestra.run.smithi155.stdout:ior/doc/Makefile.am 2023-05-24T04:00:39.059 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/ior.c 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/config.h 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/utilities.h 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/ior.h 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori-MPIIO.o 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/iordef.h 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/utilities.o 2023-05-24T04:00:39.060 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/parse_options.o 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/parse_options.c 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/Makefile.am 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/ 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/aiori-HDF5.Po 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/aiori-MPIIO.Po 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/aiori-NCMPI.Po 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/parse_options.Po 2023-05-24T04:00:39.061 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/aiori-POSIX.Po 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/ior.Po 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/.deps/utilities.Po 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori-HDF5.c 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/win/ 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/win/getopt.h 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/win/getopt.c 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori-NCMPI.c 2023-05-24T04:00:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/aiori.h 2023-05-24T04:00:39.063 INFO:teuthology.orchestra.run.smithi121.stdout:ior/src/ior.o 2023-05-24T04:00:39.063 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config.log 2023-05-24T04:00:39.065 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/ior.c 2023-05-24T04:00:39.065 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/config.h 2023-05-24T04:00:39.065 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/utilities.h 2023-05-24T04:00:39.065 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/ior.h 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori-MPIIO.o 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/iordef.h 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/utilities.o 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/parse_options.o 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/parse_options.c 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/Makefile.am 2023-05-24T04:00:39.066 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/ 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/aiori-HDF5.Po 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/aiori-MPIIO.Po 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/aiori-NCMPI.Po 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/parse_options.Po 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/aiori-POSIX.Po 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/ior.Po 2023-05-24T04:00:39.067 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/.deps/utilities.Po 2023-05-24T04:00:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori-HDF5.c 2023-05-24T04:00:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/win/ 2023-05-24T04:00:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/win/getopt.h 2023-05-24T04:00:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/win/getopt.c 2023-05-24T04:00:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori-NCMPI.c 2023-05-24T04:00:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/aiori.h 2023-05-24T04:00:39.069 INFO:teuthology.orchestra.run.smithi162.stdout:ior/src/ior.o 2023-05-24T04:00:39.069 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config.log 2023-05-24T04:00:39.077 INFO:teuthology.orchestra.run.smithi121.stdout:ior/README 2023-05-24T04:00:39.077 INFO:teuthology.orchestra.run.smithi121.stdout:ior/Makefile.am 2023-05-24T04:00:39.077 INFO:teuthology.orchestra.run.smithi121.stdout:ior/config.status 2023-05-24T04:00:39.080 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/ 2023-05-24T04:00:39.081 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/Makefile 2023-05-24T04:00:39.081 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/Makefile.in 2023-05-24T04:00:39.081 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/cbif.o 2023-05-24T04:00:39.081 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/cbif 2023-05-24T04:00:39.081 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/cbif.c 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/Makefile.am 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/.deps/ 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/contrib/.deps/cbif.Po 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/ 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/branches/ 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/HEAD 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/info/ 2023-05-24T04:00:39.082 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/info/exclude 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/ 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/tags/ 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/heads/ 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/heads/master 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/remotes/ 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/remotes/origin/ 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/refs/remotes/origin/HEAD 2023-05-24T04:00:39.083 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/config 2023-05-24T04:00:39.084 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/logs/ 2023-05-24T04:00:39.084 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/logs/HEAD 2023-05-24T04:00:39.084 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/logs/refs/ 2023-05-24T04:00:39.084 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/logs/refs/heads/ 2023-05-24T04:00:39.084 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/logs/refs/heads/master 2023-05-24T04:00:39.084 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/packed-refs 2023-05-24T04:00:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/ 2023-05-24T04:00:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/pre-commit.sample 2023-05-24T04:00:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/pre-rebase.sample 2023-05-24T04:00:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/post-update.sample 2023-05-24T04:00:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/pre-applypatch.sample 2023-05-24T04:00:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/commit-msg.sample 2023-05-24T04:00:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/applypatch-msg.sample 2023-05-24T04:00:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/prepare-commit-msg.sample 2023-05-24T04:00:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/hooks/update.sample 2023-05-24T04:00:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/objects/ 2023-05-24T04:00:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/objects/info/ 2023-05-24T04:00:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/objects/pack/ 2023-05-24T04:00:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.pack 2023-05-24T04:00:39.089 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.idx 2023-05-24T04:00:39.089 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/description 2023-05-24T04:00:39.089 INFO:teuthology.orchestra.run.smithi121.stdout:ior/.git/index 2023-05-24T04:00:39.090 INFO:teuthology.orchestra.run.smithi121.stdout:ior/META 2023-05-24T04:00:39.090 INFO:teuthology.orchestra.run.smithi121.stdout:ior/doc/ 2023-05-24T04:00:39.090 INFO:teuthology.orchestra.run.smithi121.stdout:ior/doc/Makefile 2023-05-24T04:00:39.090 INFO:teuthology.orchestra.run.smithi121.stdout:ior/doc/Makefile.in 2023-05-24T04:00:39.090 INFO:teuthology.orchestra.run.smithi121.stdout:ior/doc/USER_GUIDE 2023-05-24T04:00:39.090 INFO:teuthology.orchestra.run.smithi121.stdout:ior/doc/Makefile.am 2023-05-24T04:00:39.093 INFO:teuthology.orchestra.run.smithi162.stdout:ior/README 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/Makefile.am 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/config.status 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/ 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/Makefile 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/Makefile.in 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/cbif.o 2023-05-24T04:00:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/cbif 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/cbif.c 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/Makefile.am 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/.deps/ 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/contrib/.deps/cbif.Po 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/ 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/branches/ 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/HEAD 2023-05-24T04:00:39.095 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/info/ 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/info/exclude 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/ 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/tags/ 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/heads/ 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/heads/master 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/remotes/ 2023-05-24T04:00:39.096 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/remotes/origin/ 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/refs/remotes/origin/HEAD 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/config 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/logs/ 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/logs/HEAD 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/logs/refs/ 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/logs/refs/heads/ 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/logs/refs/heads/master 2023-05-24T04:00:39.097 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/packed-refs 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/ 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/pre-commit.sample 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/pre-rebase.sample 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/post-update.sample 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/pre-applypatch.sample 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/commit-msg.sample 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/applypatch-msg.sample 2023-05-24T04:00:39.098 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/prepare-commit-msg.sample 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/hooks/update.sample 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/objects/ 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/objects/info/ 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/objects/pack/ 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.pack 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.idx 2023-05-24T04:00:39.099 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/description 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/.git/index 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/META 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/doc/ 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/doc/Makefile 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/doc/Makefile.in 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/doc/USER_GUIDE 2023-05-24T04:00:39.100 INFO:teuthology.orchestra.run.smithi162.stdout:ior/doc/Makefile.am 2023-05-24T04:00:39.221 INFO:teuthology.orchestra.run.smithi155.stdout:checking metadata... yes 2023-05-24T04:00:39.222 INFO:teuthology.orchestra.run.smithi162.stdout:checking metadata... yes 2023-05-24T04:00:39.232 INFO:teuthology.orchestra.run.smithi121.stdout:checking metadata... yes 2023-05-24T04:00:39.249 INFO:teuthology.orchestra.run.smithi162.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-05-24T04:00:39.249 INFO:teuthology.orchestra.run.smithi162.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-05-24T04:00:39.250 INFO:teuthology.orchestra.run.smithi155.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-05-24T04:00:39.250 INFO:teuthology.orchestra.run.smithi155.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-05-24T04:00:39.256 INFO:teuthology.orchestra.run.smithi162.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-05-24T04:00:39.257 INFO:teuthology.orchestra.run.smithi155.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-05-24T04:00:39.261 INFO:teuthology.orchestra.run.smithi121.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-05-24T04:00:39.261 INFO:teuthology.orchestra.run.smithi121.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-05-24T04:00:39.269 INFO:teuthology.orchestra.run.smithi121.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-05-24T04:00:40.263 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether build environment is sane... yes 2023-05-24T04:00:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether build environment is sane... yes 2023-05-24T04:00:40.271 INFO:teuthology.orchestra.run.smithi162.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2023-05-24T04:00:40.271 INFO:teuthology.orchestra.run.smithi162.stdout:checking for gawk... gawk 2023-05-24T04:00:40.272 INFO:teuthology.orchestra.run.smithi155.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2023-05-24T04:00:40.273 INFO:teuthology.orchestra.run.smithi155.stdout:checking for gawk... gawk 2023-05-24T04:00:40.275 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether build environment is sane... yes 2023-05-24T04:00:40.278 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether make sets $(MAKE)... yes 2023-05-24T04:00:40.280 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether make sets $(MAKE)... yes 2023-05-24T04:00:40.283 INFO:teuthology.orchestra.run.smithi121.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2023-05-24T04:00:40.284 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2023-05-24T04:00:40.284 INFO:teuthology.orchestra.run.smithi121.stdout:checking for gawk... gawk 2023-05-24T04:00:40.286 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2023-05-24T04:00:40.287 INFO:teuthology.orchestra.run.smithi162.stdout:checking for style of include used by make... GNU 2023-05-24T04:00:40.289 INFO:teuthology.orchestra.run.smithi162.stdout:checking for mpicc... mpicc 2023-05-24T04:00:40.290 INFO:teuthology.orchestra.run.smithi162.stdout:checking for gcc... (cached) mpicc 2023-05-24T04:00:40.291 INFO:teuthology.orchestra.run.smithi155.stdout:checking for style of include used by make... GNU 2023-05-24T04:00:40.292 INFO:teuthology.orchestra.run.smithi155.stdout:checking for mpicc... mpicc 2023-05-24T04:00:40.293 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether make sets $(MAKE)... yes 2023-05-24T04:00:40.293 INFO:teuthology.orchestra.run.smithi155.stdout:checking for gcc... (cached) mpicc 2023-05-24T04:00:40.298 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2023-05-24T04:00:40.302 INFO:teuthology.orchestra.run.smithi121.stdout:checking for style of include used by make... GNU 2023-05-24T04:00:40.304 INFO:teuthology.orchestra.run.smithi121.stdout:checking for mpicc... mpicc 2023-05-24T04:00:40.304 INFO:teuthology.orchestra.run.smithi121.stdout:checking for gcc... (cached) mpicc 2023-05-24T04:00:41.096 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether the C compiler works... yes 2023-05-24T04:00:41.097 INFO:teuthology.orchestra.run.smithi162.stdout:checking for C compiler default output file name... a.out 2023-05-24T04:00:41.166 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether the C compiler works... yes 2023-05-24T04:00:41.167 INFO:teuthology.orchestra.run.smithi155.stdout:checking for C compiler default output file name... a.out 2023-05-24T04:00:41.172 INFO:teuthology.orchestra.run.smithi162.stdout:checking for suffix of executables... 2023-05-24T04:00:41.194 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether the C compiler works... yes 2023-05-24T04:00:41.194 INFO:teuthology.orchestra.run.smithi121.stdout:checking for C compiler default output file name... a.out 2023-05-24T04:00:41.245 INFO:teuthology.orchestra.run.smithi155.stdout:checking for suffix of executables... 2023-05-24T04:00:41.266 INFO:teuthology.orchestra.run.smithi121.stdout:checking for suffix of executables... 2023-05-24T04:00:41.359 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether we are cross compiling... no 2023-05-24T04:00:41.381 INFO:teuthology.orchestra.run.smithi162.stdout:checking for suffix of object files... o 2023-05-24T04:00:41.400 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether we are using the GNU C compiler... yes 2023-05-24T04:00:41.414 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether we are cross compiling... no 2023-05-24T04:00:41.420 INFO:teuthology.orchestra.run.smithi162.stdout:checking whether mpicc accepts -g... yes 2023-05-24T04:00:41.429 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether we are cross compiling... no 2023-05-24T04:00:41.436 INFO:teuthology.orchestra.run.smithi155.stdout:checking for suffix of object files... o 2023-05-24T04:00:41.450 INFO:teuthology.orchestra.run.smithi121.stdout:checking for suffix of object files... o 2023-05-24T04:00:41.455 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether we are using the GNU C compiler... yes 2023-05-24T04:00:41.469 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether we are using the GNU C compiler... yes 2023-05-24T04:00:41.477 INFO:teuthology.orchestra.run.smithi155.stdout:checking whether mpicc accepts -g... yes 2023-05-24T04:00:41.487 INFO:teuthology.orchestra.run.smithi121.stdout:checking whether mpicc accepts -g... yes 2023-05-24T04:00:41.560 INFO:teuthology.orchestra.run.smithi162.stdout:checking for mpicc option to accept ISO C89... none needed 2023-05-24T04:00:41.597 INFO:teuthology.orchestra.run.smithi121.stdout:checking for mpicc option to accept ISO C89... none needed 2023-05-24T04:00:41.602 INFO:teuthology.orchestra.run.smithi155.stdout:checking for mpicc option to accept ISO C89... none needed 2023-05-24T04:00:41.610 INFO:teuthology.orchestra.run.smithi162.stdout:checking dependency style of mpicc... gcc3 2023-05-24T04:00:41.648 INFO:teuthology.orchestra.run.smithi121.stdout:checking dependency style of mpicc... gcc3 2023-05-24T04:00:41.654 INFO:teuthology.orchestra.run.smithi155.stdout:checking dependency style of mpicc... gcc3 2023-05-24T04:00:42.727 INFO:teuthology.orchestra.run.smithi155.stdout:checking for function MPI_Init... no 2023-05-24T04:00:42.801 INFO:teuthology.orchestra.run.smithi121.stdout:checking for function MPI_Init... no 2023-05-24T04:00:42.818 INFO:teuthology.orchestra.run.smithi162.stdout:checking for function MPI_Init... no 2023-05-24T04:00:42.840 INFO:teuthology.orchestra.run.smithi155.stdout:checking for function MPI_Init in -lmpi... no 2023-05-24T04:00:42.914 INFO:teuthology.orchestra.run.smithi121.stdout:checking for function MPI_Init in -lmpi... no 2023-05-24T04:00:42.931 INFO:teuthology.orchestra.run.smithi162.stdout:checking for function MPI_Init in -lmpi... no 2023-05-24T04:00:43.245 INFO:teuthology.orchestra.run.smithi155.stdout:checking for function MPI_Init in -lmpich... no 2023-05-24T04:00:43.316 INFO:teuthology.orchestra.run.smithi121.stdout:checking for function MPI_Init in -lmpich... no 2023-05-24T04:00:43.321 INFO:teuthology.orchestra.run.smithi155.stdout:checking how to run the C preprocessor... mpicc -E 2023-05-24T04:00:43.346 INFO:teuthology.orchestra.run.smithi162.stdout:checking for function MPI_Init in -lmpich... no 2023-05-24T04:00:43.353 INFO:teuthology.orchestra.run.smithi155.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-24T04:00:43.355 INFO:teuthology.orchestra.run.smithi155.stdout:checking for egrep... /usr/bin/grep -E 2023-05-24T04:00:43.386 INFO:teuthology.orchestra.run.smithi121.stdout:checking how to run the C preprocessor... mpicc -E 2023-05-24T04:00:43.412 INFO:teuthology.orchestra.run.smithi162.stdout:checking how to run the C preprocessor... mpicc -E 2023-05-24T04:00:43.417 INFO:teuthology.orchestra.run.smithi121.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-24T04:00:43.419 INFO:teuthology.orchestra.run.smithi121.stdout:checking for egrep... /usr/bin/grep -E 2023-05-24T04:00:43.442 INFO:teuthology.orchestra.run.smithi162.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-24T04:00:43.443 INFO:teuthology.orchestra.run.smithi162.stdout:checking for egrep... /usr/bin/grep -E 2023-05-24T04:00:43.547 INFO:teuthology.orchestra.run.smithi155.stdout:checking for ANSI C header files... yes 2023-05-24T04:00:43.578 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/types.h... yes 2023-05-24T04:00:43.605 INFO:teuthology.orchestra.run.smithi121.stdout:checking for ANSI C header files... yes 2023-05-24T04:00:43.611 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/stat.h... yes 2023-05-24T04:00:43.627 INFO:teuthology.orchestra.run.smithi162.stdout:checking for ANSI C header files... yes 2023-05-24T04:00:43.634 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/types.h... yes 2023-05-24T04:00:43.643 INFO:teuthology.orchestra.run.smithi155.stdout:checking for stdlib.h... yes 2023-05-24T04:00:43.655 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/types.h... yes 2023-05-24T04:00:43.666 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/stat.h... yes 2023-05-24T04:00:43.677 INFO:teuthology.orchestra.run.smithi155.stdout:checking for string.h... yes 2023-05-24T04:00:43.686 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/stat.h... yes 2023-05-24T04:00:43.698 INFO:teuthology.orchestra.run.smithi121.stdout:checking for stdlib.h... yes 2023-05-24T04:00:43.711 INFO:teuthology.orchestra.run.smithi155.stdout:checking for memory.h... yes 2023-05-24T04:00:43.716 INFO:teuthology.orchestra.run.smithi162.stdout:checking for stdlib.h... yes 2023-05-24T04:00:43.733 INFO:teuthology.orchestra.run.smithi121.stdout:checking for string.h... yes 2023-05-24T04:00:43.744 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strings.h... yes 2023-05-24T04:00:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:checking for string.h... yes 2023-05-24T04:00:43.766 INFO:teuthology.orchestra.run.smithi121.stdout:checking for memory.h... yes 2023-05-24T04:00:43.779 INFO:teuthology.orchestra.run.smithi162.stdout:checking for memory.h... yes 2023-05-24T04:00:43.783 INFO:teuthology.orchestra.run.smithi155.stdout:checking for inttypes.h... yes 2023-05-24T04:00:43.800 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strings.h... yes 2023-05-24T04:00:43.810 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strings.h... yes 2023-05-24T04:00:43.819 INFO:teuthology.orchestra.run.smithi155.stdout:checking for stdint.h... yes 2023-05-24T04:00:43.837 INFO:teuthology.orchestra.run.smithi121.stdout:checking for inttypes.h... yes 2023-05-24T04:00:43.844 INFO:teuthology.orchestra.run.smithi162.stdout:checking for inttypes.h... yes 2023-05-24T04:00:43.871 INFO:teuthology.orchestra.run.smithi121.stdout:checking for stdint.h... yes 2023-05-24T04:00:43.874 INFO:teuthology.orchestra.run.smithi155.stdout:checking for unistd.h... yes 2023-05-24T04:00:43.876 INFO:teuthology.orchestra.run.smithi162.stdout:checking for stdint.h... yes 2023-05-24T04:00:43.913 INFO:teuthology.orchestra.run.smithi121.stdout:checking for unistd.h... yes 2023-05-24T04:00:43.915 INFO:teuthology.orchestra.run.smithi155.stdout:checking fcntl.h usability... yes 2023-05-24T04:00:43.916 INFO:teuthology.orchestra.run.smithi162.stdout:checking for unistd.h... yes 2023-05-24T04:00:43.930 INFO:teuthology.orchestra.run.smithi155.stdout:checking fcntl.h presence... yes 2023-05-24T04:00:43.930 INFO:teuthology.orchestra.run.smithi155.stdout:checking for fcntl.h... yes 2023-05-24T04:00:43.954 INFO:teuthology.orchestra.run.smithi121.stdout:checking fcntl.h usability... yes 2023-05-24T04:00:43.968 INFO:teuthology.orchestra.run.smithi121.stdout:checking fcntl.h presence... yes 2023-05-24T04:00:43.968 INFO:teuthology.orchestra.run.smithi121.stdout:checking for fcntl.h... yes 2023-05-24T04:00:43.971 INFO:teuthology.orchestra.run.smithi162.stdout:checking fcntl.h usability... yes 2023-05-24T04:00:43.972 INFO:teuthology.orchestra.run.smithi155.stdout:checking libintl.h usability... yes 2023-05-24T04:00:43.984 INFO:teuthology.orchestra.run.smithi162.stdout:checking fcntl.h presence... yes 2023-05-24T04:00:43.984 INFO:teuthology.orchestra.run.smithi162.stdout:checking for fcntl.h... yes 2023-05-24T04:00:43.986 INFO:teuthology.orchestra.run.smithi155.stdout:checking libintl.h presence... yes 2023-05-24T04:00:43.987 INFO:teuthology.orchestra.run.smithi155.stdout:checking for libintl.h... yes 2023-05-24T04:00:43.991 INFO:teuthology.orchestra.run.smithi155.stdout:checking for stdlib.h... (cached) yes 2023-05-24T04:00:43.996 INFO:teuthology.orchestra.run.smithi155.stdout:checking for string.h... (cached) yes 2023-05-24T04:00:44.001 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strings.h... (cached) yes 2023-05-24T04:00:44.010 INFO:teuthology.orchestra.run.smithi121.stdout:checking libintl.h usability... yes 2023-05-24T04:00:44.019 INFO:teuthology.orchestra.run.smithi121.stdout:checking libintl.h presence... yes 2023-05-24T04:00:44.020 INFO:teuthology.orchestra.run.smithi121.stdout:checking for libintl.h... yes 2023-05-24T04:00:44.022 INFO:teuthology.orchestra.run.smithi162.stdout:checking libintl.h usability... yes 2023-05-24T04:00:44.024 INFO:teuthology.orchestra.run.smithi121.stdout:checking for stdlib.h... (cached) yes 2023-05-24T04:00:44.029 INFO:teuthology.orchestra.run.smithi121.stdout:checking for string.h... (cached) yes 2023-05-24T04:00:44.032 INFO:teuthology.orchestra.run.smithi162.stdout:checking libintl.h presence... yes 2023-05-24T04:00:44.032 INFO:teuthology.orchestra.run.smithi162.stdout:checking for libintl.h... yes 2023-05-24T04:00:44.033 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strings.h... (cached) yes 2023-05-24T04:00:44.038 INFO:teuthology.orchestra.run.smithi162.stdout:checking for stdlib.h... (cached) yes 2023-05-24T04:00:44.042 INFO:teuthology.orchestra.run.smithi162.stdout:checking for string.h... (cached) yes 2023-05-24T04:00:44.047 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strings.h... (cached) yes 2023-05-24T04:00:44.079 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/ioctl.h usability... yes 2023-05-24T04:00:44.092 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/ioctl.h presence... yes 2023-05-24T04:00:44.093 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/ioctl.h... yes 2023-05-24T04:00:44.110 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/ioctl.h usability... yes 2023-05-24T04:00:44.122 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/ioctl.h presence... yes 2023-05-24T04:00:44.123 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/ioctl.h... yes 2023-05-24T04:00:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/ioctl.h usability... yes 2023-05-24T04:00:44.163 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/ioctl.h presence... yes 2023-05-24T04:00:44.164 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/ioctl.h... yes 2023-05-24T04:00:44.186 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/param.h usability... yes 2023-05-24T04:00:44.188 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/param.h usability... yes 2023-05-24T04:00:44.202 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/param.h presence... yes 2023-05-24T04:00:44.203 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/param.h... yes 2023-05-24T04:00:44.203 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/param.h presence... yes 2023-05-24T04:00:44.204 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/param.h... yes 2023-05-24T04:00:44.232 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/param.h usability... yes 2023-05-24T04:00:44.240 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/statfs.h usability... yes 2023-05-24T04:00:44.241 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/statfs.h usability... yes 2023-05-24T04:00:44.247 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/param.h presence... yes 2023-05-24T04:00:44.247 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/param.h... yes 2023-05-24T04:00:44.250 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/statfs.h presence... yes 2023-05-24T04:00:44.251 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/statfs.h... yes 2023-05-24T04:00:44.252 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/statfs.h presence... yes 2023-05-24T04:00:44.252 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/statfs.h... yes 2023-05-24T04:00:44.285 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/statfs.h usability... yes 2023-05-24T04:00:44.288 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/statvfs.h usability... yes 2023-05-24T04:00:44.291 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/statvfs.h usability... yes 2023-05-24T04:00:44.297 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/statfs.h presence... yes 2023-05-24T04:00:44.298 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/statfs.h... yes 2023-05-24T04:00:44.299 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/statvfs.h presence... yes 2023-05-24T04:00:44.300 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/statvfs.h... yes 2023-05-24T04:00:44.302 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/statvfs.h presence... yes 2023-05-24T04:00:44.303 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/statvfs.h... yes 2023-05-24T04:00:44.333 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/statvfs.h usability... yes 2023-05-24T04:00:44.336 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/time.h usability... yes 2023-05-24T04:00:44.342 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/time.h usability... yes 2023-05-24T04:00:44.344 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/statvfs.h presence... yes 2023-05-24T04:00:44.344 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/statvfs.h... yes 2023-05-24T04:00:44.347 INFO:teuthology.orchestra.run.smithi155.stdout:checking sys/time.h presence... yes 2023-05-24T04:00:44.347 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sys/time.h... yes 2023-05-24T04:00:44.352 INFO:teuthology.orchestra.run.smithi155.stdout:checking for unistd.h... (cached) yes 2023-05-24T04:00:44.353 INFO:teuthology.orchestra.run.smithi121.stdout:checking sys/time.h presence... yes 2023-05-24T04:00:44.353 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sys/time.h... yes 2023-05-24T04:00:44.357 INFO:teuthology.orchestra.run.smithi121.stdout:checking for unistd.h... (cached) yes 2023-05-24T04:00:44.382 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/time.h usability... yes 2023-05-24T04:00:44.393 INFO:teuthology.orchestra.run.smithi162.stdout:checking sys/time.h presence... yes 2023-05-24T04:00:44.394 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sys/time.h... yes 2023-05-24T04:00:44.398 INFO:teuthology.orchestra.run.smithi162.stdout:checking for unistd.h... (cached) yes 2023-05-24T04:00:44.406 INFO:teuthology.orchestra.run.smithi155.stdout:checking wchar.h usability... yes 2023-05-24T04:00:44.409 INFO:teuthology.orchestra.run.smithi121.stdout:checking wchar.h usability... yes 2023-05-24T04:00:44.419 INFO:teuthology.orchestra.run.smithi155.stdout:checking wchar.h presence... yes 2023-05-24T04:00:44.419 INFO:teuthology.orchestra.run.smithi155.stdout:checking for wchar.h... yes 2023-05-24T04:00:44.421 INFO:teuthology.orchestra.run.smithi121.stdout:checking wchar.h presence... yes 2023-05-24T04:00:44.422 INFO:teuthology.orchestra.run.smithi121.stdout:checking for wchar.h... yes 2023-05-24T04:00:44.448 INFO:teuthology.orchestra.run.smithi162.stdout:checking wchar.h usability... yes 2023-05-24T04:00:44.460 INFO:teuthology.orchestra.run.smithi162.stdout:checking wchar.h presence... yes 2023-05-24T04:00:44.460 INFO:teuthology.orchestra.run.smithi162.stdout:checking for wchar.h... yes 2023-05-24T04:00:44.492 INFO:teuthology.orchestra.run.smithi121.stdout:checking for size_t... yes 2023-05-24T04:00:44.497 INFO:teuthology.orchestra.run.smithi155.stdout:checking for size_t... yes 2023-05-24T04:00:44.534 INFO:teuthology.orchestra.run.smithi162.stdout:checking for size_t... yes 2023-05-24T04:00:44.564 INFO:teuthology.orchestra.run.smithi121.stdout:checking for getpagesize... yes 2023-05-24T04:00:44.567 INFO:teuthology.orchestra.run.smithi155.stdout:checking for getpagesize... yes 2023-05-24T04:00:44.609 INFO:teuthology.orchestra.run.smithi162.stdout:checking for getpagesize... yes 2023-05-24T04:00:44.637 INFO:teuthology.orchestra.run.smithi155.stdout:checking for gettimeofday... yes 2023-05-24T04:00:44.638 INFO:teuthology.orchestra.run.smithi121.stdout:checking for gettimeofday... yes 2023-05-24T04:00:44.683 INFO:teuthology.orchestra.run.smithi162.stdout:checking for gettimeofday... yes 2023-05-24T04:00:44.711 INFO:teuthology.orchestra.run.smithi155.stdout:checking for memset... yes 2023-05-24T04:00:44.713 INFO:teuthology.orchestra.run.smithi121.stdout:checking for memset... yes 2023-05-24T04:00:44.763 INFO:teuthology.orchestra.run.smithi162.stdout:checking for memset... yes 2023-05-24T04:00:44.780 INFO:teuthology.orchestra.run.smithi155.stdout:checking for mkdir... yes 2023-05-24T04:00:44.786 INFO:teuthology.orchestra.run.smithi121.stdout:checking for mkdir... yes 2023-05-24T04:00:44.838 INFO:teuthology.orchestra.run.smithi162.stdout:checking for mkdir... yes 2023-05-24T04:00:44.854 INFO:teuthology.orchestra.run.smithi155.stdout:checking for pow... no 2023-05-24T04:00:44.865 INFO:teuthology.orchestra.run.smithi121.stdout:checking for pow... no 2023-05-24T04:00:44.915 INFO:teuthology.orchestra.run.smithi162.stdout:checking for pow... no 2023-05-24T04:00:44.920 INFO:teuthology.orchestra.run.smithi155.stdout:checking for putenv... yes 2023-05-24T04:00:44.936 INFO:teuthology.orchestra.run.smithi121.stdout:checking for putenv... yes 2023-05-24T04:00:44.984 INFO:teuthology.orchestra.run.smithi162.stdout:checking for putenv... yes 2023-05-24T04:00:44.988 INFO:teuthology.orchestra.run.smithi155.stdout:checking for realpath... yes 2023-05-24T04:00:45.008 INFO:teuthology.orchestra.run.smithi121.stdout:checking for realpath... yes 2023-05-24T04:00:45.056 INFO:teuthology.orchestra.run.smithi162.stdout:checking for realpath... yes 2023-05-24T04:00:45.058 INFO:teuthology.orchestra.run.smithi155.stdout:checking for regcomp... yes 2023-05-24T04:00:45.081 INFO:teuthology.orchestra.run.smithi121.stdout:checking for regcomp... yes 2023-05-24T04:00:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:checking for regcomp... yes 2023-05-24T04:00:45.130 INFO:teuthology.orchestra.run.smithi155.stdout:checking for sqrt... no 2023-05-24T04:00:45.155 INFO:teuthology.orchestra.run.smithi121.stdout:checking for sqrt... no 2023-05-24T04:00:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:checking for sqrt... no 2023-05-24T04:00:45.200 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strcasecmp... yes 2023-05-24T04:00:45.236 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strcasecmp... yes 2023-05-24T04:00:45.269 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strcasecmp... yes 2023-05-24T04:00:45.274 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strchr... yes 2023-05-24T04:00:45.309 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strchr... yes 2023-05-24T04:00:45.342 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strchr... yes 2023-05-24T04:00:45.343 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strerror... yes 2023-05-24T04:00:45.381 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strerror... yes 2023-05-24T04:00:45.413 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strerror... yes 2023-05-24T04:00:45.416 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strncasecmp... yes 2023-05-24T04:00:45.454 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strncasecmp... yes 2023-05-24T04:00:45.487 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strncasecmp... yes 2023-05-24T04:00:45.488 INFO:teuthology.orchestra.run.smithi155.stdout:checking for strstr... yes 2023-05-24T04:00:45.525 INFO:teuthology.orchestra.run.smithi121.stdout:checking for strstr... yes 2023-05-24T04:00:45.556 INFO:teuthology.orchestra.run.smithi162.stdout:checking for strstr... yes 2023-05-24T04:00:45.557 INFO:teuthology.orchestra.run.smithi155.stdout:checking for uname... yes 2023-05-24T04:00:45.595 INFO:teuthology.orchestra.run.smithi121.stdout:checking for uname... yes 2023-05-24T04:00:45.629 INFO:teuthology.orchestra.run.smithi162.stdout:checking for uname... yes 2023-05-24T04:00:45.711 INFO:teuthology.orchestra.run.smithi155.stdout:checking for library containing sqrt... -lm 2023-05-24T04:00:45.712 INFO:teuthology.orchestra.run.smithi155.stdout:checking for special C compiler options needed for large files... no 2023-05-24T04:00:45.732 INFO:teuthology.orchestra.run.smithi155.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2023-05-24T04:00:45.754 INFO:teuthology.orchestra.run.smithi121.stdout:checking for library containing sqrt... -lm 2023-05-24T04:00:45.754 INFO:teuthology.orchestra.run.smithi121.stdout:checking for special C compiler options needed for large files... no 2023-05-24T04:00:45.763 INFO:teuthology.orchestra.run.smithi155.stdout:checking lustre/lustre_user.h usability... no 2023-05-24T04:00:45.775 INFO:teuthology.orchestra.run.smithi121.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2023-05-24T04:00:45.775 INFO:teuthology.orchestra.run.smithi155.stdout:checking lustre/lustre_user.h presence... no 2023-05-24T04:00:45.776 INFO:teuthology.orchestra.run.smithi155.stdout:checking for lustre/lustre_user.h... no 2023-05-24T04:00:45.790 INFO:teuthology.orchestra.run.smithi162.stdout:checking for library containing sqrt... -lm 2023-05-24T04:00:45.790 INFO:teuthology.orchestra.run.smithi162.stdout:checking for special C compiler options needed for large files... no 2023-05-24T04:00:45.796 INFO:teuthology.orchestra.run.smithi155.stdout:configure: creating ./config.status 2023-05-24T04:00:45.806 INFO:teuthology.orchestra.run.smithi121.stdout:checking lustre/lustre_user.h usability... no 2023-05-24T04:00:45.810 INFO:teuthology.orchestra.run.smithi162.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2023-05-24T04:00:45.819 INFO:teuthology.orchestra.run.smithi121.stdout:checking lustre/lustre_user.h presence... no 2023-05-24T04:00:45.819 INFO:teuthology.orchestra.run.smithi121.stdout:checking for lustre/lustre_user.h... no 2023-05-24T04:00:45.838 INFO:teuthology.orchestra.run.smithi121.stdout:configure: creating ./config.status 2023-05-24T04:00:45.843 INFO:teuthology.orchestra.run.smithi162.stdout:checking lustre/lustre_user.h usability... no 2023-05-24T04:00:45.855 INFO:teuthology.orchestra.run.smithi162.stdout:checking lustre/lustre_user.h presence... no 2023-05-24T04:00:45.856 INFO:teuthology.orchestra.run.smithi162.stdout:checking for lustre/lustre_user.h... no 2023-05-24T04:00:45.856 INFO:teuthology.orchestra.run.smithi155.stdout:config.status: creating Makefile 2023-05-24T04:00:45.864 INFO:teuthology.orchestra.run.smithi155.stdout:config.status: creating src/Makefile 2023-05-24T04:00:45.875 INFO:teuthology.orchestra.run.smithi155.stdout:config.status: creating contrib/Makefile 2023-05-24T04:00:45.883 INFO:teuthology.orchestra.run.smithi162.stdout:configure: creating ./config.status 2023-05-24T04:00:45.885 INFO:teuthology.orchestra.run.smithi155.stdout:config.status: creating doc/Makefile 2023-05-24T04:00:45.894 INFO:teuthology.orchestra.run.smithi121.stdout:config.status: creating Makefile 2023-05-24T04:00:45.895 INFO:teuthology.orchestra.run.smithi155.stdout:config.status: creating src/config.h 2023-05-24T04:00:45.903 INFO:teuthology.orchestra.run.smithi121.stdout:config.status: creating src/Makefile 2023-05-24T04:00:45.905 INFO:teuthology.orchestra.run.smithi155.stdout:config.status: executing depfiles commands 2023-05-24T04:00:45.916 INFO:teuthology.orchestra.run.smithi121.stdout:config.status: creating contrib/Makefile 2023-05-24T04:00:45.926 INFO:teuthology.orchestra.run.smithi121.stdout:config.status: creating doc/Makefile 2023-05-24T04:00:45.937 INFO:teuthology.orchestra.run.smithi121.stdout:config.status: creating src/config.h 2023-05-24T04:00:45.939 INFO:teuthology.orchestra.run.smithi162.stdout:config.status: creating Makefile 2023-05-24T04:00:45.945 INFO:teuthology.orchestra.run.smithi121.stdout:config.status: executing depfiles commands 2023-05-24T04:00:45.947 INFO:teuthology.orchestra.run.smithi162.stdout:config.status: creating src/Makefile 2023-05-24T04:00:45.958 INFO:teuthology.orchestra.run.smithi162.stdout:config.status: creating contrib/Makefile 2023-05-24T04:00:45.963 INFO:teuthology.orchestra.run.smithi155.stdout:Making all in src 2023-05-24T04:00:45.965 INFO:teuthology.orchestra.run.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:45.967 INFO:teuthology.orchestra.run.smithi155.stdout:make all-am 2023-05-24T04:00:45.968 INFO:teuthology.orchestra.run.smithi162.stdout:config.status: creating doc/Makefile 2023-05-24T04:00:45.970 INFO:teuthology.orchestra.run.smithi155.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:45.980 INFO:teuthology.orchestra.run.smithi162.stdout:config.status: creating src/config.h 2023-05-24T04:00:45.987 INFO:teuthology.orchestra.run.smithi162.stdout:config.status: executing depfiles commands 2023-05-24T04:00:46.001 INFO:teuthology.orchestra.run.smithi121.stdout:Making all in src 2023-05-24T04:00:46.003 INFO:teuthology.orchestra.run.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:46.005 INFO:teuthology.orchestra.run.smithi121.stdout:make all-am 2023-05-24T04:00:46.008 INFO:teuthology.orchestra.run.smithi121.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:46.014 INFO:teuthology.orchestra.run.smithi155.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT ior.o -MD -MP -MF .deps/ior.Tpo -c -o ior.o ior.c 2023-05-24T04:00:46.041 INFO:teuthology.orchestra.run.smithi162.stdout:Making all in src 2023-05-24T04:00:46.043 INFO:teuthology.orchestra.run.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:46.045 INFO:teuthology.orchestra.run.smithi162.stdout:make all-am 2023-05-24T04:00:46.047 INFO:teuthology.orchestra.run.smithi162.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:46.059 INFO:teuthology.orchestra.run.smithi121.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT ior.o -MD -MP -MF .deps/ior.Tpo -c -o ior.o ior.c 2023-05-24T04:00:46.084 INFO:teuthology.orchestra.run.smithi162.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT ior.o -MD -MP -MF .deps/ior.Tpo -c -o ior.o ior.c 2023-05-24T04:00:46.229 INFO:teuthology.orchestra.run.smithi155.stderr:ior.c: In function 'CountTasksPerNode': 2023-05-24T04:00:46.229 INFO:teuthology.orchestra.run.smithi155.stderr:ior.c:476:42: warning: '%s' directive writing up to 1023 bytes into a region of size between 1004 and 1014 [-Wformat-overflow=] 2023-05-24T04:00:46.229 INFO:teuthology.orchestra.run.smithi155.stderr: 476 | sprintf(tmp, "task %d on %s", rank, localhost); 2023-05-24T04:00:46.229 INFO:teuthology.orchestra.run.smithi155.stderr: | ^~ ~~~~~~~~~ 2023-05-24T04:00:46.230 INFO:teuthology.orchestra.run.smithi155.stderr:In file included from /usr/include/stdio.h:894, 2023-05-24T04:00:46.230 INFO:teuthology.orchestra.run.smithi155.stderr: from ior.c:15: 2023-05-24T04:00:46.230 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 11 and 1044 bytes into a destination of size 1024 2023-05-24T04:00:46.230 INFO:teuthology.orchestra.run.smithi155.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2023-05-24T04:00:46.230 INFO:teuthology.orchestra.run.smithi155.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.230 INFO:teuthology.orchestra.run.smithi155.stderr: 39 | __glibc_objsize (__s), __fmt, 2023-05-24T04:00:46.231 INFO:teuthology.orchestra.run.smithi155.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.231 INFO:teuthology.orchestra.run.smithi155.stderr: 40 | __va_arg_pack ()); 2023-05-24T04:00:46.231 INFO:teuthology.orchestra.run.smithi155.stderr: | ~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.284 INFO:teuthology.orchestra.run.smithi162.stderr:ior.c: In function 'CountTasksPerNode': 2023-05-24T04:00:46.285 INFO:teuthology.orchestra.run.smithi162.stderr:ior.c:476:42: warning: '%s' directive writing up to 1023 bytes into a region of size between 1004 and 1014 [-Wformat-overflow=] 2023-05-24T04:00:46.285 INFO:teuthology.orchestra.run.smithi162.stderr: 476 | sprintf(tmp, "task %d on %s", rank, localhost); 2023-05-24T04:00:46.286 INFO:teuthology.orchestra.run.smithi162.stderr: | ^~ ~~~~~~~~~ 2023-05-24T04:00:46.286 INFO:teuthology.orchestra.run.smithi162.stderr:In file included from /usr/include/stdio.h:894, 2023-05-24T04:00:46.286 INFO:teuthology.orchestra.run.smithi162.stderr: from ior.c:15: 2023-05-24T04:00:46.287 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 11 and 1044 bytes into a destination of size 1024 2023-05-24T04:00:46.287 INFO:teuthology.orchestra.run.smithi162.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2023-05-24T04:00:46.288 INFO:teuthology.orchestra.run.smithi162.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.288 INFO:teuthology.orchestra.run.smithi162.stderr: 39 | __glibc_objsize (__s), __fmt, 2023-05-24T04:00:46.288 INFO:teuthology.orchestra.run.smithi162.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.288 INFO:teuthology.orchestra.run.smithi162.stderr: 40 | __va_arg_pack ()); 2023-05-24T04:00:46.289 INFO:teuthology.orchestra.run.smithi162.stderr: | ~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.289 INFO:teuthology.orchestra.run.smithi121.stderr:ior.c: In function 'CountTasksPerNode': 2023-05-24T04:00:46.290 INFO:teuthology.orchestra.run.smithi121.stderr:ior.c:476:42: warning: '%s' directive writing up to 1023 bytes into a region of size between 1004 and 1014 [-Wformat-overflow=] 2023-05-24T04:00:46.290 INFO:teuthology.orchestra.run.smithi121.stderr: 476 | sprintf(tmp, "task %d on %s", rank, localhost); 2023-05-24T04:00:46.290 INFO:teuthology.orchestra.run.smithi121.stderr: | ^~ ~~~~~~~~~ 2023-05-24T04:00:46.290 INFO:teuthology.orchestra.run.smithi121.stderr:In file included from /usr/include/stdio.h:894, 2023-05-24T04:00:46.290 INFO:teuthology.orchestra.run.smithi121.stderr: from ior.c:15: 2023-05-24T04:00:46.290 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 11 and 1044 bytes into a destination of size 1024 2023-05-24T04:00:46.291 INFO:teuthology.orchestra.run.smithi121.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2023-05-24T04:00:46.291 INFO:teuthology.orchestra.run.smithi121.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.291 INFO:teuthology.orchestra.run.smithi121.stderr: 39 | __glibc_objsize (__s), __fmt, 2023-05-24T04:00:46.291 INFO:teuthology.orchestra.run.smithi121.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.291 INFO:teuthology.orchestra.run.smithi121.stderr: 40 | __va_arg_pack ()); 2023-05-24T04:00:46.291 INFO:teuthology.orchestra.run.smithi121.stderr: | ~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:46.977 INFO:teuthology.orchestra.run.smithi162.stdout:mv -f .deps/ior.Tpo .deps/ior.Po 2023-05-24T04:00:46.978 INFO:teuthology.orchestra.run.smithi155.stdout:mv -f .deps/ior.Tpo .deps/ior.Po 2023-05-24T04:00:46.979 INFO:teuthology.orchestra.run.smithi162.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT utilities.o -MD -MP -MF .deps/utilities.Tpo -c -o utilities.o utilities.c 2023-05-24T04:00:46.980 INFO:teuthology.orchestra.run.smithi155.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT utilities.o -MD -MP -MF .deps/utilities.Tpo -c -o utilities.o utilities.c 2023-05-24T04:00:47.009 INFO:teuthology.orchestra.run.smithi121.stdout:mv -f .deps/ior.Tpo .deps/ior.Po 2023-05-24T04:00:47.012 INFO:teuthology.orchestra.run.smithi121.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT utilities.o -MD -MP -MF .deps/utilities.Tpo -c -o utilities.o utilities.c 2023-05-24T04:00:47.171 INFO:teuthology.orchestra.run.smithi162.stdout:mv -f .deps/utilities.Tpo .deps/utilities.Po 2023-05-24T04:00:47.173 INFO:teuthology.orchestra.run.smithi162.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT parse_options.o -MD -MP -MF .deps/parse_options.Tpo -c -o parse_options.o parse_options.c 2023-05-24T04:00:47.178 INFO:teuthology.orchestra.run.smithi155.stdout:mv -f .deps/utilities.Tpo .deps/utilities.Po 2023-05-24T04:00:47.180 INFO:teuthology.orchestra.run.smithi155.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT parse_options.o -MD -MP -MF .deps/parse_options.Tpo -c -o parse_options.o parse_options.c 2023-05-24T04:00:47.202 INFO:teuthology.orchestra.run.smithi121.stdout:mv -f .deps/utilities.Tpo .deps/utilities.Po 2023-05-24T04:00:47.204 INFO:teuthology.orchestra.run.smithi121.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT parse_options.o -MD -MP -MF .deps/parse_options.Tpo -c -o parse_options.o parse_options.c 2023-05-24T04:00:47.382 INFO:teuthology.orchestra.run.smithi162.stdout:mv -f .deps/parse_options.Tpo .deps/parse_options.Po 2023-05-24T04:00:47.385 INFO:teuthology.orchestra.run.smithi162.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT aiori-POSIX.o -MD -MP -MF .deps/aiori-POSIX.Tpo -c -o aiori-POSIX.o aiori-POSIX.c 2023-05-24T04:00:47.404 INFO:teuthology.orchestra.run.smithi155.stdout:mv -f .deps/parse_options.Tpo .deps/parse_options.Po 2023-05-24T04:00:47.405 INFO:teuthology.orchestra.run.smithi155.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT aiori-POSIX.o -MD -MP -MF .deps/aiori-POSIX.Tpo -c -o aiori-POSIX.o aiori-POSIX.c 2023-05-24T04:00:47.409 INFO:teuthology.orchestra.run.smithi121.stdout:mv -f .deps/parse_options.Tpo .deps/parse_options.Po 2023-05-24T04:00:47.411 INFO:teuthology.orchestra.run.smithi121.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT aiori-POSIX.o -MD -MP -MF .deps/aiori-POSIX.Tpo -c -o aiori-POSIX.o aiori-POSIX.c 2023-05-24T04:00:47.536 INFO:teuthology.orchestra.run.smithi162.stdout:mv -f .deps/aiori-POSIX.Tpo .deps/aiori-POSIX.Po 2023-05-24T04:00:47.539 INFO:teuthology.orchestra.run.smithi162.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT aiori-MPIIO.o -MD -MP -MF .deps/aiori-MPIIO.Tpo -c -o aiori-MPIIO.o aiori-MPIIO.c 2023-05-24T04:00:47.564 INFO:teuthology.orchestra.run.smithi121.stdout:mv -f .deps/aiori-POSIX.Tpo .deps/aiori-POSIX.Po 2023-05-24T04:00:47.566 INFO:teuthology.orchestra.run.smithi121.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT aiori-MPIIO.o -MD -MP -MF .deps/aiori-MPIIO.Tpo -c -o aiori-MPIIO.o aiori-MPIIO.c 2023-05-24T04:00:47.569 INFO:teuthology.orchestra.run.smithi155.stdout:mv -f .deps/aiori-POSIX.Tpo .deps/aiori-POSIX.Po 2023-05-24T04:00:47.571 INFO:teuthology.orchestra.run.smithi155.stdout:mpicc -DHAVE_CONFIG_H -I. -g -O2 -MT aiori-MPIIO.o -MD -MP -MF .deps/aiori-MPIIO.Tpo -c -o aiori-MPIIO.o aiori-MPIIO.c 2023-05-24T04:00:47.604 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c: In function 'MPIIO_Xfer': 2023-05-24T04:00:47.604 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c:236:24: warning: assignment to 'int (*)(struct ADIOI_FileD *, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.604 INFO:teuthology.orchestra.run.smithi162.stderr: 236 | Access = MPI_File_write; 2023-05-24T04:00:47.604 INFO:teuthology.orchestra.run.smithi162.stderr: | ^ 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c:237:27: warning: assignment to 'int (*)(struct ADIOI_FileD *, MPI_Offset, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, MPI_Offset, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr: 237 | Access_at = MPI_File_write_at; 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr: | ^ 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c:238:28: warning: assignment to 'int (*)(struct ADIOI_FileD *, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr: 238 | Access_all = MPI_File_write_all; 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr: | ^ 2023-05-24T04:00:47.605 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c:239:31: warning: assignment to 'int (*)(struct ADIOI_FileD *, MPI_Offset, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, MPI_Offset, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.606 INFO:teuthology.orchestra.run.smithi162.stderr: 239 | Access_at_all = MPI_File_write_at_all; 2023-05-24T04:00:47.606 INFO:teuthology.orchestra.run.smithi162.stderr: | ^ 2023-05-24T04:00:47.628 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c: In function 'MPIIO_SetVersion': 2023-05-24T04:00:47.628 INFO:teuthology.orchestra.run.smithi162.stderr:aiori-MPIIO.c:378:38: warning: ' (version=' directive writing 10 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr: 378 | sprintf(test->apiVersion, "%s (version=%d, subversion=%d)", 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr: | ^~~~~~~~~~ 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr:In file included from /usr/include/stdio.h:894, 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr: from aiori-MPIIO.c:19: 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 27 and 1070 bytes into a destination of size 1024 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.629 INFO:teuthology.orchestra.run.smithi162.stderr: 39 | __glibc_objsize (__s), __fmt, 2023-05-24T04:00:47.630 INFO:teuthology.orchestra.run.smithi162.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.630 INFO:teuthology.orchestra.run.smithi162.stderr: 40 | __va_arg_pack ()); 2023-05-24T04:00:47.630 INFO:teuthology.orchestra.run.smithi162.stderr: | ~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.636 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c: In function 'MPIIO_Xfer': 2023-05-24T04:00:47.636 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c:236:24: warning: assignment to 'int (*)(struct ADIOI_FileD *, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr: 236 | Access = MPI_File_write; 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr: | ^ 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c:237:27: warning: assignment to 'int (*)(struct ADIOI_FileD *, MPI_Offset, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, MPI_Offset, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr: 237 | Access_at = MPI_File_write_at; 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr: | ^ 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c:238:28: warning: assignment to 'int (*)(struct ADIOI_FileD *, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr: 238 | Access_all = MPI_File_write_all; 2023-05-24T04:00:47.637 INFO:teuthology.orchestra.run.smithi121.stderr: | ^ 2023-05-24T04:00:47.638 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c:239:31: warning: assignment to 'int (*)(struct ADIOI_FileD *, MPI_Offset, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, MPI_Offset, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.638 INFO:teuthology.orchestra.run.smithi121.stderr: 239 | Access_at_all = MPI_File_write_at_all; 2023-05-24T04:00:47.638 INFO:teuthology.orchestra.run.smithi121.stderr: | ^ 2023-05-24T04:00:47.642 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c: In function 'MPIIO_Xfer': 2023-05-24T04:00:47.642 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c:236:24: warning: assignment to 'int (*)(struct ADIOI_FileD *, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.642 INFO:teuthology.orchestra.run.smithi155.stderr: 236 | Access = MPI_File_write; 2023-05-24T04:00:47.643 INFO:teuthology.orchestra.run.smithi155.stderr: | ^ 2023-05-24T04:00:47.643 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c:237:27: warning: assignment to 'int (*)(struct ADIOI_FileD *, MPI_Offset, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, MPI_Offset, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.643 INFO:teuthology.orchestra.run.smithi155.stderr: 237 | Access_at = MPI_File_write_at; 2023-05-24T04:00:47.643 INFO:teuthology.orchestra.run.smithi155.stderr: | ^ 2023-05-24T04:00:47.643 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c:238:28: warning: assignment to 'int (*)(struct ADIOI_FileD *, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.643 INFO:teuthology.orchestra.run.smithi155.stderr: 238 | Access_all = MPI_File_write_all; 2023-05-24T04:00:47.644 INFO:teuthology.orchestra.run.smithi155.stderr: | ^ 2023-05-24T04:00:47.644 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c:239:31: warning: assignment to 'int (*)(struct ADIOI_FileD *, MPI_Offset, void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, void *, int, int, MPI_Status *)'} from incompatible pointer type 'int (*)(struct ADIOI_FileD *, MPI_Offset, const void *, int, MPI_Datatype, MPI_Status *)' {aka 'int (*)(struct ADIOI_FileD *, long int, const void *, int, int, MPI_Status *)'} [-Wincompatible-pointer-types] 2023-05-24T04:00:47.644 INFO:teuthology.orchestra.run.smithi155.stderr: 239 | Access_at_all = MPI_File_write_at_all; 2023-05-24T04:00:47.644 INFO:teuthology.orchestra.run.smithi155.stderr: | ^ 2023-05-24T04:00:47.652 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c: In function 'MPIIO_SetVersion': 2023-05-24T04:00:47.652 INFO:teuthology.orchestra.run.smithi121.stderr:aiori-MPIIO.c:378:38: warning: ' (version=' directive writing 10 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-05-24T04:00:47.653 INFO:teuthology.orchestra.run.smithi121.stderr: 378 | sprintf(test->apiVersion, "%s (version=%d, subversion=%d)", 2023-05-24T04:00:47.653 INFO:teuthology.orchestra.run.smithi121.stderr: | ^~~~~~~~~~ 2023-05-24T04:00:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:In file included from /usr/include/stdio.h:894, 2023-05-24T04:00:47.653 INFO:teuthology.orchestra.run.smithi121.stderr: from aiori-MPIIO.c:19: 2023-05-24T04:00:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 27 and 1070 bytes into a destination of size 1024 2023-05-24T04:00:47.654 INFO:teuthology.orchestra.run.smithi121.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2023-05-24T04:00:47.654 INFO:teuthology.orchestra.run.smithi121.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.654 INFO:teuthology.orchestra.run.smithi121.stderr: 39 | __glibc_objsize (__s), __fmt, 2023-05-24T04:00:47.654 INFO:teuthology.orchestra.run.smithi121.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.655 INFO:teuthology.orchestra.run.smithi121.stderr: 40 | __va_arg_pack ()); 2023-05-24T04:00:47.655 INFO:teuthology.orchestra.run.smithi121.stderr: | ~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.667 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c: In function 'MPIIO_SetVersion': 2023-05-24T04:00:47.667 INFO:teuthology.orchestra.run.smithi155.stderr:aiori-MPIIO.c:378:38: warning: ' (version=' directive writing 10 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-05-24T04:00:47.668 INFO:teuthology.orchestra.run.smithi155.stderr: 378 | sprintf(test->apiVersion, "%s (version=%d, subversion=%d)", 2023-05-24T04:00:47.668 INFO:teuthology.orchestra.run.smithi155.stderr: | ^~~~~~~~~~ 2023-05-24T04:00:47.668 INFO:teuthology.orchestra.run.smithi155.stderr:In file included from /usr/include/stdio.h:894, 2023-05-24T04:00:47.668 INFO:teuthology.orchestra.run.smithi155.stderr: from aiori-MPIIO.c:19: 2023-05-24T04:00:47.668 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 27 and 1070 bytes into a destination of size 1024 2023-05-24T04:00:47.668 INFO:teuthology.orchestra.run.smithi155.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2023-05-24T04:00:47.669 INFO:teuthology.orchestra.run.smithi155.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.669 INFO:teuthology.orchestra.run.smithi155.stderr: 39 | __glibc_objsize (__s), __fmt, 2023-05-24T04:00:47.669 INFO:teuthology.orchestra.run.smithi155.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.669 INFO:teuthology.orchestra.run.smithi155.stderr: 40 | __va_arg_pack ()); 2023-05-24T04:00:47.669 INFO:teuthology.orchestra.run.smithi155.stderr: | ~~~~~~~~~~~~~~~~~ 2023-05-24T04:00:47.727 INFO:teuthology.orchestra.run.smithi162.stdout:mv -f .deps/aiori-MPIIO.Tpo .deps/aiori-MPIIO.Po 2023-05-24T04:00:47.731 INFO:teuthology.orchestra.run.smithi162.stdout:mpicc -g -O2 -o ior ior.o utilities.o parse_options.o aiori-POSIX.o aiori-MPIIO.o -lm 2023-05-24T04:00:47.752 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.752 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.752 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.752 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.753 INFO:teuthology.orchestra.run.smithi121.stdout:mv -f .deps/aiori-MPIIO.Tpo .deps/aiori-MPIIO.Po 2023-05-24T04:00:47.755 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.755 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.755 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.755 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.755 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.756 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.757 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.757 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.757 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.757 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.758 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.758 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.759 INFO:teuthology.orchestra.run.smithi121.stdout:mpicc -g -O2 -o ior ior.o utilities.o parse_options.o aiori-POSIX.o aiori-MPIIO.o -lm 2023-05-24T04:00:47.760 INFO:teuthology.orchestra.run.smithi155.stdout:mv -f .deps/aiori-MPIIO.Tpo .deps/aiori-MPIIO.Po 2023-05-24T04:00:47.763 INFO:teuthology.orchestra.run.smithi155.stdout:mpicc -g -O2 -o ior ior.o utilities.o parse_options.o aiori-POSIX.o aiori-MPIIO.o -lm 2023-05-24T04:00:47.778 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.778 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.778 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.778 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.780 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.780 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.780 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.780 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.780 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.781 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.781 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.781 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.782 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.782 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.782 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.782 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.788 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.788 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.789 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.789 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: utilities.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.789 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.789 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.790 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.790 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: parse_options.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.790 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.790 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.791 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.791 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-POSIX.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.791 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: multiple definition of `ncmpi_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:68: first defined here 2023-05-24T04:00:47.791 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: multiple definition of `hdf5_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:67: first defined here 2023-05-24T04:00:47.792 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: multiple definition of `mpiio_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:66: first defined here 2023-05-24T04:00:47.792 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: aiori-MPIIO.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: multiple definition of `posix_aiori'; ior.o:/home/ubuntu/cephtest/ior/src/aiori.h:65: first defined here 2023-05-24T04:00:47.976 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-05-24T04:00:47.977 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-05-24T04:00:47.977 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-05-24T04:00:47.978 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-05-24T04:00:47.978 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-05-24T04:00:47.978 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-05-24T04:00:47.979 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-05-24T04:00:47.979 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-05-24T04:00:47.979 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-05-24T04:00:47.981 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-05-24T04:00:47.981 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:47.981 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.982 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-05-24T04:00:47.982 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-05-24T04:00:47.982 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-05-24T04:00:47.982 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-05-24T04:00:47.982 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-05-24T04:00:47.982 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-05-24T04:00:47.983 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-05-24T04:00:47.983 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-05-24T04:00:47.983 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:47.983 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-05-24T04:00:47.983 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.984 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-05-24T04:00:47.984 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.984 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.984 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-05-24T04:00:47.984 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.984 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-05-24T04:00:47.985 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.985 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-05-24T04:00:47.985 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:47.985 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.985 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-05-24T04:00:47.985 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.986 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-05-24T04:00:47.986 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.986 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-05-24T04:00:47.986 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.986 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.986 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:47.987 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-05-24T04:00:47.988 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:47.989 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.990 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.990 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-05-24T04:00:47.990 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.990 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:47.990 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-05-24T04:00:47.990 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-05-24T04:00:47.991 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-05-24T04:00:47.992 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-05-24T04:00:47.993 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-05-24T04:00:47.993 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-05-24T04:00:47.993 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-05-24T04:00:47.993 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-05-24T04:00:47.993 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-05-24T04:00:47.994 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-05-24T04:00:47.995 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-05-24T04:00:47.996 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-05-24T04:00:47.997 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-05-24T04:00:47.997 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-05-24T04:00:47.998 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-05-24T04:00:47.998 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.998 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-05-24T04:00:47.998 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-05-24T04:00:47.998 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-05-24T04:00:47.998 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-05-24T04:00:47.999 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x841): undefined reference to `fi_version' 2023-05-24T04:00:48.000 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-05-24T04:00:48.001 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-05-24T04:00:48.001 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-05-24T04:00:48.001 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-05-24T04:00:48.001 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-05-24T04:00:48.001 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-05-24T04:00:48.001 INFO:teuthology.orchestra.run.smithi162.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-05-24T04:00:48.002 INFO:teuthology.orchestra.run.smithi162.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.010 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-05-24T04:00:48.011 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-05-24T04:00:48.011 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-05-24T04:00:48.011 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-05-24T04:00:48.011 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-05-24T04:00:48.011 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-05-24T04:00:48.012 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-05-24T04:00:48.012 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-05-24T04:00:48.012 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.018 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-05-24T04:00:48.018 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.018 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.018 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-05-24T04:00:48.019 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-05-24T04:00:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.021 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.022 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-05-24T04:00:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:48.024 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-05-24T04:00:48.025 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-05-24T04:00:48.026 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-05-24T04:00:48.027 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-05-24T04:00:48.028 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.028 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-05-24T04:00:48.028 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-05-24T04:00:48.028 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-05-24T04:00:48.028 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-05-24T04:00:48.028 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-05-24T04:00:48.029 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.029 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-05-24T04:00:48.030 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.030 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.030 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.030 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.030 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-05-24T04:00:48.030 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-05-24T04:00:48.031 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-05-24T04:00:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-05-24T04:00:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-05-24T04:00:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.035 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-05-24T04:00:48.035 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.036 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-05-24T04:00:48.037 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-05-24T04:00:48.038 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.038 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-05-24T04:00:48.038 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-05-24T04:00:48.038 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.038 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-05-24T04:00:48.038 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x841): undefined reference to `fi_version' 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-05-24T04:00:48.039 INFO:teuthology.orchestra.run.smithi155.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-05-24T04:00:48.041 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-05-24T04:00:48.042 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:48.043 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-05-24T04:00:48.044 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.045 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-05-24T04:00:48.046 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-05-24T04:00:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-05-24T04:00:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-05-24T04:00:48.049 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-05-24T04:00:48.050 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-05-24T04:00:48.051 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.052 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-05-24T04:00:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.055 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-05-24T04:00:48.055 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.056 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-05-24T04:00:48.057 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x841): undefined reference to `fi_version' 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-05-24T04:00:48.058 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-05-24T04:00:48.059 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-05-24T04:00:48.059 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-05-24T04:00:48.059 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-05-24T04:00:48.059 INFO:teuthology.orchestra.run.smithi121.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-05-24T04:00:48.059 INFO:teuthology.orchestra.run.smithi121.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-05-24T04:00:48.068 INFO:teuthology.orchestra.run.smithi162.stderr:collect2: error: ld returned 1 exit status 2023-05-24T04:00:48.069 INFO:teuthology.orchestra.run.smithi162.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:48.070 INFO:teuthology.orchestra.run.smithi162.stderr:make[2]: *** [Makefile:299: ior] Error 1 2023-05-24T04:00:48.070 INFO:teuthology.orchestra.run.smithi162.stderr:make[1]: *** [Makefile:208: all] Error 2 2023-05-24T04:00:48.070 INFO:teuthology.orchestra.run.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:48.071 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-24T04:00:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:make: *** [Makefile:261: all-recursive] Error 1 2023-05-24T04:00:48.072 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-05-24T04:00:48.138 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=aab1e3f856e64334995e28d90dda8cdb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-05-24T04:00:48.141 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-05-24T04:00:48.151 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-05-24T04:00:48.151 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T04:00:48.151 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:48.164 INFO:teuthology.orchestra.run.smithi121.stderr:collect2: error: ld returned 1 exit status 2023-05-24T04:00:48.165 INFO:teuthology.orchestra.run.smithi155.stderr:collect2: error: ld returned 1 exit status 2023-05-24T04:00:48.166 INFO:teuthology.orchestra.run.smithi121.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:48.166 INFO:teuthology.orchestra.run.smithi155.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:48.166 INFO:teuthology.orchestra.run.smithi155.stderr:make[2]: *** [Makefile:299: ior] Error 1 2023-05-24T04:00:48.167 INFO:teuthology.orchestra.run.smithi121.stderr:make[2]: *** [Makefile:299: ior] Error 1 2023-05-24T04:00:48.167 INFO:teuthology.orchestra.run.smithi121.stderr:make[1]: *** [Makefile:208: all] Error 2 2023-05-24T04:00:48.167 INFO:teuthology.orchestra.run.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:48.168 INFO:teuthology.orchestra.run.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/ior/src' 2023-05-24T04:00:48.169 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-24T04:00:48.169 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-24T04:00:48.177 INFO:teuthology.orchestra.run.smithi121.stderr:make: *** [Makefile:261: all-recursive] Error 1 2023-05-24T04:00:48.178 INFO:teuthology.orchestra.run.smithi155.stderr:make[1]: *** [Makefile:208: all] Error 2 2023-05-24T04:00:48.178 INFO:teuthology.orchestra.run.smithi155.stderr:make: *** [Makefile:261: all-recursive] Error 1 2023-05-24T04:00:48.223 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T04:00:48.223 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:48.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 Processor -- start 2023-05-24T04:00:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 -- start start 2023-05-24T04:00:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f08640699e0 0x7f0864069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f08640a0150 0x7f08640bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086414e8b0 con 0x7f08640c06a0 2023-05-24T04:00:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086414eb90 con 0x7f08640a0150 2023-05-24T04:00:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0869de0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086414ee70 con 0x7f08640699e0 2023-05-24T04:00:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0862ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f08640c06a0 0x7f08640bc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45352/0 (socket says 172.21.15.40:45352) 2023-05-24T04:00:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0862ffd640 1 -- 172.21.15.40:0/1953448814 learned_addr learned my addr 172.21.15.40:0/1953448814 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0863fff640 1 --2- 172.21.15.40:0/1953448814 >> v2:172.21.15.40:3300/0 conn(0x7f08640a0150 0x7f08640bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f08637fe640 1 --2- 172.21.15.40:0/1953448814 >> v2:172.21.15.67:3300/0 conn(0x7f08640699e0 0x7f0864069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f08627fc640 1 -- 172.21.15.40:0/1953448814 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644881154 0 0) 0x7f086414e8b0 con 0x7f08640c06a0 2023-05-24T04:00:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f08627fc640 1 -- 172.21.15.40:0/1953448814 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f084c003530 con 0x7f08640c06a0 2023-05-24T04:00:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0863fff640 1 -- 172.21.15.40:0/1953448814 >> v2:172.21.15.67:3300/0 conn(0x7f08640699e0 msgr2=0x7f0864069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0863fff640 1 --2- 172.21.15.40:0/1953448814 >> v2:172.21.15.67:3300/0 conn(0x7f08640699e0 0x7f0864069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0863fff640 1 -- 172.21.15.40:0/1953448814 >> v1:172.21.15.40:6789/0 conn(0x7f08640c06a0 legacy=0x7f08640bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.405+0000 7f0863fff640 1 -- 172.21.15.40:0/1953448814 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640bcf40 con 0x7f08640a0150 2023-05-24T04:00:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 --2- 172.21.15.40:0/1953448814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640a0150 0x7f08640bca00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08640c16f0 tx=0x7f085c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdf170d974aed6b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f08627fc640 1 -- 172.21.15.40:0/1953448814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086414e6b0 con 0x7f08640a0150 2023-05-24T04:00:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f08627fc640 1 -- 172.21.15.40:0/1953448814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c0a58d0 con 0x7f08640a0150 2023-05-24T04:00:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f08627fc640 1 -- 172.21.15.40:0/1953448814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0a5c60 con 0x7f08640a0150 2023-05-24T04:00:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- 172.21.15.40:0/1953448814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640a0150 msgr2=0x7f08640bca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 --2- 172.21.15.40:0/1953448814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640a0150 0x7f08640bca00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08640c16f0 tx=0x7f085c01c7f0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- 172.21.15.40:0/1953448814 shutdown_connections 2023-05-24T04:00:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 --2- 172.21.15.40:0/1953448814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640a0150 0x7f08640bca00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 --2- 172.21.15.40:0/1953448814 >> v2:172.21.15.67:3300/0 conn(0x7f08640699e0 0x7f0864069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- 172.21.15.40:0/1953448814 >> 172.21.15.40:0/1953448814 conn(0x7f08640c0af0 msgr2=0x7f08640c0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- 172.21.15.40:0/1953448814 shutdown_connections 2023-05-24T04:00:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- 172.21.15.40:0/1953448814 wait complete. 2023-05-24T04:00:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 Processor -- start 2023-05-24T04:00:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- start start 2023-05-24T04:00:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08640699e0 0x7f08640b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08640a0150 0x7f08641469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 0x7f08641ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641e6c90 con 0x7f08640c06a0 2023-05-24T04:00:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0864146240 con 0x7f08640699e0 2023-05-24T04:00:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0869de0640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08641eaee0 con 0x7f08640a0150 2023-05-24T04:00:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 0x7f08641ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 0x7f08641ea280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58250/0 (socket says 172.21.15.40:58250) 2023-05-24T04:00:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 -- 172.21.15.40:0/4113507135 learned_addr learned my addr 172.21.15.40:0/4113507135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f08637fe640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08640699e0 0x7f08640b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0862ffd640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08640a0150 0x7f08641469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 -- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08640a0150 msgr2=0x7f08641469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08640a0150 0x7f08641469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 -- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08640699e0 msgr2=0x7f08640b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08640699e0 0x7f08640b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0863fff640 1 -- 172.21.15.40:0/4113507135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c009a70 con 0x7f08640c06a0 2023-05-24T04:00:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f0862ffd640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08640a0150 0x7f08641469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.409+0000 7f08637fe640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08640699e0 0x7f08640b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f0863fff640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 0x7f08641ea280 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f085c019400 tx=0x7f085c019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0b9860 con 0x7f08640c06a0 2023-05-24T04:00:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c0b99c0 con 0x7f08640c06a0 2023-05-24T04:00:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086415b7b0 con 0x7f08640c06a0 2023-05-24T04:00:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0b9d50 con 0x7f08640c06a0 2023-05-24T04:00:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086415b620 con 0x7f08640c06a0 2023-05-24T04:00:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086415b940 con 0x7f08640c06a0 2023-05-24T04:00:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f085c0ad440 con 0x7f08640c06a0 2023-05-24T04:00:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f084bfff640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0850066280 0x7f0850068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f085c11f2d0 con 0x7f08640c06a0 2023-05-24T04:00:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f08637fe640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0850066280 0x7f0850068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.413+0000 7f08637fe640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0850066280 0x7f0850068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0854009840 tx=0x7f0854008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:48.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.417+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f085c0ec4b0 con 0x7f08640c06a0 2023-05-24T04:00:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.577+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08641e6e10 con 0x7f08640c06a0 2023-05-24T04:00:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.577+0000 7f084bfff640 1 -- 172.21.15.40:0/4113507135 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7f08641e6e10 con 0x7f08640c06a0 2023-05-24T04:00:48.585 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:48.585 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:48.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0850066280 msgr2=0x7f0850068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0850066280 0x7f0850068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0854009840 tx=0x7f0854008040 comp rx=0 tx=0).stop 2023-05-24T04:00:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 msgr2=0x7f08641ea280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 0x7f08641ea280 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f085c019400 tx=0x7f085c019590 comp rx=0 tx=0).stop 2023-05-24T04:00:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 shutdown_connections 2023-05-24T04:00:48.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0850066280 0x7f0850068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08640c06a0 0x7f08641ea280 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08640a0150 0x7f08641469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 --2- 172.21.15.40:0/4113507135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08640699e0 0x7f08640b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 >> 172.21.15.40:0/4113507135 conn(0x7f08640c0af0 msgr2=0x7f08640a18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 shutdown_connections 2023-05-24T04:00:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.581+0000 7f0869de0640 1 -- 172.21.15.40:0/4113507135 wait complete. 2023-05-24T04:00:48.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:48.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 Processor -- start 2023-05-24T04:00:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 -- start start 2023-05-24T04:00:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f14148390 0x7f1f140a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f14071450 0x7f1f1414e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f1414e550 0x7f1f1414e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1414eed0 con 0x7f1f14148390 2023-05-24T04:00:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1406eac0 con 0x7f1f14071450 2023-05-24T04:00:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f189dc640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140702d0 con 0x7f1f1414e550 2023-05-24T04:00:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f14148390 0x7f1f140a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f14148390 0x7f1f140a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58266/0 (socket says 172.21.15.40:58266) 2023-05-24T04:00:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 -- 172.21.15.40:0/2127075802 learned_addr learned my addr 172.21.15.40:0/2127075802 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f12d9d640 1 --2- 172.21.15.40:0/2127075802 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f1414e550 0x7f1f1414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f0bfff640 1 --2- 172.21.15.40:0/2127075802 >> v2:172.21.15.67:3300/0 conn(0x7f1f14071450 0x7f1f1414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 -- 172.21.15.40:0/2127075802 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f1414e550 msgr2=0x7f1f1414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 --2- 172.21.15.40:0/2127075802 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f1414e550 0x7f1f1414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 -- 172.21.15.40:0/2127075802 >> v2:172.21.15.67:3300/0 conn(0x7f1f14071450 msgr2=0x7f1f1414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 --2- 172.21.15.40:0/2127075802 >> v2:172.21.15.67:3300/0 conn(0x7f1f14071450 0x7f1f1414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.733+0000 7f1f1259c640 1 -- 172.21.15.40:0/2127075802 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f14148760 con 0x7f1f14148390 2023-05-24T04:00:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f1259c640 1 --2- 172.21.15.40:0/2127075802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f14148390 0x7f1f140a4d10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1f140a2ff0 tx=0x7f1f0401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a6cde0a9920c43 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:48.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f11d9b640 1 -- 172.21.15.40:0/2127075802 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040aa420 con 0x7f1f14148390 2023-05-24T04:00:48.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f11d9b640 1 -- 172.21.15.40:0/2127075802 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040aa580 con 0x7f1f14148390 2023-05-24T04:00:48.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f11d9b640 1 -- 172.21.15.40:0/2127075802 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040aa910 con 0x7f1f14148390 2023-05-24T04:00:48.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- 172.21.15.40:0/2127075802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f14148390 msgr2=0x7f1f140a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- 172.21.15.40:0/2127075802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f14148390 0x7f1f140a4d10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1f140a2ff0 tx=0x7f1f0401c500 comp rx=0 tx=0).stop 2023-05-24T04:00:48.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- 172.21.15.40:0/2127075802 shutdown_connections 2023-05-24T04:00:48.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- 172.21.15.40:0/2127075802 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f1414e550 0x7f1f1414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- 172.21.15.40:0/2127075802 >> v2:172.21.15.67:3300/0 conn(0x7f1f14071450 0x7f1f1414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- 172.21.15.40:0/2127075802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f14148390 0x7f1f140a4d10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- 172.21.15.40:0/2127075802 >> 172.21.15.40:0/2127075802 conn(0x7f1f140c0310 msgr2=0x7f1f140c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:48.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- 172.21.15.40:0/2127075802 shutdown_connections 2023-05-24T04:00:48.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- 172.21.15.40:0/2127075802 wait complete. 2023-05-24T04:00:48.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 Processor -- start 2023-05-24T04:00:48.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- start start 2023-05-24T04:00:48.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f14071450 0x7f1f140bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f14148390 0x7f1f141354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 0x7f1f14135a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1413a870 con 0x7f1f1414e550 2023-05-24T04:00:48.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140bff40 con 0x7f1f14071450 2023-05-24T04:00:48.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f189dc640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1413a220 con 0x7f1f14148390 2023-05-24T04:00:48.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f12d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 0x7f1f14135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f12d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 0x7f1f14135a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58282/0 (socket says 172.21.15.40:58282) 2023-05-24T04:00:48.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f12d9d640 1 -- 172.21.15.40:0/937704610 learned_addr learned my addr 172.21.15.40:0/937704610 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:48.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f1259c640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f14071450 0x7f1f140bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.737+0000 7f1f0bfff640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f14148390 0x7f1f141354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f12d9d640 1 -- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f14148390 msgr2=0x7f1f141354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f12d9d640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f14148390 0x7f1f141354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f12d9d640 1 -- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f14071450 msgr2=0x7f1f140bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f12d9d640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f14071450 0x7f1f140bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f12d9d640 1 -- 172.21.15.40:0/937704610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040094d0 con 0x7f1f1414e550 2023-05-24T04:00:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f1259c640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f14071450 0x7f1f140bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0bfff640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f14148390 0x7f1f141354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f12d9d640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 0x7f1f14135a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007e90 tx=0x7f1f0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c014420 con 0x7f1f1414e550 2023-05-24T04:00:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c014580 con 0x7f1f1414e550 2023-05-24T04:00:48.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f140c1100 con 0x7f1f1414e550 2023-05-24T04:00:48.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c014930 con 0x7f1f1414e550 2023-05-24T04:00:48.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1406ed10 con 0x7f1f1414e550 2023-05-24T04:00:48.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f140bc8e0 con 0x7f1f1414e550 2023-05-24T04:00:48.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f0c014a90 con 0x7f1f1414e550 2023-05-24T04:00:48.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0affd640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef40662b0 0x7f1ef4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:48.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f1259c640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef40662b0 0x7f1ef4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:48.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f0c084980 con 0x7f1f1414e550 2023-05-24T04:00:48.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.741+0000 7f1f1259c640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef40662b0 0x7f1ef4068760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1f040ae000 tx=0x7f1f04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:48.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.745+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1f0c0554c0 con 0x7f1f1414e550 2023-05-24T04:00:48.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.901+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f1406f670 con 0x7f1f1414e550 2023-05-24T04:00:48.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.901+0000 7f1f0affd640 1 -- 172.21.15.40:0/937704610 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f0c055050 con 0x7f1f1414e550 2023-05-24T04:00:48.909 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef40662b0 msgr2=0x7f1ef4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef40662b0 0x7f1ef4068760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1f040ae000 tx=0x7f1f04008040 comp rx=0 tx=0).stop 2023-05-24T04:00:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 msgr2=0x7f1f14135a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 0x7f1f14135a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007e90 tx=0x7f1f0c00e4b0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 shutdown_connections 2023-05-24T04:00:48.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef40662b0 0x7f1ef4068760 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1414e550 0x7f1f14135a20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f14148390 0x7f1f141354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 --2- 172.21.15.40:0/937704610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f14071450 0x7f1f140bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:48.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 >> 172.21.15.40:0/937704610 conn(0x7f1f140c0310 msgr2=0x7f1f14141380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:48.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 shutdown_connections 2023-05-24T04:00:48.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:48.905+0000 7f1f189dc640 1 -- 172.21.15.40:0/937704610 wait complete. 2023-05-24T04:00:48.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76e011b640 1 Processor -- start 2023-05-24T04:00:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76e011b640 1 -- start start 2023-05-24T04:00:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76e011b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76d80a5810 0x7f76d814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76e011b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d80bc040 con 0x7f76d80bc8e0 2023-05-24T04:00:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76e011b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d80bc320 con 0x7f76d80ba400 2023-05-24T04:00:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76e011b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d80bb310 con 0x7f76d80a5810 2023-05-24T04:00:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dd6b6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f76d80bc8e0 0x7f76d80bac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45362/0 (socket says 172.21.15.40:45362) 2023-05-24T04:00:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dd6b6640 1 -- 172.21.15.40:0/1487896528 learned_addr learned my addr 172.21.15.40:0/1487896528 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/1487896528 >> v2:172.21.15.67:3300/0 conn(0x7f76d80a5810 0x7f76d814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513698561 0 0) 0x7f76d80bc040 con 0x7f76d80bc8e0 2023-05-24T04:00:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c4003530 con 0x7f76d80bc8e0 2023-05-24T04:00:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2778494435 0 0) 0x7f76c4003530 con 0x7f76d80bc8e0 2023-05-24T04:00:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 >> v2:172.21.15.67:3300/0 conn(0x7f76d80a5810 msgr2=0x7f76d814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 --2- 172.21.15.40:0/1487896528 >> v2:172.21.15.67:3300/0 conn(0x7f76d80a5810 0x7f76d814f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 >> v1:172.21.15.67:6789/0 conn(0x7f76d80ba400 legacy=0x7f76d814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8071a30 con 0x7f76d80bc8e0 2023-05-24T04:00:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f76c8001680 con 0x7f76d80bc8e0 2023-05-24T04:00:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 >> v1:172.21.15.40:6789/0 conn(0x7f76d80bc8e0 legacy=0x7f76d80bac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c40047d0 0x7f76c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76c40052a0 0x7f76c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80bb310 con 0x7f76c4003980 2023-05-24T04:00:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c400c1d0 con 0x7f76c40047d0 2023-05-24T04:00:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c400c390 con 0x7f76c40052a0 2023-05-24T04:00:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76dd6b6640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c40047d0 0x7f76c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76de6b8640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76c40052a0 0x7f76c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 -- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76c40052a0 msgr2=0x7f76c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76c40052a0 0x7f76c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 -- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c40047d0 msgr2=0x7f76c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c40047d0 0x7f76c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76ddeb7640 1 -- 172.21.15.40:0/1487896528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4003530 con 0x7f76c4003980 2023-05-24T04:00:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76de6b8640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76c40052a0 0x7f76c400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.053+0000 7f76de6b8640 1 -- 172.21.15.40:0/1487896528 reap_dead start 2023-05-24T04:00:49.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76c4003d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009ae0 tx=0x7f76d401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5558d2d61f91d200 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40a8410 con 0x7f76c4003980 2023-05-24T04:00:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40a8570 con 0x7f76c4003980 2023-05-24T04:00:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76dceb5640 1 -- 172.21.15.40:0/1487896528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40a8920 con 0x7f76c4003980 2023-05-24T04:00:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- 172.21.15.40:0/1487896528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 msgr2=0x7f76c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76c4003d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009ae0 tx=0x7f76d401ca50 comp rx=0 tx=0).stop 2023-05-24T04:00:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- 172.21.15.40:0/1487896528 shutdown_connections 2023-05-24T04:00:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 --2- 172.21.15.40:0/1487896528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76c4003d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- 172.21.15.40:0/1487896528 >> 172.21.15.40:0/1487896528 conn(0x7f76d80c02a0 msgr2=0x7f76d80c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- 172.21.15.40:0/1487896528 shutdown_connections 2023-05-24T04:00:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- 172.21.15.40:0/1487896528 wait complete. 2023-05-24T04:00:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 Processor -- start 2023-05-24T04:00:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- start start 2023-05-24T04:00:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76d8149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76d81e6750 0x7f76d81ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76d81d83e0 0x7f76d80b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8149470 con 0x7f76c4003980 2023-05-24T04:00:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8149950 con 0x7f76d81d83e0 2023-05-24T04:00:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.057+0000 7f76e011b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80b9cc0 con 0x7f76d81e6750 2023-05-24T04:00:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76d8149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76d8149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58292/0 (socket says 172.21.15.40:58292) 2023-05-24T04:00:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 -- 172.21.15.40:0/2406583421 learned_addr learned my addr 172.21.15.40:0/2406583421 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76dd6b6640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76d81e6750 0x7f76d81ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76de6b8640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76d81d83e0 0x7f76d80b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 -- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76d81e6750 msgr2=0x7f76d81ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76d81e6750 0x7f76d81ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 -- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76d81d83e0 msgr2=0x7f76d80b9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76d81d83e0 0x7f76d80b9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 -- 172.21.15.40:0/2406583421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80a5d70 con 0x7f76c4003980 2023-05-24T04:00:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ddeb7640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76d8149d70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009ae0 tx=0x7f76d40197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40a9d70 con 0x7f76c4003980 2023-05-24T04:00:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40bb450 con 0x7f76c4003980 2023-05-24T04:00:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40bb7c0 con 0x7f76c4003980 2023-05-24T04:00:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d80a5be0 con 0x7f76c4003980 2023-05-24T04:00:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d814b660 con 0x7f76c4003980 2023-05-24T04:00:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d804ddd0 con 0x7f76c4003980 2023-05-24T04:00:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76d40a6040 con 0x7f76c4003980 2023-05-24T04:00:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ce7fc640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f76bc0662b0 0x7f76bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76d411e300 con 0x7f76c4003980 2023-05-24T04:00:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76dd6b6640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f76bc0662b0 0x7f76bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.061+0000 7f76dd6b6640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f76bc0662b0 0x7f76bc068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76c8001ec0 tx=0x7f76c8001d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.065+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f76d40eb4e0 con 0x7f76c4003980 2023-05-24T04:00:49.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76d80707f0 con 0x7f76c4003980 2023-05-24T04:00:49.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76ce7fc640 1 -- 172.21.15.40:0/2406583421 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76d40eeb00 con 0x7f76c4003980 2023-05-24T04:00:49.226 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:49.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f76bc0662b0 msgr2=0x7f76bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f76bc0662b0 0x7f76bc068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76c8001ec0 tx=0x7f76c8001d50 comp rx=0 tx=0).stop 2023-05-24T04:00:49.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 msgr2=0x7f76d8149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76d8149d70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009ae0 tx=0x7f76d40197f0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 shutdown_connections 2023-05-24T04:00:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f76bc0662b0 0x7f76bc068760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76d81d83e0 0x7f76d80b9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76d81e6750 0x7f76d81ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 --2- 172.21.15.40:0/2406583421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c4003980 0x7f76d8149d70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 >> 172.21.15.40:0/2406583421 conn(0x7f76d80c02a0 msgr2=0x7f76d814ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:49.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 shutdown_connections 2023-05-24T04:00:49.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.221+0000 7f76e011b640 1 -- 172.21.15.40:0/2406583421 wait complete. 2023-05-24T04:00:49.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:49.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.361+0000 7fc37a30f640 1 Processor -- start 2023-05-24T04:00:49.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.361+0000 7fc37a30f640 1 -- start start 2023-05-24T04:00:49.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc37a30f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc374071220 0x7fc374071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc37a30f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3740bcd20 0x7fc3740bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc37a30f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc374070ab0 con 0x7fc37414bc80 2023-05-24T04:00:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc37a30f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740a5040 con 0x7fc3740bcd20 2023-05-24T04:00:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc37a30f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37414d0f0 con 0x7fc374071220 2023-05-24T04:00:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3740bcd20 0x7fc3740bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3740bcd20 0x7fc3740bd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58304/0 (socket says 172.21.15.40:58304) 2023-05-24T04:00:49.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 -- 172.21.15.40:0/3495250957 learned_addr learned my addr 172.21.15.40:0/3495250957 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:49.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3737fe640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc374071220 0x7fc374071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 -- 172.21.15.40:0/3495250957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc374071220 msgr2=0x7fc374071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:49.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc374071220 0x7fc374071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 -- 172.21.15.40:0/3495250957 >> v1:172.21.15.67:6789/0 conn(0x7fc37414bc80 legacy=0x7fc3740a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 -- 172.21.15.40:0/3495250957 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374070d00 con 0x7fc3740bcd20 2023-05-24T04:00:49.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3737fe640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc374071220 0x7fc374071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:49.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc3788ac640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3740bd1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc364009870 tx=0x7fc36401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e8e63c2526aa2c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc372ffd640 1 -- 172.21.15.40:0/3495250957 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640ab640 con 0x7fc3740bcd20 2023-05-24T04:00:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc372ffd640 1 -- 172.21.15.40:0/3495250957 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640a7070 con 0x7fc3740bcd20 2023-05-24T04:00:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.365+0000 7fc372ffd640 1 -- 172.21.15.40:0/3495250957 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640ab9c0 con 0x7fc3740bcd20 2023-05-24T04:00:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/3495250957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 msgr2=0x7fc3740bd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3740bd1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc364009870 tx=0x7fc36401c420 comp rx=0 tx=0).stop 2023-05-24T04:00:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/3495250957 shutdown_connections 2023-05-24T04:00:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3740bd1a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 --2- 172.21.15.40:0/3495250957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc374071220 0x7fc374071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/3495250957 >> 172.21.15.40:0/3495250957 conn(0x7fc3740c0310 msgr2=0x7fc3740c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/3495250957 shutdown_connections 2023-05-24T04:00:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/3495250957 wait complete. 2023-05-24T04:00:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 Processor -- start 2023-05-24T04:00:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- start start 2023-05-24T04:00:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc374071220 0x7fc3741e5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3741e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc37414bc80 0x7fc3741e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374143ec0 con 0x7fc3740bcd20 2023-05-24T04:00:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37413d830 con 0x7fc374071220 2023-05-24T04:00:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc374139ee0 con 0x7fc37414bc80 2023-05-24T04:00:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3741e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3741e87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58314/0 (socket says 172.21.15.40:58314) 2023-05-24T04:00:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 -- 172.21.15.40:0/439857668 learned_addr learned my addr 172.21.15.40:0/439857668 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3788ac640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc37414bc80 0x7fc3741e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc373fff640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc374071220 0x7fc3741e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 -- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc37414bc80 msgr2=0x7fc3741e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc37414bc80 0x7fc3741e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 -- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc374071220 msgr2=0x7fc3741e5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc374071220 0x7fc3741e5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 -- 172.21.15.40:0/439857668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640094d0 con 0x7fc3740bcd20 2023-05-24T04:00:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc373fff640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc374071220 0x7fc3741e5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc3737fe640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3741e87b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00cf60 tx=0x7fc36c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00d840 con 0x7fc3740bcd20 2023-05-24T04:00:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c00d9a0 con 0x7fc3740bcd20 2023-05-24T04:00:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc374159470 con 0x7fc3740bcd20 2023-05-24T04:00:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00dd30 con 0x7fc3740bcd20 2023-05-24T04:00:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.369+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37414cd50 con 0x7fc3740bcd20 2023-05-24T04:00:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.373+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc374159600 con 0x7fc3740bcd20 2023-05-24T04:00:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.373+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc36c015440 con 0x7fc3740bcd20 2023-05-24T04:00:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.373+0000 7fc370ff9640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc354066280 0x7fc354068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.373+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc36c084a10 con 0x7fc3740bcd20 2023-05-24T04:00:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.373+0000 7fc373fff640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc354066280 0x7fc354068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.373+0000 7fc373fff640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc354066280 0x7fc354068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc35c000f70 tx=0x7fc35c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.377+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc36c051ca0 con 0x7fc3740bcd20 2023-05-24T04:00:49.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.529+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3740bcb90 con 0x7fc3740bcd20 2023-05-24T04:00:49.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.529+0000 7fc370ff9640 1 -- 172.21.15.40:0/439857668 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc36c0552c0 con 0x7fc3740bcd20 2023-05-24T04:00:49.537 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:49.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc354066280 msgr2=0x7fc354068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc354066280 0x7fc354068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc35c000f70 tx=0x7fc35c009040 comp rx=0 tx=0).stop 2023-05-24T04:00:49.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 msgr2=0x7fc3741e87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3741e87b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00cf60 tx=0x7fc36c00cf90 comp rx=0 tx=0).stop 2023-05-24T04:00:49.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 shutdown_connections 2023-05-24T04:00:49.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc354066280 0x7fc354068730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc37414bc80 0x7fc3741e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740bcd20 0x7fc3741e87b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 --2- 172.21.15.40:0/439857668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc374071220 0x7fc3741e5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 >> 172.21.15.40:0/439857668 conn(0x7fc3740c0310 msgr2=0x7fc374142290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:49.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 shutdown_connections 2023-05-24T04:00:49.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.533+0000 7fc37a30f640 1 -- 172.21.15.40:0/439857668 wait complete. 2023-05-24T04:00:49.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:00:49.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a8c7c640 1 Processor -- start 2023-05-24T04:00:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a8c7c640 1 -- start start 2023-05-24T04:00:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a8c7c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6a4071220 0x7ff6a4071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a8c7c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a4070ab0 con 0x7ff6a40bcd20 2023-05-24T04:00:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a8c7c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a414d0f0 con 0x7ff6a414bc80 2023-05-24T04:00:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a8c7c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a40a5040 con 0x7ff6a4071220 2023-05-24T04:00:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6a4071220 0x7ff6a4071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff6a40bcd20 0x7ff6a40bd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45374/0 (socket says 172.21.15.40:45374) 2023-05-24T04:00:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6a4071220 0x7ff6a4071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58320/0 (socket says 172.21.15.40:58320) 2023-05-24T04:00:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a2d9d640 1 -- 172.21.15.40:0/4045258517 learned_addr learned my addr 172.21.15.40:0/4045258517 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a1d9b640 1 -- 172.21.15.40:0/4045258517 >> v1:172.21.15.67:6789/0 conn(0x7ff6a414bc80 legacy=0x7ff6a40a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a1d9b640 1 -- 172.21.15.40:0/4045258517 >> v1:172.21.15.40:6789/0 conn(0x7ff6a40bcd20 legacy=0x7ff6a40bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.681+0000 7ff6a1d9b640 1 -- 172.21.15.40:0/4045258517 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4070d00 con 0x7ff6a4071220 2023-05-24T04:00:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a1d9b640 1 --2- 172.21.15.40:0/4045258517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4071670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097c0 tx=0x7ff69801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e834a00c0d2027ca server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a159a640 1 -- 172.21.15.40:0/4045258517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980a5640 con 0x7ff6a4071220 2023-05-24T04:00:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a159a640 1 -- 172.21.15.40:0/4045258517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6980a57a0 con 0x7ff6a4071220 2023-05-24T04:00:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a159a640 1 -- 172.21.15.40:0/4045258517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980a5b30 con 0x7ff6a4071220 2023-05-24T04:00:49.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/4045258517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 msgr2=0x7ff6a4071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/4045258517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4071670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097c0 tx=0x7ff69801bf20 comp rx=0 tx=0).stop 2023-05-24T04:00:49.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/4045258517 shutdown_connections 2023-05-24T04:00:49.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/4045258517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4071670 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/4045258517 >> 172.21.15.40:0/4045258517 conn(0x7ff6a40c0310 msgr2=0x7ff6a40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/4045258517 shutdown_connections 2023-05-24T04:00:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/4045258517 wait complete. 2023-05-24T04:00:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 Processor -- start 2023-05-24T04:00:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- start start 2023-05-24T04:00:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a40bcd20 0x7ff6a4136720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6a414bc80 0x7ff6a4136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a413abf0 con 0x7ff6a4071220 2023-05-24T04:00:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41e58e0 con 0x7ff6a40bcd20 2023-05-24T04:00:49.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4140310 con 0x7ff6a414bc80 2023-05-24T04:00:49.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4145940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58332/0 (socket says 172.21.15.40:58332) 2023-05-24T04:00:49.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 -- 172.21.15.40:0/3792257414 learned_addr learned my addr 172.21.15.40:0/3792257414 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:49.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a1d9b640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a40bcd20 0x7ff6a4136720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a2d9d640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6a414bc80 0x7ff6a4136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 -- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6a414bc80 msgr2=0x7ff6a4136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6a414bc80 0x7ff6a4136c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 -- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a40bcd20 msgr2=0x7ff6a4136720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a40bcd20 0x7ff6a4136720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 -- 172.21.15.40:0/3792257414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698009420 con 0x7ff6a4071220 2023-05-24T04:00:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a259c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4145940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff69400b410 tx=0x7ff69400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694004020 con 0x7ff6a4071220 2023-05-24T04:00:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694004180 con 0x7ff6a4071220 2023-05-24T04:00:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011630 con 0x7ff6a4071220 2023-05-24T04:00:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a415ae30 con 0x7ff6a4071220 2023-05-24T04:00:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.685+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a415aca0 con 0x7ff6a4071220 2023-05-24T04:00:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.689+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a415afc0 con 0x7ff6a4071220 2023-05-24T04:00:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.689+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff694011790 con 0x7ff6a4071220 2023-05-24T04:00:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.689+0000 7ff692ffd640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff684066280 0x7ff684068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.689+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff694083d40 con 0x7ff6a4071220 2023-05-24T04:00:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.689+0000 7ff6a1d9b640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff684066280 0x7ff684068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.689+0000 7ff6a1d9b640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff684066280 0x7ff684068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6980ad000 tx=0x7ff6980b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.693+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff694050f20 con 0x7ff6a4071220 2023-05-24T04:00:49.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.845+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6a40bcb90 con 0x7ff6a4071220 2023-05-24T04:00:49.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff692ffd640 1 -- 172.21.15.40:0/3792257414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff694054540 con 0x7ff6a4071220 2023-05-24T04:00:49.858 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:00:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff684066280 msgr2=0x7ff684068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff684066280 0x7ff684068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6980ad000 tx=0x7ff6980b2040 comp rx=0 tx=0).stop 2023-05-24T04:00:49.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 msgr2=0x7ff6a4145940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4145940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff69400b410 tx=0x7ff69400b8d0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 shutdown_connections 2023-05-24T04:00:49.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff684066280 0x7ff684068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6a414bc80 0x7ff6a4136c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a40bcd20 0x7ff6a4136720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 --2- 172.21.15.40:0/3792257414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6a4071220 0x7ff6a4145940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 >> 172.21.15.40:0/3792257414 conn(0x7ff6a40c0310 msgr2=0x7ff6a4148990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 shutdown_connections 2023-05-24T04:00:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.853+0000 7ff6a8c7c640 1 -- 172.21.15.40:0/3792257414 wait complete. 2023-05-24T04:00:49.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:00:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 Processor -- start 2023-05-24T04:00:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 -- start start 2023-05-24T04:00:49.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd75014bc80 0x7fd7500a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd750071220 0x7fd750071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:49.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd750070ab0 con 0x7fd7500bcd20 2023-05-24T04:00:49.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500a5040 con 0x7fd75014bc80 2023-05-24T04:00:49.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7558a1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75014d0f0 con 0x7fd750071220 2023-05-24T04:00:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd75014bc80 0x7fd7500a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7467fc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd750071220 0x7fd750071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7500bcd20 0x7fd7500bd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:57384/0 (socket says 172.21.15.40:57384) 2023-05-24T04:00:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd75014bc80 0x7fd7500a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:38112/0 (socket says 172.21.15.40:38112) 2023-05-24T04:00:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74f7fe640 1 -- 172.21.15.40:0/2526364374 learned_addr learned my addr 172.21.15.40:0/2526364374 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74effd640 1 -- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd750071220 msgr2=0x7fd750071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74effd640 1 --2- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd750071220 0x7fd750071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:49.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74effd640 1 -- 172.21.15.40:0/2526364374 >> v1:172.21.15.67:6789/0 conn(0x7fd7500bcd20 legacy=0x7fd7500bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:49.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd74effd640 1 -- 172.21.15.40:0/2526364374 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750070d00 con 0x7fd75014bc80 2023-05-24T04:00:49.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.989+0000 7fd7467fc640 1 --2- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd750071220 0x7fd750071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:49.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 --2- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd75014bc80 0x7fd7500a33a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7400097c0 tx=0x7fd74001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac32679b119901a0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:49.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74e7fc640 1 -- 172.21.15.40:0/2526364374 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400ad680 con 0x7fd75014bc80 2023-05-24T04:00:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74e7fc640 1 -- 172.21.15.40:0/2526364374 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7400ad7e0 con 0x7fd75014bc80 2023-05-24T04:00:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74e7fc640 1 -- 172.21.15.40:0/2526364374 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400adb70 con 0x7fd75014bc80 2023-05-24T04:00:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd75014bc80 msgr2=0x7fd7500a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 --2- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd75014bc80 0x7fd7500a33a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7400097c0 tx=0x7fd74001c360 comp rx=0 tx=0).stop 2023-05-24T04:00:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- 172.21.15.40:0/2526364374 shutdown_connections 2023-05-24T04:00:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 --2- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd750071220 0x7fd750071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 --2- 172.21.15.40:0/2526364374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd75014bc80 0x7fd7500a33a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- 172.21.15.40:0/2526364374 >> 172.21.15.40:0/2526364374 conn(0x7fd7500c0310 msgr2=0x7fd7500c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- 172.21.15.40:0/2526364374 shutdown_connections 2023-05-24T04:00:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- 172.21.15.40:0/2526364374 wait complete. 2023-05-24T04:00:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 Processor -- start 2023-05-24T04:00:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- start start 2023-05-24T04:00:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 0x7fd75013e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7500bcd20 0x7fd7501e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd75014bc80 0x7fd750139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75013f2d0 con 0x7fd750071220 2023-05-24T04:00:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7501ea5c0 con 0x7fd7500bcd20 2023-05-24T04:00:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75006ef40 con 0x7fd75014bc80 2023-05-24T04:00:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 0x7fd75013e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 0x7fd75013e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58334/0 (socket says 172.21.15.40:58334) 2023-05-24T04:00:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 -- 172.21.15.40:0/1569938456 learned_addr learned my addr 172.21.15.40:0/1569938456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7467fc640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7500bcd20 0x7fd7501e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74f7fe640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd75014bc80 0x7fd750139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 -- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd75014bc80 msgr2=0x7fd750139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd75014bc80 0x7fd750139670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 -- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7500bcd20 msgr2=0x7fd7501e9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7500bcd20 0x7fd7501e9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 -- 172.21.15.40:0/1569938456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009420 con 0x7fd750071220 2023-05-24T04:00:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7467fc640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7500bcd20 0x7fd7501e9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74effd640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 0x7fd75013e3a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd740019f90 tx=0x7fd740019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400add60 con 0x7fd750071220 2023-05-24T04:00:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7400b6410 con 0x7fd750071220 2023-05-24T04:00:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.993+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd740009420 con 0x7fd750071220 2023-05-24T04:00:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400b67a0 con 0x7fd750071220 2023-05-24T04:00:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75014cd50 con 0x7fd750071220 2023-05-24T04:00:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75014c050 con 0x7fd750071220 2023-05-24T04:00:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7400b4040 con 0x7fd750071220 2023-05-24T04:00:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd74cff9640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd7340662b0 0x7fd734068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd74011e2a0 con 0x7fd750071220 2023-05-24T04:00:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd7467fc640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd7340662b0 0x7fd734068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:49.997+0000 7fd7467fc640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd7340662b0 0x7fd734068760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd75013e8e0 tx=0x7fd738008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.005+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd7400eb370 con 0x7fd750071220 2023-05-24T04:00:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.157+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7500bcb90 con 0x7fd750071220 2023-05-24T04:00:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.157+0000 7fd74cff9640 1 -- 172.21.15.40:0/1569938456 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7400ee990 con 0x7fd750071220 2023-05-24T04:00:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd7340662b0 msgr2=0x7fd734068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd7340662b0 0x7fd734068760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd75013e8e0 tx=0x7fd738008040 comp rx=0 tx=0).stop 2023-05-24T04:00:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 msgr2=0x7fd75013e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 0x7fd75013e3a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd740019f90 tx=0x7fd740019100 comp rx=0 tx=0).stop 2023-05-24T04:00:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 shutdown_connections 2023-05-24T04:00:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd7340662b0 0x7fd734068760 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd75014bc80 0x7fd750139670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7500bcd20 0x7fd7501e9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 --2- 172.21.15.40:0/1569938456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd750071220 0x7fd75013e3a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 >> 172.21.15.40:0/1569938456 conn(0x7fd7500c0310 msgr2=0x7fd7500bd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 shutdown_connections 2023-05-24T04:00:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.161+0000 7fd7558a1640 1 -- 172.21.15.40:0/1569938456 wait complete. 2023-05-24T04:00:50.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:00:50.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2c910640 1 Processor -- start 2023-05-24T04:00:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2c910640 1 -- start start 2023-05-24T04:00:50.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2c910640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d2806d030 0x7f5d28071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2c910640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2814bda0 con 0x7f5d2814c240 2023-05-24T04:00:50.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2c910640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280b7d70 con 0x7f5d2814af30 2023-05-24T04:00:50.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2c910640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280b8330 con 0x7f5d2806d030 2023-05-24T04:00:50.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d25d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5d2814c240 0x7f5d2814a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45384/0 (socket says 172.21.15.40:45384) 2023-05-24T04:00:50.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d25d9b640 1 -- 172.21.15.40:0/2263554314 learned_addr learned my addr 172.21.15.40:0/2263554314 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:50.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2263554314 >> v2:172.21.15.67:3300/0 conn(0x7f5d2806d030 0x7f5d28071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913399583 0 0) 0x7f5d2814bda0 con 0x7f5d2814c240 2023-05-24T04:00:50.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d10003530 con 0x7f5d2814c240 2023-05-24T04:00:50.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994341353 0 0) 0x7f5d280b7d70 con 0x7f5d2814af30 2023-05-24T04:00:50.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d2814bda0 con 0x7f5d2814af30 2023-05-24T04:00:50.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2925507010 0 0) 0x7f5d10003530 con 0x7f5d2814c240 2023-05-24T04:00:50.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 >> v2:172.21.15.67:3300/0 conn(0x7f5d2806d030 msgr2=0x7f5d28071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 --2- 172.21.15.40:0/2263554314 >> v2:172.21.15.67:3300/0 conn(0x7f5d2806d030 0x7f5d28071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 >> v1:172.21.15.67:6789/0 conn(0x7f5d2814af30 legacy=0x7f5d280bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280b8050 con 0x7f5d2814c240 2023-05-24T04:00:50.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f5d18001680 con 0x7f5d2814c240 2023-05-24T04:00:50.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 >> v1:172.21.15.40:6789/0 conn(0x7f5d2814c240 legacy=0x7f5d2814a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d10003b10 0x7f5d10003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d100047d0 0x7f5d10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10005180 0x7f5d1000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280b8330 con 0x7f5d10003b10 2023-05-24T04:00:50.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1000e2a0 con 0x7f5d10005180 2023-05-24T04:00:50.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1000e460 con 0x7f5d100047d0 2023-05-24T04:00:50.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d10003b10 0x7f5d10003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d25d9b640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d100047d0 0x7f5d10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d26d9d640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10005180 0x7f5d1000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 -- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d100047d0 msgr2=0x7f5d10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d100047d0 0x7f5d10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 -- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10005180 msgr2=0x7f5d1000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10005180 0x7f5d1000dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d26d9d640 1 -- 172.21.15.40:0/2263554314 reap_dead start 2023-05-24T04:00:50.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d2659c640 1 -- 172.21.15.40:0/2263554314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d10003530 con 0x7f5d10003b10 2023-05-24T04:00:50.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.297+0000 7f5d25d9b640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d100047d0 0x7f5d10004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:50.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d10003b10 0x7f5d10003f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009ab0 tx=0x7f5d1c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab630d7b3ac79be server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0a55a0 con 0x7f5d10003b10 2023-05-24T04:00:50.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0a5700 con 0x7f5d10003b10 2023-05-24T04:00:50.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2559a640 1 -- 172.21.15.40:0/2263554314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0a5ab0 con 0x7f5d10003b10 2023-05-24T04:00:50.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- 172.21.15.40:0/2263554314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d10003b10 msgr2=0x7f5d10003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d10003b10 0x7f5d10003f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009ab0 tx=0x7f5d1c01ca30 comp rx=0 tx=0).stop 2023-05-24T04:00:50.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- 172.21.15.40:0/2263554314 shutdown_connections 2023-05-24T04:00:50.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2263554314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d10003b10 0x7f5d10003f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- 172.21.15.40:0/2263554314 >> 172.21.15.40:0/2263554314 conn(0x7f5d2806aef0 msgr2=0x7f5d2806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- 172.21.15.40:0/2263554314 shutdown_connections 2023-05-24T04:00:50.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- 172.21.15.40:0/2263554314 wait complete. 2023-05-24T04:00:50.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 Processor -- start 2023-05-24T04:00:50.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- start start 2023-05-24T04:00:50.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10003b10 0x7f5d2814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d2814ec20 0x7f5d281e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 0x7f5d2814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280a50d0 con 0x7f5d280a4630 2023-05-24T04:00:50.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d281ea6e0 con 0x7f5d10003b10 2023-05-24T04:00:50.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d2c910640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d281ea460 con 0x7f5d2814ec20 2023-05-24T04:00:50.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d26d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 0x7f5d2814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d26d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 0x7f5d2814f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58344/0 (socket says 172.21.15.40:58344) 2023-05-24T04:00:50.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.301+0000 7f5d26d9d640 1 -- 172.21.15.40:0/2630059231 learned_addr learned my addr 172.21.15.40:0/2630059231 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:50.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10003b10 0x7f5d2814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d25d9b640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d2814ec20 0x7f5d281e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d26d9d640 1 -- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d2814ec20 msgr2=0x7f5d281e9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d26d9d640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d2814ec20 0x7f5d281e9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d26d9d640 1 -- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10003b10 msgr2=0x7f5d2814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d26d9d640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10003b10 0x7f5d2814e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d26d9d640 1 -- 172.21.15.40:0/2630059231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280bc500 con 0x7f5d280a4630 2023-05-24T04:00:50.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d25d9b640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d2814ec20 0x7f5d281e9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:50.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d26d9d640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 0x7f5d2814f170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806fa40 tx=0x7f5d2000d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000b070 con 0x7f5d280a4630 2023-05-24T04:00:50.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20003980 con 0x7f5d280a4630 2023-05-24T04:00:50.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280bc370 con 0x7f5d280a4630 2023-05-24T04:00:50.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20003d30 con 0x7f5d280a4630 2023-05-24T04:00:50.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d280bc690 con 0x7f5d280a4630 2023-05-24T04:00:50.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d280674e0 con 0x7f5d280a4630 2023-05-24T04:00:50.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d20005070 con 0x7f5d280a4630 2023-05-24T04:00:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d16ffd640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5d080662b0 0x7f5d08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5d20082e90 con 0x7f5d280a4630 2023-05-24T04:00:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5d080662b0 0x7f5d08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.305+0000 7f5d2659c640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5d080662b0 0x7f5d08068760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0af000 tx=0x7f5d1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.309+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5d20050150 con 0x7f5d280a4630 2023-05-24T04:00:50.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.473+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d281ea870 con 0x7f5d280a4630 2023-05-24T04:00:50.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.473+0000 7f5d16ffd640 1 -- 172.21.15.40:0/2630059231 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5d20018070 con 0x7f5d280a4630 2023-05-24T04:00:50.479 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:00:50.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5d080662b0 msgr2=0x7f5d08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5d080662b0 0x7f5d08068760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0af000 tx=0x7f5d1c008040 comp rx=0 tx=0).stop 2023-05-24T04:00:50.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 msgr2=0x7f5d2814f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 0x7f5d2814f170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806fa40 tx=0x7f5d2000d7c0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 shutdown_connections 2023-05-24T04:00:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5d080662b0 0x7f5d08068760 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d280a4630 0x7f5d2814f170 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d2814ec20 0x7f5d281e9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 --2- 172.21.15.40:0/2630059231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d10003b10 0x7f5d2814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 >> 172.21.15.40:0/2630059231 conn(0x7f5d2806aef0 msgr2=0x7f5d280699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 shutdown_connections 2023-05-24T04:00:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.477+0000 7f5d2c910640 1 -- 172.21.15.40:0/2630059231 wait complete. 2023-05-24T04:00:50.496 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-05-24T04:00:50.497 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:50.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:50.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 Processor -- start 2023-05-24T04:00:50.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 -- start start 2023-05-24T04:00:50.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba5c0a3da0 0x7fba5c0c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 0x7fba5c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0b8040 con 0x7fba5c0bef60 2023-05-24T04:00:50.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0c4220 con 0x7fba5c0a3da0 2023-05-24T04:00:50.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba62c5b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0b7df0 con 0x7fba5c151e20 2023-05-24T04:00:50.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba609f7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fba5c0bef60 0x7fba5c0c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45386/0 (socket says 172.21.15.40:45386) 2023-05-24T04:00:50.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba609f7640 1 -- 172.21.15.40:0/2853506645 learned_addr learned my addr 172.21.15.40:0/2853506645 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:50.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba611f8640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 0x7fba5c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 --2- 172.21.15.40:0/2853506645 >> v2:172.21.15.67:3300/0 conn(0x7fba5c0a3da0 0x7fba5c0c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506766600 0 0) 0x7fba50001120 con 0x7fba5c0bef60 2023-05-24T04:00:50.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c003530 con 0x7fba5c0bef60 2023-05-24T04:00:50.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3063112126 0 0) 0x7fba4c003530 con 0x7fba5c0bef60 2023-05-24T04:00:50.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 msgr2=0x7fba5c1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 0x7fba5c1522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 >> v2:172.21.15.67:3300/0 conn(0x7fba5c0a3da0 msgr2=0x7fba5c0c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 --2- 172.21.15.40:0/2853506645 >> v2:172.21.15.67:3300/0 conn(0x7fba5c0a3da0 0x7fba5c0c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0a38d0 con 0x7fba5c0bef60 2023-05-24T04:00:50.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fba50001810 con 0x7fba5c0bef60 2023-05-24T04:00:50.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 >> v1:172.21.15.40:6789/0 conn(0x7fba5c0bef60 legacy=0x7fba5c0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 0x7fba4c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba4c003f00 0x7fba4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4c004d10 0x7fba4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0c4220 con 0x7fba4c003f00 2023-05-24T04:00:50.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0b7df0 con 0x7fba4c004d10 2023-05-24T04:00:50.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c00b9c0 con 0x7fba5c151e20 2023-05-24T04:00:50.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba4c003f00 0x7fba4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 -- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 msgr2=0x7fba4c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba609f7640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 0x7fba4c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba611f8640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4c004d10 0x7fba4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba5c151e20 0x7fba4c003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 -- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4c004d10 msgr2=0x7fba4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4c004d10 0x7fba4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba5bfff640 1 -- 172.21.15.40:0/2853506645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c003530 con 0x7fba4c003f00 2023-05-24T04:00:50.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.613+0000 7fba611f8640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4c004d10 0x7fba4c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:50.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba5bfff640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba4c003f00 0x7fba4c0047d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba48009ab0 tx=0x7fba4801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1ca736a7dcf03f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480a5580 con 0x7fba4c003f00 2023-05-24T04:00:50.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480a56e0 con 0x7fba4c003f00 2023-05-24T04:00:50.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba5b7fe640 1 -- 172.21.15.40:0/2853506645 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480a5a90 con 0x7fba4c003f00 2023-05-24T04:00:50.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- 172.21.15.40:0/2853506645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba4c003f00 msgr2=0x7fba4c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 --2- 172.21.15.40:0/2853506645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba4c003f00 0x7fba4c0047d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba48009ab0 tx=0x7fba4801c9f0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 -- 172.21.15.40:0/2853506645 reap_dead start 2023-05-24T04:00:50.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- 172.21.15.40:0/2853506645 shutdown_connections 2023-05-24T04:00:50.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- 172.21.15.40:0/2853506645 >> 172.21.15.40:0/2853506645 conn(0x7fba5c065bb0 msgr2=0x7fba5c0a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- 172.21.15.40:0/2853506645 shutdown_connections 2023-05-24T04:00:50.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- 172.21.15.40:0/2853506645 wait complete. 2023-05-24T04:00:50.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 Processor -- start 2023-05-24T04:00:50.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- start start 2023-05-24T04:00:50.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba4c003f00 0x7fba5c146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c147490 0x7fba5c14ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 0x7fba5c0a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0bd6c0 con 0x7fba5c0a9b40 2023-05-24T04:00:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0a5c20 con 0x7fba5c147490 2023-05-24T04:00:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba62c5b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c14f340 con 0x7fba4c003f00 2023-05-24T04:00:50.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 0x7fba5c0a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 0x7fba5c0a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58360/0 (socket says 172.21.15.40:58360) 2023-05-24T04:00:50.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 -- 172.21.15.40:0/3321756636 learned_addr learned my addr 172.21.15.40:0/3321756636 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:50.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba609f7640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba4c003f00 0x7fba5c146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba5bfff640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c147490 0x7fba5c14ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 -- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba4c003f00 msgr2=0x7fba5c146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba4c003f00 0x7fba5c146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 -- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c147490 msgr2=0x7fba5c14ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c147490 0x7fba5c14ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 -- 172.21.15.40:0/3321756636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0bb5d0 con 0x7fba5c0a9b40 2023-05-24T04:00:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba5bfff640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c147490 0x7fba5c14ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.617+0000 7fba611f8640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 0x7fba5c0a9f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0c2060 tx=0x7fba54007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54014760 con 0x7fba5c0a9b40 2023-05-24T04:00:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54011040 con 0x7fba5c0a9b40 2023-05-24T04:00:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c0bb440 con 0x7fba5c0a9b40 2023-05-24T04:00:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54014b20 con 0x7fba5c0a9b40 2023-05-24T04:00:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c0c3410 con 0x7fba5c0a9b40 2023-05-24T04:00:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c04ddd0 con 0x7fba5c0a9b40 2023-05-24T04:00:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba54014c80 con 0x7fba5c0a9b40 2023-05-24T04:00:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba597fa640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fba40066280 0x7fba40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba540838a0 con 0x7fba5c0a9b40 2023-05-24T04:00:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba609f7640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fba40066280 0x7fba40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.621+0000 7fba609f7640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fba40066280 0x7fba40068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba500019c0 tx=0x7fba50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.625+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fba54050a80 con 0x7fba5c0a9b40 2023-05-24T04:00:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.777+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba5c0bb7e0 con 0x7fba5c0a9b40 2023-05-24T04:00:50.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba597fa640 1 -- 172.21.15.40:0/3321756636 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7fba540540a0 con 0x7fba5c0a9b40 2023-05-24T04:00:50.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:50.787 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:50.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fba40066280 msgr2=0x7fba40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fba40066280 0x7fba40068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba500019c0 tx=0x7fba50009040 comp rx=0 tx=0).stop 2023-05-24T04:00:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 msgr2=0x7fba5c0a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 0x7fba5c0a9f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0c2060 tx=0x7fba54007f00 comp rx=0 tx=0).stop 2023-05-24T04:00:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 shutdown_connections 2023-05-24T04:00:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fba40066280 0x7fba40068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c0a9b40 0x7fba5c0a9f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c147490 0x7fba5c14ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 --2- 172.21.15.40:0/3321756636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fba4c003f00 0x7fba5c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 >> 172.21.15.40:0/3321756636 conn(0x7fba5c065bb0 msgr2=0x7fba5c14a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 shutdown_connections 2023-05-24T04:00:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.781+0000 7fba62c5b640 1 -- 172.21.15.40:0/3321756636 wait complete. 2023-05-24T04:00:50.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:50.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 Processor -- start 2023-05-24T04:00:50.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 -- start start 2023-05-24T04:00:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc4280714c0 0x7fc42814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4280c0e20 0x7fc42814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4280bd750 con 0x7fc42814f250 2023-05-24T04:00:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42806fe00 con 0x7fc4280c0e20 2023-05-24T04:00:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc4306b7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42814f690 con 0x7fc4280714c0 2023-05-24T04:00:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4280c0e20 0x7fc42814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4280c0e20 0x7fc42814ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58366/0 (socket says 172.21.15.40:58366) 2023-05-24T04:00:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 -- 172.21.15.40:0/717291046 learned_addr learned my addr 172.21.15.40:0/717291046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42e453640 1 --2- 172.21.15.40:0/717291046 >> v2:172.21.15.67:3300/0 conn(0x7fc4280714c0 0x7fc42814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 -- 172.21.15.40:0/717291046 >> v2:172.21.15.67:3300/0 conn(0x7fc4280714c0 msgr2=0x7fc42814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:50.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 --2- 172.21.15.40:0/717291046 >> v2:172.21.15.67:3300/0 conn(0x7fc4280714c0 0x7fc42814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 -- 172.21.15.40:0/717291046 >> v1:172.21.15.67:6789/0 conn(0x7fc42814f250 legacy=0x7fc42814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 -- 172.21.15.40:0/717291046 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280a4800 con 0x7fc4280c0e20 2023-05-24T04:00:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.929+0000 7fc42dc52640 1 --2- 172.21.15.40:0/717291046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280c0e20 0x7fc42814ed10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc42806de30 tx=0x7fc41801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d985f5106d36704 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42d451640 1 -- 172.21.15.40:0/717291046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4180a7b00 con 0x7fc4280c0e20 2023-05-24T04:00:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42d451640 1 -- 172.21.15.40:0/717291046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4180a7c60 con 0x7fc4280c0e20 2023-05-24T04:00:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42d451640 1 -- 172.21.15.40:0/717291046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4180af440 con 0x7fc4280c0e20 2023-05-24T04:00:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/717291046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280c0e20 msgr2=0x7fc42814ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 --2- 172.21.15.40:0/717291046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280c0e20 0x7fc42814ed10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc42806de30 tx=0x7fc41801eb40 comp rx=0 tx=0).stop 2023-05-24T04:00:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/717291046 shutdown_connections 2023-05-24T04:00:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 --2- 172.21.15.40:0/717291046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280c0e20 0x7fc42814ed10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 --2- 172.21.15.40:0/717291046 >> v2:172.21.15.67:3300/0 conn(0x7fc4280714c0 0x7fc42814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/717291046 >> 172.21.15.40:0/717291046 conn(0x7fc4280c0310 msgr2=0x7fc4280c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/717291046 shutdown_connections 2023-05-24T04:00:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/717291046 wait complete. 2023-05-24T04:00:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 Processor -- start 2023-05-24T04:00:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- start start 2023-05-24T04:00:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 0x7fc428147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4280c0e20 0x7fc428145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc42814f250 0x7fc42813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428148310 con 0x7fc4280714c0 2023-05-24T04:00:50.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428149260 con 0x7fc4280c0e20 2023-05-24T04:00:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc428146c50 con 0x7fc42814f250 2023-05-24T04:00:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 0x7fc428147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 0x7fc428147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58382/0 (socket says 172.21.15.40:58382) 2023-05-24T04:00:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 -- 172.21.15.40:0/4149734533 learned_addr learned my addr 172.21.15.40:0/4149734533 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 -- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc42814f250 msgr2=0x7fc42813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42dc52640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4280c0e20 0x7fc428145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42ec54640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc42814f250 0x7fc42813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc42814f250 0x7fc42813e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 -- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4280c0e20 msgr2=0x7fc428145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4280c0e20 0x7fc428145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 -- 172.21.15.40:0/4149734533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41800b770 con 0x7fc4280714c0 2023-05-24T04:00:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc42e453640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 0x7fc428147810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc42400d5f0 tx=0x7fc42400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240125f0 con 0x7fc4280714c0 2023-05-24T04:00:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424012750 con 0x7fc4280714c0 2023-05-24T04:00:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424012ae0 con 0x7fc4280714c0 2023-05-24T04:00:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4280a2e40 con 0x7fc4280714c0 2023-05-24T04:00:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.933+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc428071890 con 0x7fc4280714c0 2023-05-24T04:00:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.937+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4281e5700 con 0x7fc4280714c0 2023-05-24T04:00:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.937+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc424012c40 con 0x7fc4280714c0 2023-05-24T04:00:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.937+0000 7fc41effd640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc40c0662b0 0x7fc40c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.937+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc424084490 con 0x7fc4280714c0 2023-05-24T04:00:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.937+0000 7fc42dc52640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc40c0662b0 0x7fc40c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.937+0000 7fc42dc52640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc40c0662b0 0x7fc40c068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4180b1000 tx=0x7fc4180a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:50.941+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc424051670 con 0x7fc4280714c0 2023-05-24T04:00:51.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc428149420 con 0x7fc4280714c0 2023-05-24T04:00:51.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc41effd640 1 -- 172.21.15.40:0/4149734533 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc424007380 con 0x7fc4280714c0 2023-05-24T04:00:51.095 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc40c0662b0 msgr2=0x7fc40c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc40c0662b0 0x7fc40c068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4180b1000 tx=0x7fc4180a9070 comp rx=0 tx=0).stop 2023-05-24T04:00:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 msgr2=0x7fc428147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 0x7fc428147810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc42400d5f0 tx=0x7fc42400dab0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 shutdown_connections 2023-05-24T04:00:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc40c0662b0 0x7fc40c068760 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc42814f250 0x7fc42813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4280c0e20 0x7fc428145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 --2- 172.21.15.40:0/4149734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4280714c0 0x7fc428147810 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 >> 172.21.15.40:0/4149734533 conn(0x7fc4280c0310 msgr2=0x7fc42814ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 shutdown_connections 2023-05-24T04:00:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.089+0000 7fc4306b7640 1 -- 172.21.15.40:0/4149734533 wait complete. 2023-05-24T04:00:51.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f7615368640 1 Processor -- start 2023-05-24T04:00:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f7615368640 1 -- start start 2023-05-24T04:00:51.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f7615368640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f761014ba30 0x7f76101519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f7615368640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761006c4c0 con 0x7f761006f130 2023-05-24T04:00:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f7615368640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761014be00 con 0x7f7610070330 2023-05-24T04:00:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f7615368640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100a61a0 con 0x7f761014ba30 2023-05-24T04:00:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760e7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f761006f130 0x7f7610151ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45392/0 (socket says 172.21.15.40:45392) 2023-05-24T04:00:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760e7fc640 1 -- 172.21.15.40:0/1137981173 learned_addr learned my addr 172.21.15.40:0/1137981173 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760effd640 1 --2- 172.21.15.40:0/1137981173 >> v2:172.21.15.40:3300/0 conn(0x7f761014ba30 0x7f76101519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760dffb640 1 -- 172.21.15.40:0/1137981173 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073702123 0 0) 0x7f761006c4c0 con 0x7f761006f130 2023-05-24T04:00:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760dffb640 1 -- 172.21.15.40:0/1137981173 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f8003530 con 0x7f761006f130 2023-05-24T04:00:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760effd640 1 -- 172.21.15.40:0/1137981173 >> v1:172.21.15.67:6789/0 conn(0x7f7610070330 legacy=0x7f76100707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760effd640 1 -- 172.21.15.40:0/1137981173 >> v1:172.21.15.40:6789/0 conn(0x7f761006f130 legacy=0x7f7610151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.225+0000 7f760effd640 1 -- 172.21.15.40:0/1137981173 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76101527c0 con 0x7f761014ba30 2023-05-24T04:00:51.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760effd640 1 --2- 172.21.15.40:0/1137981173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76101519b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76000097c0 tx=0x7f760001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4f7373770d313b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760dffb640 1 -- 172.21.15.40:0/1137981173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000a8050 con 0x7f761014ba30 2023-05-24T04:00:51.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760dffb640 1 -- 172.21.15.40:0/1137981173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76000ac5f0 con 0x7f761014ba30 2023-05-24T04:00:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760dffb640 1 -- 172.21.15.40:0/1137981173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000ac980 con 0x7f761014ba30 2023-05-24T04:00:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/1137981173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 msgr2=0x7f76101519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 --2- 172.21.15.40:0/1137981173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76101519b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76000097c0 tx=0x7f760001c480 comp rx=0 tx=0).stop 2023-05-24T04:00:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/1137981173 shutdown_connections 2023-05-24T04:00:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 --2- 172.21.15.40:0/1137981173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76101519b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/1137981173 >> 172.21.15.40:0/1137981173 conn(0x7f76100c0ba0 msgr2=0x7f76100c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:51.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/1137981173 shutdown_connections 2023-05-24T04:00:51.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/1137981173 wait complete. 2023-05-24T04:00:51.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 Processor -- start 2023-05-24T04:00:51.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- start start 2023-05-24T04:00:51.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761006f130 0x7f761014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7610070330 0x7f76101ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76100bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610151b80 con 0x7f761014ba30 2023-05-24T04:00:51.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76101ea920 con 0x7f761006f130 2023-05-24T04:00:51.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7610140f90 con 0x7f7610070330 2023-05-24T04:00:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76100bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76100bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58396/0 (socket says 172.21.15.40:58396) 2023-05-24T04:00:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 -- 172.21.15.40:0/784553527 learned_addr learned my addr 172.21.15.40:0/784553527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760effd640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761006f130 0x7f761014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760e7fc640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7610070330 0x7f76101ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 -- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7610070330 msgr2=0x7f76101ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7610070330 0x7f76101ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 -- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761006f130 msgr2=0x7f761014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761006f130 0x7f761014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 -- 172.21.15.40:0/784553527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009420 con 0x7f761014ba30 2023-05-24T04:00:51.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f760f7fe640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76100bc3b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f760800c770 tx=0x7f760800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608003b80 con 0x7f761014ba30 2023-05-24T04:00:51.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608003ce0 con 0x7f761014ba30 2023-05-24T04:00:51.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100716a0 con 0x7f761014ba30 2023-05-24T04:00:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800aa30 con 0x7f761014ba30 2023-05-24T04:00:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.229+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7610071510 con 0x7f761014ba30 2023-05-24T04:00:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.233+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761015c570 con 0x7f761014ba30 2023-05-24T04:00:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.233+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f760800ab90 con 0x7f761014ba30 2023-05-24T04:00:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.233+0000 7f75f77fe640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f75fc0662b0 0x7f75fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.233+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7608083e60 con 0x7f761014ba30 2023-05-24T04:00:51.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.233+0000 7f760effd640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f75fc0662b0 0x7f75fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.233+0000 7f760effd640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f75fc0662b0 0x7f75fc068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76000ae000 tx=0x7f76000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.237+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7608050fb0 con 0x7f761014ba30 2023-05-24T04:00:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.389+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7610066d70 con 0x7f761014ba30 2023-05-24T04:00:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.389+0000 7f75f77fe640 1 -- 172.21.15.40:0/784553527 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76080545d0 con 0x7f761014ba30 2023-05-24T04:00:51.397 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:51.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f75fc0662b0 msgr2=0x7f75fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f75fc0662b0 0x7f75fc068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76000ae000 tx=0x7f76000a7000 comp rx=0 tx=0).stop 2023-05-24T04:00:51.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 msgr2=0x7f76100bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76100bc3b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f760800c770 tx=0x7f760800cc30 comp rx=0 tx=0).stop 2023-05-24T04:00:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 shutdown_connections 2023-05-24T04:00:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f75fc0662b0 0x7f75fc068760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761014ba30 0x7f76100bc3b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7610070330 0x7f76101ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 --2- 172.21.15.40:0/784553527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761006f130 0x7f761014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 >> 172.21.15.40:0/784553527 conn(0x7f76100c0ba0 msgr2=0x7f76100bec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 shutdown_connections 2023-05-24T04:00:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.393+0000 7f7615368640 1 -- 172.21.15.40:0/784553527 wait complete. 2023-05-24T04:00:51.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35e7bf640 1 Processor -- start 2023-05-24T04:00:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35e7bf640 1 -- start start 2023-05-24T04:00:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35e7bf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3580bedc0 0x7fe3580bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35e7bf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580a3a90 con 0x7fe3580c1000 2023-05-24T04:00:51.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35e7bf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580aa610 con 0x7fe3580c4080 2023-05-24T04:00:51.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35e7bf640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580a37f0 con 0x7fe3580bedc0 2023-05-24T04:00:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35cd5c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe3580c1000 0x7fe358151f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46028/0 (socket says 172.21.15.40:46028) 2023-05-24T04:00:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35cd5c640 1 -- 172.21.15.40:0/1589736443 learned_addr learned my addr 172.21.15.40:0/1589736443 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe357fff640 1 --2- 172.21.15.40:0/1589736443 >> v2:172.21.15.67:3300/0 conn(0x7fe3580bedc0 0x7fe3580bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522756072 0 0) 0x7fe3580a3a90 con 0x7fe3580c1000 2023-05-24T04:00:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe340003530 con 0x7fe3580c1000 2023-05-24T04:00:51.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148673722 0 0) 0x7fe340003530 con 0x7fe3580c1000 2023-05-24T04:00:51.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 >> v2:172.21.15.67:3300/0 conn(0x7fe3580bedc0 msgr2=0x7fe3580bf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:51.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 --2- 172.21.15.40:0/1589736443 >> v2:172.21.15.67:3300/0 conn(0x7fe3580bedc0 0x7fe3580bf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 >> v1:172.21.15.67:6789/0 conn(0x7fe3580c4080 legacy=0x7fe3580c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c44e0 con 0x7fe3580c1000 2023-05-24T04:00:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fe348001680 con 0x7fe3580c1000 2023-05-24T04:00:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 >> v1:172.21.15.40:6789/0 conn(0x7fe3580c1000 legacy=0x7fe358151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe340003980 0x7fe340003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3400047d0 0x7fe340004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe340005180 0x7fe34000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580a37f0 con 0x7fe3400047d0 2023-05-24T04:00:51.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34000c000 con 0x7fe340003980 2023-05-24T04:00:51.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34000c1c0 con 0x7fe340005180 2023-05-24T04:00:51.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe3577fe640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3400047d0 0x7fe340004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe357fff640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe340003980 0x7fe340003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35cd5c640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe340005180 0x7fe34000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe3577fe640 1 -- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe340005180 msgr2=0x7fe34000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:51.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe3577fe640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe340005180 0x7fe34000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe3577fe640 1 -- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe340003980 msgr2=0x7fe340003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:51.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe3577fe640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe340003980 0x7fe340003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe3577fe640 1 -- 172.21.15.40:0/1589736443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340003530 con 0x7fe3400047d0 2023-05-24T04:00:51.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.533+0000 7fe35cd5c640 1 -- 172.21.15.40:0/1589736443 reap_dead start 2023-05-24T04:00:51.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe3577fe640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3400047d0 0x7fe340004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe34c001780 tx=0x7fe34c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776578e2f032dd55 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0052d0 con 0x7fe3400047d0 2023-05-24T04:00:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0a7050 con 0x7fe3400047d0 2023-05-24T04:00:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe356ffd640 1 -- 172.21.15.40:0/1589736443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c003600 con 0x7fe3400047d0 2023-05-24T04:00:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- 172.21.15.40:0/1589736443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3400047d0 msgr2=0x7fe340004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3400047d0 0x7fe340004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe34c001780 tx=0x7fe34c01c400 comp rx=0 tx=0).stop 2023-05-24T04:00:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- 172.21.15.40:0/1589736443 shutdown_connections 2023-05-24T04:00:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/1589736443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3400047d0 0x7fe340004c40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- 172.21.15.40:0/1589736443 >> 172.21.15.40:0/1589736443 conn(0x7fe3580a6340 msgr2=0x7fe3580a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- 172.21.15.40:0/1589736443 shutdown_connections 2023-05-24T04:00:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- 172.21.15.40:0/1589736443 wait complete. 2023-05-24T04:00:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 Processor -- start 2023-05-24T04:00:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- start start 2023-05-24T04:00:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3400047d0 0x7fe3580a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3580badb0 0x7fe3581e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 0x7fe3580bd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581e2f70 con 0x7fe3580bdbd0 2023-05-24T04:00:51.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581e31f0 con 0x7fe3580badb0 2023-05-24T04:00:51.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35e7bf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581e34d0 con 0x7fe3400047d0 2023-05-24T04:00:51.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 0x7fe3580bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 0x7fe3580bd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45400/0 (socket says 172.21.15.40:45400) 2023-05-24T04:00:51.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 -- 172.21.15.40:0/3044601774 learned_addr learned my addr 172.21.15.40:0/3044601774 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:51.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe3577fe640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3580badb0 0x7fe3581e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe357fff640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3400047d0 0x7fe3580a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 -- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3400047d0 msgr2=0x7fe3580a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3400047d0 0x7fe3580a3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 -- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3580badb0 msgr2=0x7fe3581e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3580badb0 0x7fe3581e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.537+0000 7fe35cd5c640 1 -- 172.21.15.40:0/3044601774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580bb690 con 0x7fe3580bdbd0 2023-05-24T04:00:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe35cd5c640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 0x7fe3580bd070 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe348001ec0 tx=0x7fe348011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348014370 con 0x7fe3580bdbd0 2023-05-24T04:00:51.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3480144d0 con 0x7fe3580bdbd0 2023-05-24T04:00:51.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580bb500 con 0x7fe3580bdbd0 2023-05-24T04:00:51.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348014880 con 0x7fe3580bdbd0 2023-05-24T04:00:51.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580c35e0 con 0x7fe3580bdbd0 2023-05-24T04:00:51.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3581e3690 con 0x7fe3580bdbd0 2023-05-24T04:00:51.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3480149e0 con 0x7fe3580bdbd0 2023-05-24T04:00:51.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe354ff9640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe3440662b0 0x7fe344068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe357fff640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe3440662b0 0x7fe344068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe3480861f0 con 0x7fe3580bdbd0 2023-05-24T04:00:51.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.541+0000 7fe357fff640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe3440662b0 0x7fe344068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe350007520 tx=0x7fe35000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.545+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe348053330 con 0x7fe3580bdbd0 2023-05-24T04:00:51.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe35804ddd0 con 0x7fe3580bdbd0 2023-05-24T04:00:51.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe354ff9640 1 -- 172.21.15.40:0/3044601774 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe34801c020 con 0x7fe3580bdbd0 2023-05-24T04:00:51.708 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:51.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe3440662b0 msgr2=0x7fe344068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe3440662b0 0x7fe344068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe350007520 tx=0x7fe35000b040 comp rx=0 tx=0).stop 2023-05-24T04:00:51.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 msgr2=0x7fe3580bd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 0x7fe3580bd070 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe348001ec0 tx=0x7fe348011850 comp rx=0 tx=0).stop 2023-05-24T04:00:51.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 shutdown_connections 2023-05-24T04:00:51.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe3440662b0 0x7fe344068760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3580bdbd0 0x7fe3580bd070 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3580badb0 0x7fe3581e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 --2- 172.21.15.40:0/3044601774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3400047d0 0x7fe3580a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 >> 172.21.15.40:0/3044601774 conn(0x7fe3580a6340 msgr2=0x7fe3581d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:51.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.701+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 shutdown_connections 2023-05-24T04:00:51.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.705+0000 7fe35e7bf640 1 -- 172.21.15.40:0/3044601774 wait complete. 2023-05-24T04:00:51.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:00:51.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 Processor -- start 2023-05-24T04:00:51.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 -- start start 2023-05-24T04:00:51.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67e814bc80 0x7f67e80a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e8071220 0x7f67e8071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67e80bcd20 0x7f67e80bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e80a5040 con 0x7f67e80bcd20 2023-05-24T04:00:51.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e8070ab0 con 0x7f67e814bc80 2023-05-24T04:00:51.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67ed171640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e814d0f0 con 0x7f67e8071220 2023-05-24T04:00:51.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67e80bcd20 0x7f67e80bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67e80bcd20 0x7f67e80bd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45406/0 (socket says 172.21.15.40:45406) 2023-05-24T04:00:51.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e659c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e8071220 0x7f67e8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e6d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67e814bc80 0x7f67e80a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 -- 172.21.15.40:0/2317202524 learned_addr learned my addr 172.21.15.40:0/2317202524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:51.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 -- 172.21.15.40:0/2317202524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e8071220 msgr2=0x7f67e8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:51.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 --2- 172.21.15.40:0/2317202524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e8071220 0x7f67e8071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 -- 172.21.15.40:0/2317202524 >> v2:172.21.15.67:3300/0 conn(0x7f67e814bc80 msgr2=0x7f67e80a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:51.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 --2- 172.21.15.40:0/2317202524 >> v2:172.21.15.67:3300/0 conn(0x7f67e814bc80 0x7f67e80a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.845+0000 7f67e759e640 1 -- 172.21.15.40:0/2317202524 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e8070d00 con 0x7f67e80bcd20 2023-05-24T04:00:51.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e759e640 1 --2- 172.21.15.40:0/2317202524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e80bcd20 0x7f67e80bd1a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f67e806e350 tx=0x7f67e001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a49918dbec019aa server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e5d9b640 1 -- 172.21.15.40:0/2317202524 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00a5750 con 0x7f67e80bcd20 2023-05-24T04:00:51.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e5d9b640 1 -- 172.21.15.40:0/2317202524 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e00a58b0 con 0x7f67e80bcd20 2023-05-24T04:00:51.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e5d9b640 1 -- 172.21.15.40:0/2317202524 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00a5c40 con 0x7f67e80bcd20 2023-05-24T04:00:51.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2317202524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e80bcd20 msgr2=0x7f67e80bd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- 172.21.15.40:0/2317202524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e80bcd20 0x7f67e80bd1a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f67e806e350 tx=0x7f67e001c8b0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2317202524 shutdown_connections 2023-05-24T04:00:51.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- 172.21.15.40:0/2317202524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e80bcd20 0x7f67e80bd1a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- 172.21.15.40:0/2317202524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e8071220 0x7f67e8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- 172.21.15.40:0/2317202524 >> v2:172.21.15.67:3300/0 conn(0x7f67e814bc80 0x7f67e80a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2317202524 >> 172.21.15.40:0/2317202524 conn(0x7f67e80c0310 msgr2=0x7f67e80c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:51.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2317202524 shutdown_connections 2023-05-24T04:00:51.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2317202524 wait complete. 2023-05-24T04:00:51.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 Processor -- start 2023-05-24T04:00:51.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- start start 2023-05-24T04:00:51.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 0x7f67e81470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67e80bcd20 0x7f67e814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e814bc80 0x7f67e8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e813f370 con 0x7f67e8071220 2023-05-24T04:00:51.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e814efb0 con 0x7f67e80bcd20 2023-05-24T04:00:51.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e813f0d0 con 0x7f67e814bc80 2023-05-24T04:00:51.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 0x7f67e81470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 0x7f67e81470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45420/0 (socket says 172.21.15.40:45420) 2023-05-24T04:00:51.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 -- 172.21.15.40:0/2490414688 learned_addr learned my addr 172.21.15.40:0/2490414688 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:51.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 -- 172.21.15.40:0/2490414688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e814bc80 msgr2=0x7f67e8142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e814bc80 0x7f67e8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 -- 172.21.15.40:0/2490414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67e80bcd20 msgr2=0x7f67e814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:51.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67e80bcd20 0x7f67e814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:51.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 -- 172.21.15.40:0/2490414688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0009b30 con 0x7f67e8071220 2023-05-24T04:00:51.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67e6d9d640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 0x7f67e81470f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67d800e870 tx=0x7f67d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8009510 con 0x7f67e8071220 2023-05-24T04:00:51.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800eec0 con 0x7f67e8071220 2023-05-24T04:00:51.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e814cd50 con 0x7f67e8071220 2023-05-24T04:00:51.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800cb40 con 0x7f67e8071220 2023-05-24T04:00:51.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.849+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e814c050 con 0x7f67e8071220 2023-05-24T04:00:51.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.853+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e81500d0 con 0x7f67e8071220 2023-05-24T04:00:51.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.853+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67d800cca0 con 0x7f67e8071220 2023-05-24T04:00:51.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.853+0000 7f67cf7fe640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67d4066280 0x7f67d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:51.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.853+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f67d80844f0 con 0x7f67e8071220 2023-05-24T04:00:51.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.853+0000 7f67e659c640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67d4066280 0x7f67d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:51.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.853+0000 7f67e659c640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67d4066280 0x7f67d4068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f67e806cd50 tx=0x7f67dc009520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:51.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:51.857+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f67d8051640 con 0x7f67e8071220 2023-05-24T04:00:52.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.009+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67e80bcb90 con 0x7f67e8071220 2023-05-24T04:00:52.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.009+0000 7f67cf7fe640 1 -- 172.21.15.40:0/2490414688 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67d8054c60 con 0x7f67e8071220 2023-05-24T04:00:52.017 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:00:52.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67d4066280 msgr2=0x7f67d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67d4066280 0x7f67d4068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f67e806cd50 tx=0x7f67dc009520 comp rx=0 tx=0).stop 2023-05-24T04:00:52.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 msgr2=0x7f67e81470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 0x7f67e81470f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67d800e870 tx=0x7f67d800ec70 comp rx=0 tx=0).stop 2023-05-24T04:00:52.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 shutdown_connections 2023-05-24T04:00:52.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f67d4066280 0x7f67d4068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67e814bc80 0x7f67e8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67e80bcd20 0x7f67e814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 --2- 172.21.15.40:0/2490414688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67e8071220 0x7f67e81470f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 >> 172.21.15.40:0/2490414688 conn(0x7f67e80c0310 msgr2=0x7f67e81404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:52.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 shutdown_connections 2023-05-24T04:00:52.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.013+0000 7f67ed171640 1 -- 172.21.15.40:0/2490414688 wait complete. 2023-05-24T04:00:52.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:00:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.149+0000 7f5cf5650640 1 Processor -- start 2023-05-24T04:00:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.149+0000 7f5cf5650640 1 -- start start 2023-05-24T04:00:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.149+0000 7f5cf5650640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cf00a4d10 0x7f5cf00bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cf5650640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 0x7f5cf0155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cf5650640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf0148760 con 0x7f5cf0148390 2023-05-24T04:00:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cf5650640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf006eac0 con 0x7f5cf00a4d10 2023-05-24T04:00:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cf5650640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00702d0 con 0x7f5cf00bdb60 2023-05-24T04:00:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 0x7f5cf0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5ce7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cf00a4d10 0x7f5cf00bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 0x7f5cf0155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:57814/0 (socket says 172.21.15.40:57814) 2023-05-24T04:00:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 -- 172.21.15.40:0/1616696411 learned_addr learned my addr 172.21.15.40:0/1616696411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5ceeffd640 1 --1- 172.21.15.40:0/1616696411 >> v1:172.21.15.67:6789/0 conn(0x7f5cf0148390 0x7f5cf0071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:58012/0 (socket says 172.21.15.40:58012) 2023-05-24T04:00:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 -- 172.21.15.40:0/1616696411 >> v2:172.21.15.67:3300/0 conn(0x7f5cf00a4d10 msgr2=0x7f5cf00bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 --2- 172.21.15.40:0/1616696411 >> v2:172.21.15.67:3300/0 conn(0x7f5cf00a4d10 0x7f5cf00bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 -- 172.21.15.40:0/1616696411 >> v1:172.21.15.67:6789/0 conn(0x7f5cf0148390 legacy=0x7f5cf0071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 -- 172.21.15.40:0/1616696411 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00a5150 con 0x7f5cf00bdb60 2023-05-24T04:00:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cef7fe640 1 --2- 172.21.15.40:0/1616696411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 0x7f5cf0155340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800d150 tx=0x7f5ce801ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eeaac5a060a9037 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cee7fc640 1 -- 172.21.15.40:0/1616696411 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800b2d0 con 0x7f5cf00bdb60 2023-05-24T04:00:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cee7fc640 1 -- 172.21.15.40:0/1616696411 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800b430 con 0x7f5cf00bdb60 2023-05-24T04:00:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.153+0000 7f5cee7fc640 1 -- 172.21.15.40:0/1616696411 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80a7c50 con 0x7f5cf00bdb60 2023-05-24T04:00:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/1616696411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 msgr2=0x7f5cf0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 --2- 172.21.15.40:0/1616696411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 0x7f5cf0155340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800d150 tx=0x7f5ce801ebe0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/1616696411 shutdown_connections 2023-05-24T04:00:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 --2- 172.21.15.40:0/1616696411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf00bdb60 0x7f5cf0155340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 --2- 172.21.15.40:0/1616696411 >> v2:172.21.15.67:3300/0 conn(0x7f5cf00a4d10 0x7f5cf00bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/1616696411 >> 172.21.15.40:0/1616696411 conn(0x7f5cf00c0310 msgr2=0x7f5cf00c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/1616696411 shutdown_connections 2023-05-24T04:00:52.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/1616696411 wait complete. 2023-05-24T04:00:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 Processor -- start 2023-05-24T04:00:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- start start 2023-05-24T04:00:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf00a4d10 0x7f5cf00b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 0x7f5cf01e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf0148390 0x7f5cf01ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0141260 con 0x7f5cf00bdb60 2023-05-24T04:00:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf013b5a0 con 0x7f5cf00a4d10 2023-05-24T04:00:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0140f40 con 0x7f5cf0148390 2023-05-24T04:00:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 0x7f5cf01e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 0x7f5cf01e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45422/0 (socket says 172.21.15.40:45422) 2023-05-24T04:00:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 -- 172.21.15.40:0/3800194672 learned_addr learned my addr 172.21.15.40:0/3800194672 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ceeffd640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf00a4d10 0x7f5cf00b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cef7fe640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf0148390 0x7f5cf01ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 -- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf0148390 msgr2=0x7f5cf01ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf0148390 0x7f5cf01ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 -- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf00a4d10 msgr2=0x7f5cf00b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf00a4d10 0x7f5cf00b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 -- 172.21.15.40:0/3800194672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce800bd40 con 0x7f5cf00bdb60 2023-05-24T04:00:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce7fff640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 0x7f5cf01e9ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800e930 tx=0x7f5cd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8009690 con 0x7f5cf00bdb60 2023-05-24T04:00:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800c9a0 con 0x7f5cf00bdb60 2023-05-24T04:00:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf00c1100 con 0x7f5cf00bdb60 2023-05-24T04:00:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800cd10 con 0x7f5cf00bdb60 2023-05-24T04:00:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.157+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf006ed10 con 0x7f5cf00bdb60 2023-05-24T04:00:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.161+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf00bc8e0 con 0x7f5cf00bdb60 2023-05-24T04:00:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.161+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5cd8013470 con 0x7f5cf00bdb60 2023-05-24T04:00:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.161+0000 7f5ce77fe640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.161+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5cd80841e0 con 0x7f5cf00bdb60 2023-05-24T04:00:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.161+0000 7f5ceeffd640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.161+0000 7f5ceeffd640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5cd0066280 0x7f5cd0068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0000f70 tx=0x7f5ce0007cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:52.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.165+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5cd8051410 con 0x7f5cf00bdb60 2023-05-24T04:00:52.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5cf0140d10 con 0x7f5cf00bdb60 2023-05-24T04:00:52.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5ce77fe640 1 -- 172.21.15.40:0/3800194672 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5cf0140d10 con 0x7f5cf00bdb60 2023-05-24T04:00:52.318 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:00:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5cd0066280 msgr2=0x7f5cd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5cd0066280 0x7f5cd0068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0000f70 tx=0x7f5ce0007cf0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 msgr2=0x7f5cf01e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 0x7f5cf01e9ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800e930 tx=0x7f5cd800edf0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 shutdown_connections 2023-05-24T04:00:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f5cd0066280 0x7f5cd0068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cf0148390 0x7f5cf01ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf00bdb60 0x7f5cf01e9ad0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 --2- 172.21.15.40:0/3800194672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf00a4d10 0x7f5cf00b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 >> 172.21.15.40:0/3800194672 conn(0x7f5cf00c0310 msgr2=0x7f5cf01474f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 shutdown_connections 2023-05-24T04:00:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.313+0000 7f5cf5650640 1 -- 172.21.15.40:0/3800194672 wait complete. 2023-05-24T04:00:52.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:00:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2197a16640 1 Processor -- start 2023-05-24T04:00:52.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2197a16640 1 -- start start 2023-05-24T04:00:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2197a16640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f219014fa70 0x7f219006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2197a16640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219006ea20 con 0x7f2190070b20 2023-05-24T04:00:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2197a16640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219006ec70 con 0x7f2190145df0 2023-05-24T04:00:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2197a16640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2190150230 con 0x7f219014fa70 2023-05-24T04:00:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2194fb1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2190070b20 0x7f219006bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46044/0 (socket says 172.21.15.40:46044) 2023-05-24T04:00:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2194fb1640 1 -- 172.21.15.40:0/3084848032 learned_addr learned my addr 172.21.15.40:0/3084848032 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f21957b2640 1 --2- 172.21.15.40:0/3084848032 >> v2:172.21.15.67:3300/0 conn(0x7f219014fa70 0x7f219006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648782762 0 0) 0x7f219006ea20 con 0x7f2190070b20 2023-05-24T04:00:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2178003530 con 0x7f2190070b20 2023-05-24T04:00:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2862410790 0 0) 0x7f2178003530 con 0x7f2190070b20 2023-05-24T04:00:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 >> v2:172.21.15.67:3300/0 conn(0x7f219014fa70 msgr2=0x7f219006fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 --2- 172.21.15.40:0/3084848032 >> v2:172.21.15.67:3300/0 conn(0x7f219014fa70 0x7f219006fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 >> v1:172.21.15.67:6789/0 conn(0x7f2190145df0 legacy=0x7f2190156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219006c1d0 con 0x7f2190070b20 2023-05-24T04:00:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f2184001680 con 0x7f2190070b20 2023-05-24T04:00:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 >> v1:172.21.15.40:6789/0 conn(0x7f2190070b20 legacy=0x7f219006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178003980 0x7f2178003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21780047d0 0x7f2178004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2178005180 0x7f217800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190150230 con 0x7f2178005180 2023-05-24T04:00:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217800c000 con 0x7f2178003980 2023-05-24T04:00:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217800c1c0 con 0x7f21780047d0 2023-05-24T04:00:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2178005180 0x7f217800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f21957b2640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178003980 0x7f2178003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2194fb1640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21780047d0 0x7f2178004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2195fb3640 1 -- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21780047d0 msgr2=0x7f2178004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.457+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21780047d0 0x7f2178004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2195fb3640 1 -- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178003980 msgr2=0x7f2178003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:52.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178003980 0x7f2178003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2195fb3640 1 -- 172.21.15.40:0/3084848032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178003530 con 0x7f2178005180 2023-05-24T04:00:52.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2195fb3640 1 -- 172.21.15.40:0/3084848032 reap_dead start 2023-05-24T04:00:52.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2178005180 0x7f217800b990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2180001780 tx=0x7f218001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502c9e6b81f82669 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:52.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800052d0 con 0x7f2178005180 2023-05-24T04:00:52.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21800a7050 con 0x7f2178005180 2023-05-24T04:00:52.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f218ffff640 1 -- 172.21.15.40:0/3084848032 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180003840 con 0x7f2178005180 2023-05-24T04:00:52.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 -- 172.21.15.40:0/3084848032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2178005180 msgr2=0x7f217800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2178005180 0x7f217800b990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2180001780 tx=0x7f218001c400 comp rx=0 tx=0).stop 2023-05-24T04:00:52.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 -- 172.21.15.40:0/3084848032 shutdown_connections 2023-05-24T04:00:52.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 --2- 172.21.15.40:0/3084848032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2178005180 0x7f217800b990 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 -- 172.21.15.40:0/3084848032 >> 172.21.15.40:0/3084848032 conn(0x7f21900c0280 msgr2=0x7f21900c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:52.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 -- 172.21.15.40:0/3084848032 shutdown_connections 2023-05-24T04:00:52.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.461+0000 7f2197a16640 1 -- 172.21.15.40:0/3084848032 wait complete. 2023-05-24T04:00:52.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 Processor -- start 2023-05-24T04:00:52.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- start start 2023-05-24T04:00:52.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178005180 0x7f219014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2190148ba0 0x7f21901467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 0x7f21901e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21901e11b0 con 0x7f2190140ea0 2023-05-24T04:00:52.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190148420 con 0x7f2178005180 2023-05-24T04:00:52.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21901477d0 con 0x7f2190148ba0 2023-05-24T04:00:52.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 0x7f21901e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 0x7f21901e15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45440/0 (socket says 172.21.15.40:45440) 2023-05-24T04:00:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 -- 172.21.15.40:0/3930787633 learned_addr learned my addr 172.21.15.40:0/3930787633 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f21957b2640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178005180 0x7f219014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2194fb1640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2190148ba0 0x7f21901467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 -- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2190148ba0 msgr2=0x7f21901467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2190148ba0 0x7f21901467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 -- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178005180 msgr2=0x7f219014add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178005180 0x7f219014add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 -- 172.21.15.40:0/3930787633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219014d330 con 0x7f2190140ea0 2023-05-24T04:00:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2194fb1640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2190148ba0 0x7f21901467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2195fb3640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 0x7f21901e15d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2180097e10 tx=0x7f2178005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800b0070 con 0x7f2190140ea0 2023-05-24T04:00:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180007230 con 0x7f2190140ea0 2023-05-24T04:00:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21900c10d0 con 0x7f2190140ea0 2023-05-24T04:00:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800075a0 con 0x7f2190140ea0 2023-05-24T04:00:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219014fe40 con 0x7f2190140ea0 2023-05-24T04:00:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21901e12f0 con 0x7f2190140ea0 2023-05-24T04:00:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21800067e0 con 0x7f2190140ea0 2023-05-24T04:00:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f218dffb640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f217c0662b0 0x7f217c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f218011d030 con 0x7f2190140ea0 2023-05-24T04:00:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.465+0000 7f21957b2640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f217c0662b0 0x7f217c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.469+0000 7f21957b2640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f217c0662b0 0x7f217c068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2188009fd0 tx=0x7f218800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.469+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f21901e12f0 con 0x7f2190140ea0 2023-05-24T04:00:52.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:52.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:52.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:52.503 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:52.506 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:00:52.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.637+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21901e12f0 con 0x7f2190140ea0 2023-05-24T04:00:52.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.637+0000 7f218dffb640 1 -- 172.21.15.40:0/3930787633 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21901e12f0 con 0x7f2190140ea0 2023-05-24T04:00:52.645 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:00:52.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f217c0662b0 msgr2=0x7f217c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f217c0662b0 0x7f217c068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2188009fd0 tx=0x7f218800b040 comp rx=0 tx=0).stop 2023-05-24T04:00:52.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 msgr2=0x7f21901e15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:52.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 0x7f21901e15d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2180097e10 tx=0x7f2178005800 comp rx=0 tx=0).stop 2023-05-24T04:00:52.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 shutdown_connections 2023-05-24T04:00:52.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f217c0662b0 0x7f217c068760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2190140ea0 0x7f21901e15d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2190148ba0 0x7f21901467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 --2- 172.21.15.40:0/3930787633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2178005180 0x7f219014add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:52.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 >> 172.21.15.40:0/3930787633 conn(0x7f21900c0280 msgr2=0x7f219006fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:52.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 shutdown_connections 2023-05-24T04:00:52.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:52.641+0000 7f2197a16640 1 -- 172.21.15.40:0/3930787633 wait complete. 2023-05-24T04:00:52.663 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2023-05-24T04:00:52.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:52.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-24T04:00:52.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[32525]: fuse finished with error 0 and tester_r 0 2023-05-24T04:00:52.679 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:00:58.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2023-05-24T04:00:58.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:00:58.782 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-24T04:00:58.791 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T04:00:58.792 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:58.799 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T04:00:58.799 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:00:58.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:00:58.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c8dfc640 1 Processor -- start 2023-05-24T04:00:58.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c8dfc640 1 -- start start 2023-05-24T04:00:58.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c8dfc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79c414fa70 0x7f79c406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:58.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c8dfc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c406ea20 con 0x7f79c4070b20 2023-05-24T04:00:58.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c8dfc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c406ec70 con 0x7f79c4145df0 2023-05-24T04:00:58.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c8dfc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c4150230 con 0x7f79c414fa70 2023-05-24T04:00:58.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79c414fa70 0x7f79c406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:58.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79c414fa70 0x7f79c406fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45446/0 (socket says 172.21.15.40:45446) 2023-05-24T04:00:58.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c1d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f79c4070b20 0x7f79c406bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46052/0 (socket says 172.21.15.40:46052) 2023-05-24T04:00:58.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c259c640 1 -- 172.21.15.40:0/3208079857 learned_addr learned my addr 172.21.15.40:0/3208079857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:58.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c259c640 1 -- 172.21.15.40:0/3208079857 >> v1:172.21.15.67:6789/0 conn(0x7f79c4145df0 legacy=0x7f79c4156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:58.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c259c640 1 -- 172.21.15.40:0/3208079857 >> v1:172.21.15.40:6789/0 conn(0x7f79c4070b20 legacy=0x7f79c406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:58.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c159a640 1 -- 172.21.15.40:0/3208079857 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109383516 0 0) 0x7f79c406ea20 con 0x7f79c4070b20 2023-05-24T04:00:58.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.981+0000 7f79c259c640 1 -- 172.21.15.40:0/3208079857 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c406c1d0 con 0x7f79c414fa70 2023-05-24T04:00:58.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c259c640 1 --2- 172.21.15.40:0/3208079857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c414fa70 0x7f79c406fd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009870 tx=0x7f79b401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef4e1d6025b9454 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:58.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c159a640 1 -- 172.21.15.40:0/3208079857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40ab610 con 0x7f79c414fa70 2023-05-24T04:00:58.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c159a640 1 -- 172.21.15.40:0/3208079857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40ab770 con 0x7f79c414fa70 2023-05-24T04:00:58.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c159a640 1 -- 172.21.15.40:0/3208079857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40abb00 con 0x7f79c414fa70 2023-05-24T04:00:58.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- 172.21.15.40:0/3208079857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c414fa70 msgr2=0x7f79c406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:58.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/3208079857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c414fa70 0x7f79c406fd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009870 tx=0x7f79b401c540 comp rx=0 tx=0).stop 2023-05-24T04:00:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- 172.21.15.40:0/3208079857 shutdown_connections 2023-05-24T04:00:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/3208079857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c414fa70 0x7f79c406fd50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- 172.21.15.40:0/3208079857 >> 172.21.15.40:0/3208079857 conn(0x7f79c40c0280 msgr2=0x7f79c40c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- 172.21.15.40:0/3208079857 shutdown_connections 2023-05-24T04:00:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- 172.21.15.40:0/3208079857 wait complete. 2023-05-24T04:00:58.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 Processor -- start 2023-05-24T04:00:58.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- start start 2023-05-24T04:00:58.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c4070b20 0x7f79c4141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:58.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 0x7f79c40bb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:58.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c414fa70 0x7f79c40bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:58.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41ea590 con 0x7f79c4145df0 2023-05-24T04:00:58.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c414c530 con 0x7f79c414fa70 2023-05-24T04:00:58.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c8dfc640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41ea020 con 0x7f79c4070b20 2023-05-24T04:00:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 0x7f79c40bb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 0x7f79c40bb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45452/0 (socket says 172.21.15.40:45452) 2023-05-24T04:00:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.985+0000 7f79c1d9b640 1 -- 172.21.15.40:0/813601994 learned_addr learned my addr 172.21.15.40:0/813601994 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c259c640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c4070b20 0x7f79c4141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c1d9b640 1 -- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c4070b20 msgr2=0x7f79c4141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c2d9d640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c414fa70 0x7f79c40bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c1d9b640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c4070b20 0x7f79c4141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c1d9b640 1 -- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c414fa70 msgr2=0x7f79c40bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c1d9b640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c414fa70 0x7f79c40bbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c1d9b640 1 -- 172.21.15.40:0/813601994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40094d0 con 0x7f79c4145df0 2023-05-24T04:00:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c1d9b640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 0x7f79c40bb870 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c410 tx=0x7f79b800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80074e0 con 0x7f79c4145df0 2023-05-24T04:00:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8007640 con 0x7f79c4145df0 2023-05-24T04:00:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8004a30 con 0x7f79c4145df0 2023-05-24T04:00:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c4070290 con 0x7f79c4145df0 2023-05-24T04:00:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c414d330 con 0x7f79c4145df0 2023-05-24T04:00:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c414fe40 con 0x7f79c4145df0 2023-05-24T04:00:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79b8004b90 con 0x7f79c4145df0 2023-05-24T04:00:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79b2ffd640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f79a4066280 0x7f79a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f79b8083e30 con 0x7f79c4145df0 2023-05-24T04:00:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c259c640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f79a4066280 0x7f79a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.989+0000 7f79c259c640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f79a4066280 0x7f79a4068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f79b40af000 tx=0x7f79b40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:58.993+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f79b8054a10 con 0x7f79c4145df0 2023-05-24T04:00:59.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.157+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c414c1a0 con 0x7f79c4145df0 2023-05-24T04:00:59.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79b2ffd640 1 -- 172.21.15.40:0/813601994 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7f79c414c1a0 con 0x7f79c4145df0 2023-05-24T04:00:59.167 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:00:59.168 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:00:59.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f79a4066280 msgr2=0x7f79a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f79a4066280 0x7f79a4068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f79b40af000 tx=0x7f79b40a7000 comp rx=0 tx=0).stop 2023-05-24T04:00:59.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 msgr2=0x7f79c40bb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 0x7f79c40bb870 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c410 tx=0x7f79b800c8d0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 shutdown_connections 2023-05-24T04:00:59.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f79a4066280 0x7f79a4068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c414fa70 0x7f79c40bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c4145df0 0x7f79c40bb870 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 --2- 172.21.15.40:0/813601994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c4070b20 0x7f79c4141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 >> 172.21.15.40:0/813601994 conn(0x7f79c40c0280 msgr2=0x7f79c40be860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 shutdown_connections 2023-05-24T04:00:59.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.161+0000 7f79c8dfc640 1 -- 172.21.15.40:0/813601994 wait complete. 2023-05-24T04:00:59.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:00:59.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:00:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.313+0000 7f8705aff640 1 Processor -- start 2023-05-24T04:00:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.313+0000 7f8705aff640 1 -- start start 2023-05-24T04:00:59.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f8705aff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87000a4860 0x7f87000a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f8705aff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870014f730 con 0x7f8700152140 2023-05-24T04:00:59.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f8705aff640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870006eb50 con 0x7f8700151d70 2023-05-24T04:00:59.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f8705aff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870006f030 con 0x7f87000a4860 2023-05-24T04:00:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86feffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8700152140 0x7f8700071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46062/0 (socket says 172.21.15.40:46062) 2023-05-24T04:00:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86feffd640 1 -- 172.21.15.40:0/395546955 learned_addr learned my addr 172.21.15.40:0/395546955 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86fffff640 1 --2- 172.21.15.40:0/395546955 >> v2:172.21.15.40:3300/0 conn(0x7f87000a4860 0x7f87000a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86fffff640 1 -- 172.21.15.40:0/395546955 >> v1:172.21.15.67:6789/0 conn(0x7f8700151d70 legacy=0x7f870014f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86fffff640 1 -- 172.21.15.40:0/395546955 >> v1:172.21.15.40:6789/0 conn(0x7f8700152140 legacy=0x7f8700071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86fffff640 1 -- 172.21.15.40:0/395546955 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87001526a0 con 0x7f87000a4860 2023-05-24T04:00:59.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86fe7fc640 1 -- 172.21.15.40:0/395546955 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731355988 0 0) 0x7f870014f730 con 0x7f8700152140 2023-05-24T04:00:59.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.317+0000 7f86fffff640 1 --2- 172.21.15.40:0/395546955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87000a4860 0x7f87000a33a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009d90 tx=0x7f86f801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292feab0ecf317b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86fe7fc640 1 -- 172.21.15.40:0/395546955 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80a5940 con 0x7f87000a4860 2023-05-24T04:00:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86fe7fc640 1 -- 172.21.15.40:0/395546955 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f80a5aa0 con 0x7f87000a4860 2023-05-24T04:00:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86fe7fc640 1 -- 172.21.15.40:0/395546955 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80a5e30 con 0x7f87000a4860 2023-05-24T04:00:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/395546955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87000a4860 msgr2=0x7f87000a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 --2- 172.21.15.40:0/395546955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87000a4860 0x7f87000a33a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009d90 tx=0x7f86f801c8c0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/395546955 shutdown_connections 2023-05-24T04:00:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 --2- 172.21.15.40:0/395546955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87000a4860 0x7f87000a33a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/395546955 >> 172.21.15.40:0/395546955 conn(0x7f87000c0310 msgr2=0x7f87000c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/395546955 shutdown_connections 2023-05-24T04:00:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/395546955 wait complete. 2023-05-24T04:00:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 Processor -- start 2023-05-24T04:00:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- start start 2023-05-24T04:00:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87000a4860 0x7f87000bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 0x7f8700137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8700152140 0x7f8700137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700144a70 con 0x7f8700151d70 2023-05-24T04:00:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700144d50 con 0x7f87000a4860 2023-05-24T04:00:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000bf6e0 con 0x7f8700152140 2023-05-24T04:00:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 0x7f8700137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 0x7f8700137420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45476/0 (socket says 172.21.15.40:45476) 2023-05-24T04:00:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 -- 172.21.15.40:0/1332371844 learned_addr learned my addr 172.21.15.40:0/1332371844 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86ff7fe640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87000a4860 0x7f87000bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86fffff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8700152140 0x7f8700137960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 -- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8700152140 msgr2=0x7f8700137960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8700152140 0x7f8700137960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 -- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87000a4860 msgr2=0x7f87000bf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87000a4860 0x7f87000bf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 -- 172.21.15.40:0/1332371844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009a70 con 0x7f8700151d70 2023-05-24T04:00:59.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86feffd640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 0x7f8700137420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c410 tx=0x7f86f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40074e0 con 0x7f8700151d70 2023-05-24T04:00:59.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f4007640 con 0x7f8700151d70 2023-05-24T04:00:59.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700071e10 con 0x7f8700151d70 2023-05-24T04:00:59.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4004a30 con 0x7f8700151d70 2023-05-24T04:00:59.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.321+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8700071c80 con 0x7f8700151d70 2023-05-24T04:00:59.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.325+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870015c670 con 0x7f8700151d70 2023-05-24T04:00:59.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.325+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86f4004b90 con 0x7f8700151d70 2023-05-24T04:00:59.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.325+0000 7f86e7fff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f86ec066280 0x7f86ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.325+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f86f4083d80 con 0x7f8700151d70 2023-05-24T04:00:59.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.325+0000 7f86ff7fe640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f86ec066280 0x7f86ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.325+0000 7f86ff7fe640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f86ec066280 0x7f86ec068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000f70 tx=0x7f86f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.329+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f86f4050f60 con 0x7f8700151d70 2023-05-24T04:00:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f870004ddd0 con 0x7f8700151d70 2023-05-24T04:00:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f86e7fff640 1 -- 172.21.15.40:0/1332371844 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86f4054580 con 0x7f8700151d70 2023-05-24T04:00:59.491 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:00:59.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f86ec066280 msgr2=0x7f86ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f86ec066280 0x7f86ec068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000f70 tx=0x7f86f0009040 comp rx=0 tx=0).stop 2023-05-24T04:00:59.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 msgr2=0x7f8700137420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 0x7f8700137420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c410 tx=0x7f86f400c8d0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 shutdown_connections 2023-05-24T04:00:59.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f86ec066280 0x7f86ec068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.485+0000 7f8705aff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8700152140 0x7f8700137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.489+0000 7f8705aff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8700151d70 0x7f8700137420 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.489+0000 7f8705aff640 1 --2- 172.21.15.40:0/1332371844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87000a4860 0x7f87000bf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.489+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 >> 172.21.15.40:0/1332371844 conn(0x7f87000c0310 msgr2=0x7f870014e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:59.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.489+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 shutdown_connections 2023-05-24T04:00:59.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.489+0000 7f8705aff640 1 -- 172.21.15.40:0/1332371844 wait complete. 2023-05-24T04:00:59.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:00:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e4015640 1 Processor -- start 2023-05-24T04:00:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e4015640 1 -- start start 2023-05-24T04:00:59.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e4015640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06dc071670 0x7f06dc0bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e4015640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc070ab0 con 0x7f06dc14bc80 2023-05-24T04:00:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e4015640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc071a90 con 0x7f06dc071220 2023-05-24T04:00:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e4015640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0a5040 con 0x7f06dc071670 2023-05-24T04:00:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e1db1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f06dc14bc80 0x7f06dc0a33a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46072/0 (socket says 172.21.15.40:46072) 2023-05-24T04:00:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e1db1640 1 -- 172.21.15.40:0/1505222922 learned_addr learned my addr 172.21.15.40:0/1505222922 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e25b2640 1 --2- 172.21.15.40:0/1505222922 >> v2:172.21.15.40:3300/0 conn(0x7f06dc071670 0x7f06dc0bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e25b2640 1 -- 172.21.15.40:0/1505222922 >> v1:172.21.15.67:6789/0 conn(0x7f06dc071220 legacy=0x7f06dc0bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e25b2640 1 -- 172.21.15.40:0/1505222922 >> v1:172.21.15.40:6789/0 conn(0x7f06dc14bc80 legacy=0x7f06dc0a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.629+0000 7f06e25b2640 1 -- 172.21.15.40:0/1505222922 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc14d0f0 con 0x7f06dc071670 2023-05-24T04:00:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e25b2640 1 --2- 172.21.15.40:0/1505222922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc071670 0x7f06dc0bd430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009d90 tx=0x7f06d401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1197ab5732855fd8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e0daf640 1 -- 172.21.15.40:0/1505222922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40a58f0 con 0x7f06dc071670 2023-05-24T04:00:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e0daf640 1 -- 172.21.15.40:0/1505222922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40a5a50 con 0x7f06dc071670 2023-05-24T04:00:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e0daf640 1 -- 172.21.15.40:0/1505222922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40a5de0 con 0x7f06dc071670 2023-05-24T04:00:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 -- 172.21.15.40:0/1505222922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc071670 msgr2=0x7f06dc0bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 --2- 172.21.15.40:0/1505222922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc071670 0x7f06dc0bd430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009d90 tx=0x7f06d401c830 comp rx=0 tx=0).stop 2023-05-24T04:00:59.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 -- 172.21.15.40:0/1505222922 shutdown_connections 2023-05-24T04:00:59.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 --2- 172.21.15.40:0/1505222922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc071670 0x7f06dc0bd430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 -- 172.21.15.40:0/1505222922 >> 172.21.15.40:0/1505222922 conn(0x7f06dc0c0310 msgr2=0x7f06dc0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:59.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 -- 172.21.15.40:0/1505222922 shutdown_connections 2023-05-24T04:00:59.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 -- 172.21.15.40:0/1505222922 wait complete. 2023-05-24T04:00:59.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 Processor -- start 2023-05-24T04:00:59.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.633+0000 7f06e4015640 1 -- start start 2023-05-24T04:00:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06dc071220 0x7f06dc150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06dc071670 0x7f06dc145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 0x7f06dc14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1482c0 con 0x7f06dc14bc80 2023-05-24T04:00:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc145a40 con 0x7f06dc071670 2023-05-24T04:00:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1500a0 con 0x7f06dc071220 2023-05-24T04:00:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 0x7f06dc14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 0x7f06dc14f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45492/0 (socket says 172.21.15.40:45492) 2023-05-24T04:00:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 -- 172.21.15.40:0/3096561307 learned_addr learned my addr 172.21.15.40:0/3096561307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e15b0640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06dc071670 0x7f06dc145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e1db1640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06dc071220 0x7f06dc150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 -- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06dc071220 msgr2=0x7f06dc150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06dc071220 0x7f06dc150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 -- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06dc071670 msgr2=0x7f06dc145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06dc071670 0x7f06dc145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 -- 172.21.15.40:0/3096561307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009a70 con 0x7f06dc14bc80 2023-05-24T04:00:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e1db1640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06dc071220 0x7f06dc150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:00:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e25b2640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 0x7f06dc14f6f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06d401a460 tx=0x7f06d40195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40b9860 con 0x7f06dc14bc80 2023-05-24T04:00:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40b99c0 con 0x7f06dc14bc80 2023-05-24T04:00:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc14c050 con 0x7f06dc14bc80 2023-05-24T04:00:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40b9d30 con 0x7f06dc14bc80 2023-05-24T04:00:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc06b1d0 con 0x7f06dc14bc80 2023-05-24T04:00:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc0bcb90 con 0x7f06dc14bc80 2023-05-24T04:00:59.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06d40ad440 con 0x7f06dc14bc80 2023-05-24T04:00:59.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06d27fc640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f06c0066280 0x7f06c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f06d411f4a0 con 0x7f06dc14bc80 2023-05-24T04:00:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e1db1640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f06c0066280 0x7f06c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.637+0000 7f06e1db1640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f06c0066280 0x7f06c0068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06d8005890 tx=0x7f06d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.641+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f06d40ec5f0 con 0x7f06dc14bc80 2023-05-24T04:00:59.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.797+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06dc1e8220 con 0x7f06dc14bc80 2023-05-24T04:00:59.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.797+0000 7f06d27fc640 1 -- 172.21.15.40:0/3096561307 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06d40efc10 con 0x7f06dc14bc80 2023-05-24T04:00:59.803 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:00:59.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.797+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f06c0066280 msgr2=0x7f06c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.797+0000 7f06e4015640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f06c0066280 0x7f06c0068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06d8005890 tx=0x7f06d8009040 comp rx=0 tx=0).stop 2023-05-24T04:00:59.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.797+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 msgr2=0x7f06dc14f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.797+0000 7f06e4015640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 0x7f06dc14f6f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06d401a460 tx=0x7f06d40195d0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 shutdown_connections 2023-05-24T04:00:59.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f06c0066280 0x7f06c0068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06dc14bc80 0x7f06dc14f6f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06dc071670 0x7f06dc145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 --2- 172.21.15.40:0/3096561307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06dc071220 0x7f06dc150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 >> 172.21.15.40:0/3096561307 conn(0x7f06dc0c0310 msgr2=0x7f06dc1409e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:59.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 shutdown_connections 2023-05-24T04:00:59.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.801+0000 7f06e4015640 1 -- 172.21.15.40:0/3096561307 wait complete. 2023-05-24T04:00:59.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:00:59.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 Processor -- start 2023-05-24T04:00:59.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 -- start start 2023-05-24T04:00:59.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f120414c1b0 0x7f1204070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bd4f0 0x7f120406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040be160 con 0x7f1204070fe0 2023-05-24T04:00:59.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12040be8c0 con 0x7f120414c1b0 2023-05-24T04:00:59.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120c37f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040a7ea0 con 0x7f12040bd4f0 2023-05-24T04:00:59.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a11b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f120414c1b0 0x7f1204070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a91c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1204070fe0 0x7f120406e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:58062/0 (socket says 172.21.15.40:58062) 2023-05-24T04:00:59.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a91c640 1 -- 172.21.15.40:0/3625849081 learned_addr learned my addr 172.21.15.40:0/3625849081 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:00:59.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120991a640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bd4f0 0x7f120406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f1209119640 1 -- 172.21.15.40:0/3625849081 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45894754 0 0) 0x7f11fc0014a0 con 0x7f1204070fe0 2023-05-24T04:00:59.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f1209119640 1 -- 172.21.15.40:0/3625849081 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003530 con 0x7f1204070fe0 2023-05-24T04:00:59.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a11b640 1 -- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bd4f0 msgr2=0x7f120406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:00:59.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a11b640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bd4f0 0x7f120406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a11b640 1 -- 172.21.15.40:0/3625849081 >> v1:172.21.15.67:6789/0 conn(0x7f1204070fe0 legacy=0x7f120406e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120a11b640 1 -- 172.21.15.40:0/3625849081 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120414c580 con 0x7f120414c1b0 2023-05-24T04:00:59.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.941+0000 7f120991a640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bd4f0 0x7f120406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:00:59.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120a11b640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120414c1b0 0x7f1204070aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12000097c0 tx=0x7f120001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73b0edb8faf56ad server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f1209119640 1 -- 172.21.15.40:0/3625849081 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000ac640 con 0x7f120414c1b0 2023-05-24T04:00:59.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f1209119640 1 -- 172.21.15.40:0/3625849081 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000ac7a0 con 0x7f120414c1b0 2023-05-24T04:00:59.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f1209119640 1 -- 172.21.15.40:0/3625849081 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000acb10 con 0x7f120414c1b0 2023-05-24T04:00:59.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120414c1b0 msgr2=0x7f1204070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120414c1b0 0x7f1204070aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12000097c0 tx=0x7f120001c3c0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- 172.21.15.40:0/3625849081 shutdown_connections 2023-05-24T04:00:59.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bd4f0 0x7f120406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 --2- 172.21.15.40:0/3625849081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120414c1b0 0x7f1204070aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- 172.21.15.40:0/3625849081 >> 172.21.15.40:0/3625849081 conn(0x7f12040c2540 msgr2=0x7f12040c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:00:59.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- 172.21.15.40:0/3625849081 shutdown_connections 2023-05-24T04:00:59.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- 172.21.15.40:0/3625849081 wait complete. 2023-05-24T04:00:59.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 Processor -- start 2023-05-24T04:00:59.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- start start 2023-05-24T04:00:59.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 0x7f12040ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1204155200 0x7f12041482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bbc10 0x7f1204148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041e6ce0 con 0x7f1204070fe0 2023-05-24T04:00:59.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120406c760 con 0x7f1204155200 2023-05-24T04:00:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120c37f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040bae00 con 0x7f12040bbc10 2023-05-24T04:00:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.945+0000 7f120a11b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 0x7f12040ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 0x7f12040ba8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45502/0 (socket says 172.21.15.40:45502) 2023-05-24T04:00:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 -- 172.21.15.40:0/1641999796 learned_addr learned my addr 172.21.15.40:0/1641999796 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:00:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a91c640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bbc10 0x7f1204148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120991a640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1204155200 0x7f12041482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 -- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bbc10 msgr2=0x7f1204148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bbc10 0x7f1204148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 -- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1204155200 msgr2=0x7f12041482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:00:59.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1204155200 0x7f12041482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:00:59.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 -- 172.21.15.40:0/1641999796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4009420 con 0x7f1204070fe0 2023-05-24T04:00:59.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a91c640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bbc10 0x7f1204148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:00:59.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120a11b640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 0x7f12040ba8c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1200000c10 tx=0x7f1200019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000acb10 con 0x7f1204070fe0 2023-05-24T04:00:59.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000acc70 con 0x7f1204070fe0 2023-05-24T04:00:59.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1200009420 con 0x7f1204070fe0 2023-05-24T04:00:59.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200003620 con 0x7f1204070fe0 2023-05-24T04:00:59.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12040a55a0 con 0x7f1204070fe0 2023-05-24T04:00:59.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12040a83f0 con 0x7f1204070fe0 2023-05-24T04:00:59.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12000b3050 con 0x7f1204070fe0 2023-05-24T04:00:59.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f11faffd640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f11e80662b0 0x7f11e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:00:59.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120991a640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f11e80662b0 0x7f11e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:00:59.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f120011e470 con 0x7f1204070fe0 2023-05-24T04:00:59.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.949+0000 7f120991a640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f11e80662b0 0x7f11e8068760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12040b5f30 tx=0x7f11f4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:00:59.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:00:59.953+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f12000eb790 con 0x7f1204070fe0 2023-05-24T04:01:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.105+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12040a5730 con 0x7f1204070fe0 2023-05-24T04:01:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.105+0000 7f11faffd640 1 -- 172.21.15.40:0/1641999796 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12040a5730 con 0x7f1204070fe0 2023-05-24T04:01:00.112 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f11e80662b0 msgr2=0x7f11e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f11e80662b0 0x7f11e8068760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12040b5f30 tx=0x7f11f4009190 comp rx=0 tx=0).stop 2023-05-24T04:01:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 msgr2=0x7f12040ba8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 0x7f12040ba8c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1200000c10 tx=0x7f1200019160 comp rx=0 tx=0).stop 2023-05-24T04:01:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 shutdown_connections 2023-05-24T04:01:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f11e80662b0 0x7f11e8068760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12040bbc10 0x7f1204148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1204155200 0x7f12041482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 --2- 172.21.15.40:0/1641999796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1204070fe0 0x7f12040ba8c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 >> 172.21.15.40:0/1641999796 conn(0x7f12040c2540 msgr2=0x7f12040a73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 shutdown_connections 2023-05-24T04:01:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.109+0000 7f120c37f640 1 -- 172.21.15.40:0/1641999796 wait complete. 2023-05-24T04:01:00.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:01:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 Processor -- start 2023-05-24T04:01:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 -- start start 2023-05-24T04:01:00.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f100714c0 0x7f1f1014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100c0e20 0x7f1f1014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f1014f250 0x7f1f1014a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1006fe00 con 0x7f1f1014f250 2023-05-24T04:01:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f100bd750 con 0x7f1f100714c0 2023-05-24T04:01:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f174bf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100a4800 con 0x7f1f100c0e20 2023-05-24T04:01:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f1014f250 0x7f1f1014a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f1014f250 0x7f1f1014a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45512/0 (socket says 172.21.15.40:45512) 2023-05-24T04:01:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 -- 172.21.15.40:0/1107822276 learned_addr learned my addr 172.21.15.40:0/1107822276 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:00.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f14a5a640 1 --2- 172.21.15.40:0/1107822276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100c0e20 0x7f1f1014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f1525b640 1 --2- 172.21.15.40:0/1107822276 >> v2:172.21.15.67:3300/0 conn(0x7f1f100714c0 0x7f1f1014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 -- 172.21.15.40:0/1107822276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100c0e20 msgr2=0x7f1f1014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:00.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 --2- 172.21.15.40:0/1107822276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100c0e20 0x7f1f1014ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 -- 172.21.15.40:0/1107822276 >> v2:172.21.15.67:3300/0 conn(0x7f1f100714c0 msgr2=0x7f1f1014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 --2- 172.21.15.40:0/1107822276 >> v2:172.21.15.67:3300/0 conn(0x7f1f100714c0 0x7f1f1014e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f15a5c640 1 -- 172.21.15.40:0/1107822276 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100a4ae0 con 0x7f1f1014f250 2023-05-24T04:01:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.241+0000 7f1f1525b640 1 --2- 172.21.15.40:0/1107822276 >> v2:172.21.15.67:3300/0 conn(0x7f1f100714c0 0x7f1f1014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f15a5c640 1 --2- 172.21.15.40:0/1107822276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1014f250 0x7f1f1014a7f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1f1006de30 tx=0x7f1f0801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98c6d619e93e1e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f07fff640 1 -- 172.21.15.40:0/1107822276 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f080ab600 con 0x7f1f1014f250 2023-05-24T04:01:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f07fff640 1 -- 172.21.15.40:0/1107822276 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f080a7050 con 0x7f1f1014f250 2023-05-24T04:01:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f07fff640 1 -- 172.21.15.40:0/1107822276 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f080ab980 con 0x7f1f1014f250 2023-05-24T04:01:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/1107822276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1014f250 msgr2=0x7f1f1014a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- 172.21.15.40:0/1107822276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1014f250 0x7f1f1014a7f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1f1006de30 tx=0x7f1f0801c470 comp rx=0 tx=0).stop 2023-05-24T04:01:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/1107822276 shutdown_connections 2023-05-24T04:01:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- 172.21.15.40:0/1107822276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1014f250 0x7f1f1014a7f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- 172.21.15.40:0/1107822276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100c0e20 0x7f1f1014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- 172.21.15.40:0/1107822276 >> v2:172.21.15.67:3300/0 conn(0x7f1f100714c0 0x7f1f1014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/1107822276 >> 172.21.15.40:0/1107822276 conn(0x7f1f100c0310 msgr2=0x7f1f100c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/1107822276 shutdown_connections 2023-05-24T04:01:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/1107822276 wait complete. 2023-05-24T04:01:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 Processor -- start 2023-05-24T04:01:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- start start 2023-05-24T04:01:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100714c0 0x7f1f101e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 0x7f1f10153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1014f250 0x7f1f10154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b6780 con 0x7f1f100c0e20 2023-05-24T04:01:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1014c790 con 0x7f1f1014f250 2023-05-24T04:01:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b5620 con 0x7f1f100714c0 2023-05-24T04:01:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 0x7f1f10153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 0x7f1f10153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45514/0 (socket says 172.21.15.40:45514) 2023-05-24T04:01:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 -- 172.21.15.40:0/2653778276 learned_addr learned my addr 172.21.15.40:0/2653778276 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f1525b640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100714c0 0x7f1f101e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f15a5c640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1014f250 0x7f1f10154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 -- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100714c0 msgr2=0x7f1f101e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100714c0 0x7f1f101e6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 -- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1014f250 msgr2=0x7f1f10154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1014f250 0x7f1f10154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 -- 172.21.15.40:0/2653778276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080094d0 con 0x7f1f100c0e20 2023-05-24T04:01:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f14a5a640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 0x7f1f10153d10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000c7f0 tx=0x7f1f0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00004220 con 0x7f1f100c0e20 2023-05-24T04:01:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f000043a0 con 0x7f1f100c0e20 2023-05-24T04:01:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f100a2e40 con 0x7f1f100c0e20 2023-05-24T04:01:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00004510 con 0x7f1f100c0e20 2023-05-24T04:01:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.245+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f10071890 con 0x7f1f100c0e20 2023-05-24T04:01:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.249+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f100a2fd0 con 0x7f1f100c0e20 2023-05-24T04:01:00.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.249+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f00003a70 con 0x7f1f100c0e20 2023-05-24T04:01:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.249+0000 7f1f05ffb640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef4066280 0x7f1ef4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.249+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f000841f0 con 0x7f1f100c0e20 2023-05-24T04:01:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.249+0000 7f1f1525b640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef4066280 0x7f1ef4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.249+0000 7f1f1525b640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef4066280 0x7f1ef4068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1f1014cac0 tx=0x7f1f0c008470 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.253+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1f000514b0 con 0x7f1f100c0e20 2023-05-24T04:01:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.401+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f100a2fd0 con 0x7f1f100c0e20 2023-05-24T04:01:00.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f05ffb640 1 -- 172.21.15.40:0/2653778276 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f100a2fd0 con 0x7f1f100c0e20 2023-05-24T04:01:00.409 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:01:00.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef4066280 msgr2=0x7f1ef4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef4066280 0x7f1ef4068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1f1014cac0 tx=0x7f1f0c008470 comp rx=0 tx=0).stop 2023-05-24T04:01:00.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 msgr2=0x7f1f10153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 0x7f1f10153d10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000c7f0 tx=0x7f1f0000ccb0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 shutdown_connections 2023-05-24T04:01:00.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1ef4066280 0x7f1ef4068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f1014f250 0x7f1f10154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f100c0e20 0x7f1f10153d10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 --2- 172.21.15.40:0/2653778276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f100714c0 0x7f1f101e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 >> 172.21.15.40:0/2653778276 conn(0x7f1f100c0310 msgr2=0x7f1f100bf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:00.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 shutdown_connections 2023-05-24T04:01:00.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.405+0000 7f1f174bf640 1 -- 172.21.15.40:0/2653778276 wait complete. 2023-05-24T04:01:00.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:01:00.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 Processor -- start 2023-05-24T04:01:00.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 -- start start 2023-05-24T04:01:00.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe270070ce0 0x7fe2700bef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe27006d350 0x7fe27014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe270150140 0x7fe27014b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700a6200 con 0x7fe270150140 2023-05-24T04:01:00.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700a5ef0 con 0x7fe270070ce0 2023-05-24T04:01:00.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe275488640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700a5930 con 0x7fe27006d350 2023-05-24T04:01:00.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe270150140 0x7fe27014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe270150140 0x7fe27014b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45530/0 (socket says 172.21.15.40:45530) 2023-05-24T04:01:00.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2240066265 learned_addr learned my addr 172.21.15.40:0/2240066265 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:00.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26e7fc640 1 --2- 172.21.15.40:0/2240066265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe27006d350 0x7fe27014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26effd640 1 --2- 172.21.15.40:0/2240066265 >> v2:172.21.15.67:3300/0 conn(0x7fe270070ce0 0x7fe2700bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2240066265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe27006d350 msgr2=0x7fe27014fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:00.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 --2- 172.21.15.40:0/2240066265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe27006d350 0x7fe27014fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2240066265 >> v2:172.21.15.67:3300/0 conn(0x7fe270070ce0 msgr2=0x7fe2700bef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:00.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 --2- 172.21.15.40:0/2240066265 >> v2:172.21.15.67:3300/0 conn(0x7fe270070ce0 0x7fe2700bef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2240066265 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700a5c10 con 0x7fe270150140 2023-05-24T04:01:00.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.553+0000 7fe26effd640 1 --2- 172.21.15.40:0/2240066265 >> v2:172.21.15.67:3300/0 conn(0x7fe270070ce0 0x7fe2700bef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 --2- 172.21.15.40:0/2240066265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe27014b830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe270071dc0 tx=0x7fe26801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d34b9ffaca7814 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26dffb640 1 -- 172.21.15.40:0/2240066265 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5760 con 0x7fe270150140 2023-05-24T04:01:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26dffb640 1 -- 172.21.15.40:0/2240066265 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680a58c0 con 0x7fe270150140 2023-05-24T04:01:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26dffb640 1 -- 172.21.15.40:0/2240066265 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5c50 con 0x7fe270150140 2023-05-24T04:01:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2240066265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 msgr2=0x7fe27014b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- 172.21.15.40:0/2240066265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe27014b830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe270071dc0 tx=0x7fe26801c9d0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2240066265 shutdown_connections 2023-05-24T04:01:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- 172.21.15.40:0/2240066265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe27014b830 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- 172.21.15.40:0/2240066265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe27006d350 0x7fe27014fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- 172.21.15.40:0/2240066265 >> v2:172.21.15.67:3300/0 conn(0x7fe270070ce0 0x7fe2700bef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2240066265 >> 172.21.15.40:0/2240066265 conn(0x7fe2700a4210 msgr2=0x7fe2700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2240066265 shutdown_connections 2023-05-24T04:01:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2240066265 wait complete. 2023-05-24T04:01:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 Processor -- start 2023-05-24T04:01:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- start start 2023-05-24T04:01:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe27006d350 0x7fe2701e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe270070ce0 0x7fe27014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe2701448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270143e10 con 0x7fe270150140 2023-05-24T04:01:00.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2701440f0 con 0x7fe27006d350 2023-05-24T04:01:00.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2701443d0 con 0x7fe270070ce0 2023-05-24T04:01:00.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe2701448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe2701448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45540/0 (socket says 172.21.15.40:45540) 2023-05-24T04:01:00.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2941875980 learned_addr learned my addr 172.21.15.40:0/2941875980 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:00.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26effd640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe27006d350 0x7fe2701e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26e7fc640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe270070ce0 0x7fe27014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe270070ce0 msgr2=0x7fe27014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe270070ce0 0x7fe27014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe27006d350 msgr2=0x7fe2701e3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe27006d350 0x7fe2701e3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 -- 172.21.15.40:0/2941875980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe268009b30 con 0x7fe270150140 2023-05-24T04:01:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26e7fc640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe270070ce0 0x7fe27014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26effd640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe27006d350 0x7fe2701e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe26f7fe640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe2701448f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe2680af040 tx=0x7fe2701507d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680be070 con 0x7fe270150140 2023-05-24T04:01:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680b8440 con 0x7fe270150140 2023-05-24T04:01:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270071240 con 0x7fe270150140 2023-05-24T04:01:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680b87f0 con 0x7fe270150140 2023-05-24T04:01:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.557+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2700710b0 con 0x7fe270150140 2023-05-24T04:01:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.561+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2700a7820 con 0x7fe270150140 2023-05-24T04:01:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.561+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2680b8950 con 0x7fe270150140 2023-05-24T04:01:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.561+0000 7fe2577fe640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe25c066280 0x7fe25c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.561+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe26811ea70 con 0x7fe270150140 2023-05-24T04:01:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.561+0000 7fe26effd640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe25c066280 0x7fe25c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.561+0000 7fe26effd640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe25c066280 0x7fe25c068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b840 tx=0x7fe260008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.565+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe2680ebbc0 con 0x7fe270150140 2023-05-24T04:01:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.713+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe270143f50 con 0x7fe270150140 2023-05-24T04:01:00.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.713+0000 7fe2577fe640 1 -- 172.21.15.40:0/2941875980 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe270143f50 con 0x7fe270150140 2023-05-24T04:01:00.720 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:00.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe25c066280 msgr2=0x7fe25c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe25c066280 0x7fe25c068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b840 tx=0x7fe260008040 comp rx=0 tx=0).stop 2023-05-24T04:01:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 msgr2=0x7fe2701448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe2701448f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe2680af040 tx=0x7fe2701507d0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 shutdown_connections 2023-05-24T04:01:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe25c066280 0x7fe25c068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe270150140 0x7fe2701448f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe270070ce0 0x7fe27014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 --2- 172.21.15.40:0/2941875980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe27006d350 0x7fe2701e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 >> 172.21.15.40:0/2941875980 conn(0x7fe2700a4210 msgr2=0x7fe27014c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 shutdown_connections 2023-05-24T04:01:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.717+0000 7fe275488640 1 -- 172.21.15.40:0/2941875980 wait complete. 2023-05-24T04:01:00.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:01:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 Processor -- start 2023-05-24T04:01:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 -- start start 2023-05-24T04:01:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e4070b20 0x7f68e406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68e406c000 0x7f68e4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e406ea20 con 0x7f68e414fa70 2023-05-24T04:01:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e4070460 con 0x7f68e406c000 2023-05-24T04:01:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68ea0d3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e406ec70 con 0x7f68e4070b20 2023-05-24T04:01:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f68e414fa70 0x7f68e406fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46088/0 (socket says 172.21.15.40:46088) 2023-05-24T04:01:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e37fe640 1 -- 172.21.15.40:0/1389564963 learned_addr learned my addr 172.21.15.40:0/1389564963 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e3fff640 1 --2- 172.21.15.40:0/1389564963 >> v2:172.21.15.40:3300/0 conn(0x7f68e406c000 0x7f68e4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e2ffd640 1 --2- 172.21.15.40:0/1389564963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e4070b20 0x7f68e406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e3fff640 1 -- 172.21.15.40:0/1389564963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e4070b20 msgr2=0x7f68e406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e3fff640 1 --2- 172.21.15.40:0/1389564963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e4070b20 0x7f68e406bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e3fff640 1 -- 172.21.15.40:0/1389564963 >> v1:172.21.15.40:6789/0 conn(0x7f68e414fa70 legacy=0x7f68e406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.853+0000 7f68e3fff640 1 -- 172.21.15.40:0/1389564963 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4150230 con 0x7f68e406c000 2023-05-24T04:01:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e3fff640 1 --2- 172.21.15.40:0/1389564963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e4145df0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009d90 tx=0x7f68dc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603d84094c5a7090 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e27fc640 1 -- 172.21.15.40:0/1389564963 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0a5810 con 0x7f68e406c000 2023-05-24T04:01:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e27fc640 1 -- 172.21.15.40:0/1389564963 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc0a5970 con 0x7f68e406c000 2023-05-24T04:01:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e27fc640 1 -- 172.21.15.40:0/1389564963 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0a5d00 con 0x7f68e406c000 2023-05-24T04:01:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/1389564963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 msgr2=0x7f68e4145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/1389564963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e4145df0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009d90 tx=0x7f68dc01c950 comp rx=0 tx=0).stop 2023-05-24T04:01:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/1389564963 shutdown_connections 2023-05-24T04:01:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/1389564963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e4145df0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/1389564963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e4070b20 0x7f68e406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/1389564963 >> 172.21.15.40:0/1389564963 conn(0x7f68e40c0280 msgr2=0x7f68e40c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/1389564963 shutdown_connections 2023-05-24T04:01:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/1389564963 wait complete. 2023-05-24T04:01:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 Processor -- start 2023-05-24T04:01:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- start start 2023-05-24T04:01:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e40bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68e4070b20 0x7f68e41e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e414fa70 0x7f68e40be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40a39c0 con 0x7f68e406c000 2023-05-24T04:01:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40be080 con 0x7f68e4070b20 2023-05-24T04:01:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40bf8a0 con 0x7f68e414fa70 2023-05-24T04:01:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e40bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e40bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45564/0 (socket says 172.21.15.40:45564) 2023-05-24T04:01:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 -- 172.21.15.40:0/2195783141 learned_addr learned my addr 172.21.15.40:0/2195783141 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e3fff640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e414fa70 0x7f68e40be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e2ffd640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68e4070b20 0x7f68e41e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 -- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e414fa70 msgr2=0x7f68e40be4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e414fa70 0x7f68e40be4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 -- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68e4070b20 msgr2=0x7f68e41e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68e4070b20 0x7f68e41e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 -- 172.21.15.40:0/2195783141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc009a70 con 0x7f68e406c000 2023-05-24T04:01:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e2ffd640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68e4070b20 0x7f68e41e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e3fff640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e414fa70 0x7f68e40be4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68e37fe640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e40bf360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68d400c400 tx=0x7f68d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4005cf0 con 0x7f68e406c000 2023-05-24T04:01:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4005e50 con 0x7f68e406c000 2023-05-24T04:01:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e414ffd0 con 0x7f68e406c000 2023-05-24T04:01:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40072d0 con 0x7f68e406c000 2023-05-24T04:01:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.857+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e414fe40 con 0x7f68e406c000 2023-05-24T04:01:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.861+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e41593c0 con 0x7f68e406c000 2023-05-24T04:01:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.861+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68d4007430 con 0x7f68e406c000 2023-05-24T04:01:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.861+0000 7f68cbfff640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f68d0066280 0x7f68d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.861+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f68d4083490 con 0x7f68e406c000 2023-05-24T04:01:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.861+0000 7f68e2ffd640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f68d0066280 0x7f68d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.861+0000 7f68e2ffd640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f68d0066280 0x7f68d0068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f68e41461f0 tx=0x7f68d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:00.865+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f68d4050720 con 0x7f68e406c000 2023-05-24T04:01:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.025+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f68e40be1f0 con 0x7f68e406c000 2023-05-24T04:01:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68cbfff640 1 -- 172.21.15.40:0/2195783141 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f68d4053d40 con 0x7f68e406c000 2023-05-24T04:01:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:01:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f68d0066280 msgr2=0x7f68d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f68d0066280 0x7f68d0068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f68e41461f0 tx=0x7f68d8008040 comp rx=0 tx=0).stop 2023-05-24T04:01:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 msgr2=0x7f68e40bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e40bf360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68d400c400 tx=0x7f68d400c8c0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 shutdown_connections 2023-05-24T04:01:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f68d0066280 0x7f68d0068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68e414fa70 0x7f68e40be4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68e4070b20 0x7f68e41e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 --2- 172.21.15.40:0/2195783141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e406c000 0x7f68e40bf360 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 >> 172.21.15.40:0/2195783141 conn(0x7f68e40c0280 msgr2=0x7f68e413d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 shutdown_connections 2023-05-24T04:01:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.029+0000 7f68ea0d3640 1 -- 172.21.15.40:0/2195783141 wait complete. 2023-05-24T04:01:01.051 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-05-24T04:01:01.051 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:01:01.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:01:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f836972a640 1 Processor -- start 2023-05-24T04:01:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f836972a640 1 -- start start 2023-05-24T04:01:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f836972a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8364156c10 0x7f836406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f836972a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8364153ad0 con 0x7f83641523c0 2023-05-24T04:01:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f836972a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8364152790 con 0x7f83640a37c0 2023-05-24T04:01:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f836972a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83640a4ae0 con 0x7f8364156c10 2023-05-24T04:01:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8364156c10 0x7f836406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8364156c10 0x7f836406bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45578/0 (socket says 172.21.15.40:45578) 2023-05-24T04:01:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 -- 172.21.15.40:0/2390939191 learned_addr learned my addr 172.21.15.40:0/2390939191 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 -- 172.21.15.40:0/2390939191 >> v1:172.21.15.67:6789/0 conn(0x7f83640a37c0 legacy=0x7f83641533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 -- 172.21.15.40:0/2390939191 >> v1:172.21.15.40:6789/0 conn(0x7f83641523c0 legacy=0x7f83640a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 -- 172.21.15.40:0/2390939191 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640a1670 con 0x7f8364156c10 2023-05-24T04:01:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f83627fc640 1 --2- 172.21.15.40:0/2390939191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8364156c10 0x7f836406bac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8358009870 tx=0x7f835801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244afc7f5ce2a23c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f8361ffb640 1 -- 172.21.15.40:0/2390939191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580ab660 con 0x7f8364156c10 2023-05-24T04:01:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f8361ffb640 1 -- 172.21.15.40:0/2390939191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83580ab7c0 con 0x7f8364156c10 2023-05-24T04:01:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.173+0000 7f8361ffb640 1 -- 172.21.15.40:0/2390939191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580abb50 con 0x7f8364156c10 2023-05-24T04:01:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2390939191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8364156c10 msgr2=0x7f836406bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 --2- 172.21.15.40:0/2390939191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8364156c10 0x7f836406bac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8358009870 tx=0x7f835801c440 comp rx=0 tx=0).stop 2023-05-24T04:01:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2390939191 shutdown_connections 2023-05-24T04:01:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 --2- 172.21.15.40:0/2390939191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8364156c10 0x7f836406bac0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2390939191 >> 172.21.15.40:0/2390939191 conn(0x7f83640c0280 msgr2=0x7f83640c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2390939191 shutdown_connections 2023-05-24T04:01:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2390939191 wait complete. 2023-05-24T04:01:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 Processor -- start 2023-05-24T04:01:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- start start 2023-05-24T04:01:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 0x7f8364147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83641523c0 0x7f83641ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8364156c10 0x7f8364153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836406f0f0 con 0x7f83640a37c0 2023-05-24T04:01:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836406f270 con 0x7f83641523c0 2023-05-24T04:01:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8364147fa0 con 0x7f8364156c10 2023-05-24T04:01:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 0x7f8364147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 0x7f8364147a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45592/0 (socket says 172.21.15.40:45592) 2023-05-24T04:01:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 -- 172.21.15.40:0/2690961175 learned_addr learned my addr 172.21.15.40:0/2690961175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f83627fc640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83641523c0 0x7f83641ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 -- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8364156c10 msgr2=0x7f8364153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8364156c10 0x7f8364153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 -- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83641523c0 msgr2=0x7f83641ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83641523c0 0x7f83641ebbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 -- 172.21.15.40:0/2690961175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580094d0 con 0x7f83640a37c0 2023-05-24T04:01:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f8362ffd640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 0x7f8364147a60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f835400c820 tx=0x7f835400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354003b80 con 0x7f83640a37c0 2023-05-24T04:01:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354003ce0 con 0x7f83640a37c0 2023-05-24T04:01:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400aa90 con 0x7f83640a37c0 2023-05-24T04:01:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8364160c00 con 0x7f83640a37c0 2023-05-24T04:01:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8364160a70 con 0x7f83640a37c0 2023-05-24T04:01:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.177+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364160d90 con 0x7f83640a37c0 2023-05-24T04:01:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.181+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f835400abf0 con 0x7f83640a37c0 2023-05-24T04:01:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.181+0000 7f834b7fe640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8350066280 0x7f8350068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.181+0000 7f83627fc640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8350066280 0x7f8350068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.181+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8354084170 con 0x7f83640a37c0 2023-05-24T04:01:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.181+0000 7f83627fc640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8350066280 0x7f8350068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f83580af000 tx=0x7f83580a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.185+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8354051190 con 0x7f83640a37c0 2023-05-24T04:01:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.337+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f836404ddd0 con 0x7f83640a37c0 2023-05-24T04:01:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f834b7fe640 1 -- 172.21.15.40:0/2690961175 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7f83540547b0 con 0x7f83640a37c0 2023-05-24T04:01:01.346 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:01.347 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:01:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8350066280 msgr2=0x7f8350068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8350066280 0x7f8350068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f83580af000 tx=0x7f83580a7000 comp rx=0 tx=0).stop 2023-05-24T04:01:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 msgr2=0x7f8364147a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 0x7f8364147a60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f835400c820 tx=0x7f835400cce0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 shutdown_connections 2023-05-24T04:01:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f8350066280 0x7f8350068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8364156c10 0x7f8364153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83641523c0 0x7f83641ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 --2- 172.21.15.40:0/2690961175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83640a37c0 0x7f8364147a60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 >> 172.21.15.40:0/2690961175 conn(0x7f83640c0280 msgr2=0x7f83640c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 shutdown_connections 2023-05-24T04:01:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.341+0000 7f836972a640 1 -- 172.21.15.40:0/2690961175 wait complete. 2023-05-24T04:01:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:01:01.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:01:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff112a72640 1 Processor -- start 2023-05-24T04:01:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff112a72640 1 -- start start 2023-05-24T04:01:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff112a72640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff10c0a6370 0x7ff10c144c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff112a72640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0710b0 con 0x7ff10c06f130 2023-05-24T04:01:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff112a72640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0bae50 con 0x7ff10c1451b0 2023-05-24T04:01:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff112a72640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c06fc50 con 0x7ff10c0a6370 2023-05-24T04:01:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff11100f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff10c06f130 0x7ff10c152210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46102/0 (socket says 172.21.15.40:46102) 2023-05-24T04:01:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff11100f640 1 -- 172.21.15.40:0/505016034 learned_addr learned my addr 172.21.15.40:0/505016034 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff11080e640 1 --2- 172.21.15.40:0/505016034 >> v2:172.21.15.67:3300/0 conn(0x7ff10c0a6370 0x7ff10c144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307181336 0 0) 0x7ff10c0bae50 con 0x7ff10c1451b0 2023-05-24T04:01:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f4003530 con 0x7ff10c1451b0 2023-05-24T04:01:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408581432 0 0) 0x7ff10c0710b0 con 0x7ff10c06f130 2023-05-24T04:01:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff10c0bae50 con 0x7ff10c06f130 2023-05-24T04:01:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff11080e640 1 -- 172.21.15.40:0/505016034 >> v1:172.21.15.67:6789/0 conn(0x7ff10c1451b0 legacy=0x7ff10c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff11080e640 1 -- 172.21.15.40:0/505016034 >> v1:172.21.15.40:6789/0 conn(0x7ff10c06f130 legacy=0x7ff10c152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.485+0000 7ff11080e640 1 -- 172.21.15.40:0/505016034 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c152920 con 0x7ff10c0a6370 2023-05-24T04:01:01.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff11080e640 1 --2- 172.21.15.40:0/505016034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c144c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097c0 tx=0x7ff0fc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f0a9839c515075 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ab600 con 0x7ff10c0a6370 2023-05-24T04:01:01.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0a7050 con 0x7ff10c0a6370 2023-05-24T04:01:01.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff10b7fe640 1 -- 172.21.15.40:0/505016034 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ab960 con 0x7ff10c0a6370 2023-05-24T04:01:01.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- 172.21.15.40:0/505016034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 msgr2=0x7ff10c144c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 --2- 172.21.15.40:0/505016034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c144c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097c0 tx=0x7ff0fc01c3f0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- 172.21.15.40:0/505016034 shutdown_connections 2023-05-24T04:01:01.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 --2- 172.21.15.40:0/505016034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c144c70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- 172.21.15.40:0/505016034 >> 172.21.15.40:0/505016034 conn(0x7ff10c0c0c40 msgr2=0x7ff10c0c1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- 172.21.15.40:0/505016034 shutdown_connections 2023-05-24T04:01:01.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- 172.21.15.40:0/505016034 wait complete. 2023-05-24T04:01:01.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 Processor -- start 2023-05-24T04:01:01.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- start start 2023-05-24T04:01:01.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 0x7ff10c0bc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff10c1451b0 0x7ff10c140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c14abf0 con 0x7ff10c06f130 2023-05-24T04:01:01.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c140da0 con 0x7ff10c0a6370 2023-05-24T04:01:01.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff112a72640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c14a630 con 0x7ff10c1451b0 2023-05-24T04:01:01.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff11080e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 0x7ff10c0bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff11080e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 0x7ff10c0bc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45608/0 (socket says 172.21.15.40:45608) 2023-05-24T04:01:01.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff11080e640 1 -- 172.21.15.40:0/1707229327 learned_addr learned my addr 172.21.15.40:0/1707229327 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:01.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11100f640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff10c1451b0 0x7ff10c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.489+0000 7ff10bfff640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11080e640 1 -- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff10c1451b0 msgr2=0x7ff10c140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11080e640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff10c1451b0 0x7ff10c140860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11080e640 1 -- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 msgr2=0x7ff10c140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11080e640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11080e640 1 -- 172.21.15.40:0/1707229327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc009420 con 0x7ff10c06f130 2023-05-24T04:01:01.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff10bfff640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:01.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff11080e640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 0x7ff10c0bc520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c10 tx=0x7ff0fc019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc003ab0 con 0x7ff10c06f130 2023-05-24T04:01:01.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc003c10 con 0x7ff10c06f130 2023-05-24T04:01:01.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c14f020 con 0x7ff10c06f130 2023-05-24T04:01:01.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ab400 con 0x7ff10c06f130 2023-05-24T04:01:01.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c14ee90 con 0x7ff10c06f130 2023-05-24T04:01:01.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c0a6740 con 0x7ff10c06f130 2023-05-24T04:01:01.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0fc0b2040 con 0x7ff10c06f130 2023-05-24T04:01:01.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff1097fa640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff0f8066280 0x7ff0f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff0fc11ded0 con 0x7ff10c06f130 2023-05-24T04:01:01.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff10bfff640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff0f8066280 0x7ff0f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.493+0000 7ff10bfff640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff0f8066280 0x7ff0f8068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff10c14b160 tx=0x7ff100009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.497+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff0fc0eb0b0 con 0x7ff10c06f130 2023-05-24T04:01:01.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.645+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff10c04ddd0 con 0x7ff10c06f130 2023-05-24T04:01:01.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff1097fa640 1 -- 172.21.15.40:0/1707229327 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0fc0ee6d0 con 0x7ff10c06f130 2023-05-24T04:01:01.654 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:01:01.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff0f8066280 msgr2=0x7ff0f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff0f8066280 0x7ff0f8068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff10c14b160 tx=0x7ff100009040 comp rx=0 tx=0).stop 2023-05-24T04:01:01.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 msgr2=0x7ff10c0bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 0x7ff10c0bc520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c10 tx=0x7ff0fc019190 comp rx=0 tx=0).stop 2023-05-24T04:01:01.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 shutdown_connections 2023-05-24T04:01:01.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff0f8066280 0x7ff0f8068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff10c1451b0 0x7ff10c140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff10c0a6370 0x7ff10c140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 --2- 172.21.15.40:0/1707229327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff10c06f130 0x7ff10c0bc520 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 >> 172.21.15.40:0/1707229327 conn(0x7ff10c0c0c40 msgr2=0x7ff10c151ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 shutdown_connections 2023-05-24T04:01:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.649+0000 7ff112a72640 1 -- 172.21.15.40:0/1707229327 wait complete. 2023-05-24T04:01:01.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:01:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.793+0000 7ff88cba4640 1 Processor -- start 2023-05-24T04:01:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.793+0000 7ff88cba4640 1 -- start start 2023-05-24T04:01:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88cba4640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff88814c1b0 0x7ff888070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88cba4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff888070fe0 0x7ff88806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88cba4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880be160 con 0x7ff8880bd4f0 2023-05-24T04:01:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88cba4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880be8c0 con 0x7ff888070fe0 2023-05-24T04:01:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88cba4640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880a7ea0 con 0x7ff88814c1b0 2023-05-24T04:01:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff888070fe0 0x7ff88806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff888070fe0 0x7ff88806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39686/0 (socket says 172.21.15.40:39686) 2023-05-24T04:01:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 -- 172.21.15.40:0/3052224908 learned_addr learned my addr 172.21.15.40:0/3052224908 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88659c640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff88814c1b0 0x7ff888070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 -- 172.21.15.40:0/3052224908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff88814c1b0 msgr2=0x7ff888070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff88814c1b0 0x7ff888070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 -- 172.21.15.40:0/3052224908 >> v1:172.21.15.67:6789/0 conn(0x7ff8880bd4f0 legacy=0x7ff88806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff886d9d640 1 -- 172.21.15.40:0/3052224908 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88814c580 con 0x7ff888070fe0 2023-05-24T04:01:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.797+0000 7ff88659c640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff88814c1b0 0x7ff888070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff888070fe0 0x7ff88806e5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dc08f1682ed785 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff885d9b640 1 -- 172.21.15.40:0/3052224908 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800a5830 con 0x7ff888070fe0 2023-05-24T04:01:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff885d9b640 1 -- 172.21.15.40:0/3052224908 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8800a5990 con 0x7ff888070fe0 2023-05-24T04:01:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff885d9b640 1 -- 172.21.15.40:0/3052224908 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800a5d20 con 0x7ff888070fe0 2023-05-24T04:01:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- 172.21.15.40:0/3052224908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff888070fe0 msgr2=0x7ff88806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff888070fe0 0x7ff88806e5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88001c950 comp rx=0 tx=0).stop 2023-05-24T04:01:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- 172.21.15.40:0/3052224908 shutdown_connections 2023-05-24T04:01:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff888070fe0 0x7ff88806e5f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 --2- 172.21.15.40:0/3052224908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff88814c1b0 0x7ff888070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- 172.21.15.40:0/3052224908 >> 172.21.15.40:0/3052224908 conn(0x7ff8880c2540 msgr2=0x7ff8880c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- 172.21.15.40:0/3052224908 shutdown_connections 2023-05-24T04:01:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- 172.21.15.40:0/3052224908 wait complete. 2023-05-24T04:01:01.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 Processor -- start 2023-05-24T04:01:01.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- start start 2023-05-24T04:01:01.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff888070fe0 0x7ff8880bb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88814c1b0 0x7ff888150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 0x7ff8881e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880bc180 con 0x7ff8880b5fe0 2023-05-24T04:01:01.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880baea0 con 0x7ff88814c1b0 2023-05-24T04:01:01.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88cba4640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880bb180 con 0x7ff888070fe0 2023-05-24T04:01:01.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 0x7ff8881e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 0x7ff8881e50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39688/0 (socket says 172.21.15.40:39688) 2023-05-24T04:01:01.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 -- 172.21.15.40:0/1571546574 learned_addr learned my addr 172.21.15.40:0/1571546574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:01.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff88659c640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff888070fe0 0x7ff8880bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff87ffff640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88814c1b0 0x7ff888150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 -- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff888070fe0 msgr2=0x7ff8880bb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff888070fe0 0x7ff8880bb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 -- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88814c1b0 msgr2=0x7ff888150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88814c1b0 0x7ff888150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 -- 172.21.15.40:0/1571546574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009b30 con 0x7ff8880b5fe0 2023-05-24T04:01:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff886d9d640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 0x7ff8881e50d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8800af040 tx=0x7ff8800196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800b8670 con 0x7ff8880b5fe0 2023-05-24T04:01:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8800b8810 con 0x7ff8880b5fe0 2023-05-24T04:01:01.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.801+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800b8bc0 con 0x7ff8880b5fe0 2023-05-24T04:01:01.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8880a55a0 con 0x7ff8880b5fe0 2023-05-24T04:01:01.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8880a83f0 con 0x7ff8880b5fe0 2023-05-24T04:01:01.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8880a5730 con 0x7ff8880b5fe0 2023-05-24T04:01:01.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8800b8d20 con 0x7ff8880b5fe0 2023-05-24T04:01:01.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff87effd640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff8680662b0 0x7ff868068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:01.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff88011f210 con 0x7ff8880b5fe0 2023-05-24T04:01:01.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff88659c640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff8680662b0 0x7ff868068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:01.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.805+0000 7ff88659c640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff8680662b0 0x7ff868068760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff87800ba10 tx=0x7ff878008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:01.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.809+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff8880a5730 con 0x7ff8880b5fe0 2023-05-24T04:01:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff8880a5730 con 0x7ff8880b5fe0 2023-05-24T04:01:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff87effd640 1 -- 172.21.15.40:0/1571546574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff8880a5730 con 0x7ff8880b5fe0 2023-05-24T04:01:01.971 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:01:01.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff8680662b0 msgr2=0x7ff868068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff8680662b0 0x7ff868068760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff87800ba10 tx=0x7ff878008040 comp rx=0 tx=0).stop 2023-05-24T04:01:01.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 msgr2=0x7ff8881e50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:01.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 0x7ff8881e50d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8800af040 tx=0x7ff8800196f0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 shutdown_connections 2023-05-24T04:01:01.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff8680662b0 0x7ff868068760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8880b5fe0 0x7ff8881e50d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88814c1b0 0x7ff888150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 --2- 172.21.15.40:0/1571546574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff888070fe0 0x7ff8880bb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:01.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 >> 172.21.15.40:0/1571546574 conn(0x7ff8880c2540 msgr2=0x7ff8880c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:01.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.965+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 shutdown_connections 2023-05-24T04:01:01.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:01.969+0000 7ff88cba4640 1 -- 172.21.15.40:0/1571546574 wait complete. 2023-05-24T04:01:01.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:01:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 Processor -- start 2023-05-24T04:01:02.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 -- start start 2023-05-24T04:01:02.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f696814bc80 0x7f69680a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6968071220 0x7f6968071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6968070ab0 con 0x7f69680bcd20 2023-05-24T04:01:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69680a5040 con 0x7f6968071220 2023-05-24T04:01:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f696de24640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696814d0f0 con 0x7f696814bc80 2023-05-24T04:01:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6968071220 0x7f6968071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6968071220 0x7f6968071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39700/0 (socket says 172.21.15.40:39700) 2023-05-24T04:01:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 -- 172.21.15.40:0/1963774161 learned_addr learned my addr 172.21.15.40:0/1963774161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f69677fe640 1 --2- 172.21.15.40:0/1963774161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f696814bc80 0x7f69680a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 -- 172.21.15.40:0/1963774161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f696814bc80 msgr2=0x7f69680a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 --2- 172.21.15.40:0/1963774161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f696814bc80 0x7f69680a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 -- 172.21.15.40:0/1963774161 >> v1:172.21.15.67:6789/0 conn(0x7f69680bcd20 legacy=0x7f69680bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.101+0000 7f6966ffd640 1 -- 172.21.15.40:0/1963774161 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968070d00 con 0x7f6968071220 2023-05-24T04:01:02.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f6966ffd640 1 --2- 172.21.15.40:0/1963774161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f6968071670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf1573d696e03f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69667fc640 1 -- 172.21.15.40:0/1963774161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0ac620 con 0x7f6968071220 2023-05-24T04:01:02.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69667fc640 1 -- 172.21.15.40:0/1963774161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0ac780 con 0x7f6968071220 2023-05-24T04:01:02.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69667fc640 1 -- 172.21.15.40:0/1963774161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0acb10 con 0x7f6968071220 2023-05-24T04:01:02.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/1963774161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 msgr2=0x7f6968071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 --2- 172.21.15.40:0/1963774161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f6968071670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c01c3e0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/1963774161 shutdown_connections 2023-05-24T04:01:02.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 --2- 172.21.15.40:0/1963774161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f6968071670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 --2- 172.21.15.40:0/1963774161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f696814bc80 0x7f69680a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/1963774161 >> 172.21.15.40:0/1963774161 conn(0x7f69680c0310 msgr2=0x7f69680c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/1963774161 shutdown_connections 2023-05-24T04:01:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/1963774161 wait complete. 2023-05-24T04:01:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 Processor -- start 2023-05-24T04:01:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- start start 2023-05-24T04:01:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f696813cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69680bcd20 0x7f6968154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696814bc80 0x7f69681ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696814a510 con 0x7f6968071220 2023-05-24T04:01:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696813d4b0 con 0x7f696814bc80 2023-05-24T04:01:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69681554b0 con 0x7f69680bcd20 2023-05-24T04:01:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f696813cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f696813cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39702/0 (socket says 172.21.15.40:39702) 2023-05-24T04:01:02.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 -- 172.21.15.40:0/133598274 learned_addr learned my addr 172.21.15.40:0/133598274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:02.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f6967fff640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696814bc80 0x7f69681ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f6966ffd640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69680bcd20 0x7f6968154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 -- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69680bcd20 msgr2=0x7f6968154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69680bcd20 0x7f6968154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 -- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696814bc80 msgr2=0x7f69681ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696814bc80 0x7f69681ea0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 -- 172.21.15.40:0/133598274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0094d0 con 0x7f6968071220 2023-05-24T04:01:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f6966ffd640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69680bcd20 0x7f6968154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f69677fe640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f696813cf70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f695800d5f0 tx=0x7f695800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69580125f0 con 0x7f6968071220 2023-05-24T04:01:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6958012750 con 0x7f6968071220 2023-05-24T04:01:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696814cd50 con 0x7f6968071220 2023-05-24T04:01:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958012ae0 con 0x7f6968071220 2023-05-24T04:01:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.105+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696814c050 con 0x7f6968071220 2023-05-24T04:01:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.109+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69680bd8b0 con 0x7f6968071220 2023-05-24T04:01:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.109+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6958012c40 con 0x7f6968071220 2023-05-24T04:01:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.109+0000 7f694ffff640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f69540662b0 0x7f6954068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.109+0000 7f6966ffd640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f69540662b0 0x7f6954068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.109+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6958084530 con 0x7f6968071220 2023-05-24T04:01:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.109+0000 7f6966ffd640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f69540662b0 0x7f6954068760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ae000 tx=0x7f695c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.113+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6958051680 con 0x7f6968071220 2023-05-24T04:01:02.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.257+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69680bcb90 con 0x7f6968071220 2023-05-24T04:01:02.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.257+0000 7f694ffff640 1 -- 172.21.15.40:0/133598274 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6958054ca0 con 0x7f6968071220 2023-05-24T04:01:02.265 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f69540662b0 msgr2=0x7f6954068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f69540662b0 0x7f6954068760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ae000 tx=0x7f695c008040 comp rx=0 tx=0).stop 2023-05-24T04:01:02.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 msgr2=0x7f696813cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f696813cf70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f695800d5f0 tx=0x7f695800dab0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 shutdown_connections 2023-05-24T04:01:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f69540662b0 0x7f6954068760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f696814bc80 0x7f69681ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69680bcd20 0x7f6968154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 --2- 172.21.15.40:0/133598274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6968071220 0x7f696813cf70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 >> 172.21.15.40:0/133598274 conn(0x7f69680c0310 msgr2=0x7f6968149d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 shutdown_connections 2023-05-24T04:01:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.261+0000 7f696de24640 1 -- 172.21.15.40:0/133598274 wait complete. 2023-05-24T04:01:02.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:01:02.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f59044f1640 1 Processor -- start 2023-05-24T04:01:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f59044f1640 1 -- start start 2023-05-24T04:01:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f59044f1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 0x7f58fc0a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f59044f1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc14f730 con 0x7f58fc0a4860 2023-05-24T04:01:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f59044f1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc06eb50 con 0x7f58fc152140 2023-05-24T04:01:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f59044f1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc06f030 con 0x7f58fc151d70 2023-05-24T04:01:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f58fc0a4860 0x7f58fc071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36980/0 (socket says 172.21.15.40:36980) 2023-05-24T04:01:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 -- 172.21.15.40:0/1695054819 learned_addr learned my addr 172.21.15.40:0/1695054819 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590228d640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 0x7f58fc0a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149838180 0 0) 0x7f58fc14f730 con 0x7f58fc0a4860 2023-05-24T04:01:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e8003530 con 0x7f58fc0a4860 2023-05-24T04:01:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3484213535 0 0) 0x7f58e8003530 con 0x7f58fc0a4860 2023-05-24T04:01:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 msgr2=0x7f58fc0a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 0x7f58fc0a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 >> v1:172.21.15.67:6789/0 conn(0x7f58fc152140 legacy=0x7f58fc14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc1526a0 con 0x7f58fc0a4860 2023-05-24T04:01:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f58f4001680 con 0x7f58fc0a4860 2023-05-24T04:01:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 >> v1:172.21.15.40:6789/0 conn(0x7f58fc0a4860 legacy=0x7f58fc071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 0x7f58e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e8003f30 0x7f58e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e8004d10 0x7f58e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc06f030 con 0x7f58e8004d10 2023-05-24T04:01:02.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e800bba0 con 0x7f58e8003f30 2023-05-24T04:01:02.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e800bd60 con 0x7f58fc151d70 2023-05-24T04:01:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e8004d10 0x7f58e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f590228d640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 0x7f58e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 -- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 msgr2=0x7f58e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc151d70 0x7f58e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 -- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e8003f30 msgr2=0x7f58e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e8003f30 0x7f58e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.393+0000 7f5902a8e640 1 -- 172.21.15.40:0/1695054819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8003530 con 0x7f58e8004d10 2023-05-24T04:01:02.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e8004d10 0x7f58e8005180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58f401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cf29354df8b57a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40058e0 con 0x7f58e8004d10 2023-05-24T04:01:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4005a40 con 0x7f58e8004d10 2023-05-24T04:01:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f590128b640 1 -- 172.21.15.40:0/1695054819 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4005e70 con 0x7f58e8004d10 2023-05-24T04:01:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- 172.21.15.40:0/1695054819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e8004d10 msgr2=0x7f58e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 --2- 172.21.15.40:0/1695054819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e8004d10 0x7f58e8005180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58f401cc00 comp rx=0 tx=0).stop 2023-05-24T04:01:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 -- 172.21.15.40:0/1695054819 reap_dead start 2023-05-24T04:01:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- 172.21.15.40:0/1695054819 shutdown_connections 2023-05-24T04:01:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- 172.21.15.40:0/1695054819 >> 172.21.15.40:0/1695054819 conn(0x7f58fc0c0310 msgr2=0x7f58fc0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- 172.21.15.40:0/1695054819 shutdown_connections 2023-05-24T04:01:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- 172.21.15.40:0/1695054819 wait complete. 2023-05-24T04:01:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 Processor -- start 2023-05-24T04:01:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- start start 2023-05-24T04:01:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc1504c0 0x7f58fc0b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58fc150890 0x7f58fc0b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 0x7f58fc145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0bc540 con 0x7f58fc145220 2023-05-24T04:01:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc150d00 con 0x7f58fc150890 2023-05-24T04:01:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f59044f1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1463d0 con 0x7f58fc1504c0 2023-05-24T04:01:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 0x7f58fc145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 0x7f58fc145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39726/0 (socket says 172.21.15.40:39726) 2023-05-24T04:01:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 -- 172.21.15.40:0/3398420397 learned_addr learned my addr 172.21.15.40:0/3398420397 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:02.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f590228d640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc1504c0 0x7f58fc0b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 -- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc1504c0 msgr2=0x7f58fc0b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5901a8c640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58fc150890 0x7f58fc0b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc1504c0 0x7f58fc0b9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 -- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58fc150890 msgr2=0x7f58fc0b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58fc150890 0x7f58fc0b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 -- 172.21.15.40:0/3398420397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc071c80 con 0x7f58fc145220 2023-05-24T04:01:02.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.397+0000 7f5902a8e640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 0x7f58fc145690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58f401c670 tx=0x7f58e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4001480 con 0x7f58fc145220 2023-05-24T04:01:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40015e0 con 0x7f58fc145220 2023-05-24T04:01:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0a5230 con 0x7f58fc145220 2023-05-24T04:01:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40a5ac0 con 0x7f58fc145220 2023-05-24T04:01:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc071e10 con 0x7f58fc145220 2023-05-24T04:01:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc146590 con 0x7f58fc145220 2023-05-24T04:01:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58f40b4020 con 0x7f58fc145220 2023-05-24T04:01:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f58f2ffd640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f58e0066280 0x7f58e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f590228d640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f58e0066280 0x7f58e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f58f411cbe0 con 0x7f58fc145220 2023-05-24T04:01:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.401+0000 7f590228d640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f58e0066280 0x7f58e0068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58fc14a530 tx=0x7f58ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.405+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f58f40e9ca0 con 0x7f58fc145220 2023-05-24T04:01:02.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.557+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58fc04ddd0 con 0x7f58fc145220 2023-05-24T04:01:02.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.557+0000 7f58f2ffd640 1 -- 172.21.15.40:0/3398420397 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58f4007cf0 con 0x7f58fc145220 2023-05-24T04:01:02.563 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:01:02.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f58e0066280 msgr2=0x7f58e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f58e0066280 0x7f58e0068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58fc14a530 tx=0x7f58ec008040 comp rx=0 tx=0).stop 2023-05-24T04:01:02.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 msgr2=0x7f58fc145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 0x7f58fc145690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58f401c670 tx=0x7f58e8005800 comp rx=0 tx=0).stop 2023-05-24T04:01:02.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 shutdown_connections 2023-05-24T04:01:02.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f58e0066280 0x7f58e0068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58fc145220 0x7f58fc145690 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58fc150890 0x7f58fc0b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 --2- 172.21.15.40:0/3398420397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58fc1504c0 0x7f58fc0b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 >> 172.21.15.40:0/3398420397 conn(0x7f58fc0c0310 msgr2=0x7f58fc070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 shutdown_connections 2023-05-24T04:01:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.561+0000 7f59044f1640 1 -- 172.21.15.40:0/3398420397 wait complete. 2023-05-24T04:01:02.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:01:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa38a162640 1 Processor -- start 2023-05-24T04:01:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa38a162640 1 -- start start 2023-05-24T04:01:02.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa38a162640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa384152140 0x7fa3840a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa38a162640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38414f730 con 0x7fa384151d70 2023-05-24T04:01:02.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa38a162640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38406eb50 con 0x7fa3840a4860 2023-05-24T04:01:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa38a162640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38406f030 con 0x7fa384152140 2023-05-24T04:01:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa382ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa384152140 0x7fa3840a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa3837fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa384151d70 0x7fa38414f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36986/0 (socket says 172.21.15.40:36986) 2023-05-24T04:01:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa382ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa384152140 0x7fa3840a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39732/0 (socket says 172.21.15.40:39732) 2023-05-24T04:01:02.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa3837fe640 1 -- 172.21.15.40:0/3354803994 learned_addr learned my addr 172.21.15.40:0/3354803994 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:02.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa382ffd640 1 -- 172.21.15.40:0/3354803994 >> v1:172.21.15.67:6789/0 conn(0x7fa3840a4860 legacy=0x7fa384071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:02.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa382ffd640 1 -- 172.21.15.40:0/3354803994 >> v1:172.21.15.40:6789/0 conn(0x7fa384151d70 legacy=0x7fa38414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa382ffd640 1 -- 172.21.15.40:0/3354803994 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3841526a0 con 0x7fa384152140 2023-05-24T04:01:02.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.701+0000 7fa3827fc640 1 -- 172.21.15.40:0/3354803994 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604084756 0 0) 0x7fa38414f730 con 0x7fa384151d70 2023-05-24T04:01:02.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa382ffd640 1 --2- 172.21.15.40:0/3354803994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384152140 0x7fa3840a33a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097c0 tx=0x7fa37801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e82d38a4425a8c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3827fc640 1 -- 172.21.15.40:0/3354803994 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780ab600 con 0x7fa384152140 2023-05-24T04:01:02.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3827fc640 1 -- 172.21.15.40:0/3354803994 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780a7050 con 0x7fa384152140 2023-05-24T04:01:02.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3827fc640 1 -- 172.21.15.40:0/3354803994 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780ab980 con 0x7fa384152140 2023-05-24T04:01:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- 172.21.15.40:0/3354803994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384152140 msgr2=0x7fa3840a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 --2- 172.21.15.40:0/3354803994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384152140 0x7fa3840a33a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097c0 tx=0x7fa37801c3f0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- 172.21.15.40:0/3354803994 shutdown_connections 2023-05-24T04:01:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 --2- 172.21.15.40:0/3354803994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384152140 0x7fa3840a33a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- 172.21.15.40:0/3354803994 >> 172.21.15.40:0/3354803994 conn(0x7fa3840c0310 msgr2=0x7fa3840c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- 172.21.15.40:0/3354803994 shutdown_connections 2023-05-24T04:01:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- 172.21.15.40:0/3354803994 wait complete. 2023-05-24T04:01:02.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 Processor -- start 2023-05-24T04:01:02.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- start start 2023-05-24T04:01:02.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 0x7fa3841406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa384151d70 0x7fa38413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa384152140 0x7fa38413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38413eff0 con 0x7fa3840a4860 2023-05-24T04:01:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841414e0 con 0x7fa384151d70 2023-05-24T04:01:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa38a162640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa384143ca0 con 0x7fa384152140 2023-05-24T04:01:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 0x7fa3841406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 0x7fa3841406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39736/0 (socket says 172.21.15.40:39736) 2023-05-24T04:01:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 -- 172.21.15.40:0/3169462042 learned_addr learned my addr 172.21.15.40:0/3169462042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 -- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa384152140 msgr2=0x7fa38413eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa384152140 0x7fa38413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa382ffd640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa384151d70 0x7fa38413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 -- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa384151d70 msgr2=0x7fa38413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa384151d70 0x7fa38413e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 -- 172.21.15.40:0/3169462042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009420 con 0x7fa3840a4860 2023-05-24T04:01:02.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa382ffd640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa384151d70 0x7fa38413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:02.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa3837fe640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 0x7fa3841406f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c440 tx=0x7fa37400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.705+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3740074e0 con 0x7fa3840a4860 2023-05-24T04:01:02.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374007640 con 0x7fa3840a4860 2023-05-24T04:01:02.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa384071e10 con 0x7fa3840a4860 2023-05-24T04:01:02.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374004a10 con 0x7fa3840a4860 2023-05-24T04:01:02.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa384071c80 con 0x7fa3840a4860 2023-05-24T04:01:02.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38415c670 con 0x7fa3840a4860 2023-05-24T04:01:02.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa374004b70 con 0x7fa3840a4860 2023-05-24T04:01:02.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa36bfff640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa3700662b0 0x7fa370068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:02.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa3740834f0 con 0x7fa3840a4860 2023-05-24T04:01:02.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa382ffd640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa3700662b0 0x7fa370068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:02.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.709+0000 7fa382ffd640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa3700662b0 0x7fa370068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3780ad000 tx=0x7fa3780a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:02.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.713+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa374050630 con 0x7fa3840a4860 2023-05-24T04:01:02.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.869+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa384144b40 con 0x7fa3840a4860 2023-05-24T04:01:02.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa36bfff640 1 -- 172.21.15.40:0/3169462042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa374053c50 con 0x7fa3840a4860 2023-05-24T04:01:02.879 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:02.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa3700662b0 msgr2=0x7fa370068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa3700662b0 0x7fa370068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3780ad000 tx=0x7fa3780a4f90 comp rx=0 tx=0).stop 2023-05-24T04:01:02.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 msgr2=0x7fa3841406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:02.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 0x7fa3841406f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c440 tx=0x7fa37400c900 comp rx=0 tx=0).stop 2023-05-24T04:01:02.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 shutdown_connections 2023-05-24T04:01:02.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa3700662b0 0x7fa370068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa384152140 0x7fa38413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa384151d70 0x7fa38413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 --2- 172.21.15.40:0/3169462042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3840a4860 0x7fa3841406f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:02.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 >> 172.21.15.40:0/3169462042 conn(0x7fa3840c0310 msgr2=0x7fa38414e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:02.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 shutdown_connections 2023-05-24T04:01:02.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:02.873+0000 7fa38a162640 1 -- 172.21.15.40:0/3169462042 wait complete. 2023-05-24T04:01:02.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:01:03.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 Processor -- start 2023-05-24T04:01:03.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 -- start start 2023-05-24T04:01:03.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7e0151c70 0x7fc7e0152040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:03.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7e00a4a30 0x7fc7e014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:03.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e0152580 con 0x7fc7e00a3690 2023-05-24T04:01:03.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e006ee00 con 0x7fc7e00a4a30 2023-05-24T04:01:03.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e8242640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e006c1d0 con 0x7fc7e0151c70 2023-05-24T04:01:03.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7e00a4a30 0x7fc7e014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:03.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7e00a4a30 0x7fc7e014eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39740/0 (socket says 172.21.15.40:39740) 2023-05-24T04:01:03.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 -- 172.21.15.40:0/2402981604 learned_addr learned my addr 172.21.15.40:0/2402981604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:03.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e5fde640 1 --2- 172.21.15.40:0/2402981604 >> v2:172.21.15.67:3300/0 conn(0x7fc7e0151c70 0x7fc7e0152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:03.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 -- 172.21.15.40:0/2402981604 >> v2:172.21.15.67:3300/0 conn(0x7fc7e0151c70 msgr2=0x7fc7e0152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:03.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 --2- 172.21.15.40:0/2402981604 >> v2:172.21.15.67:3300/0 conn(0x7fc7e0151c70 0x7fc7e0152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 -- 172.21.15.40:0/2402981604 >> v1:172.21.15.67:6789/0 conn(0x7fc7e00a3690 legacy=0x7fc7e006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:03.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.025+0000 7fc7e67df640 1 -- 172.21.15.40:0/2402981604 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0152820 con 0x7fc7e00a4a30 2023-05-24T04:01:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e67df640 1 --2- 172.21.15.40:0/2402981604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a4a30 0x7fc7e014eac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00665d0 tx=0x7fc7dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79f62f103b7ac63 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e4fdc640 1 -- 172.21.15.40:0/2402981604 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0aa610 con 0x7fc7e00a4a30 2023-05-24T04:01:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e4fdc640 1 -- 172.21.15.40:0/2402981604 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0a6040 con 0x7fc7e00a4a30 2023-05-24T04:01:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e4fdc640 1 -- 172.21.15.40:0/2402981604 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0aa990 con 0x7fc7e00a4a30 2023-05-24T04:01:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- 172.21.15.40:0/2402981604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a4a30 msgr2=0x7fc7e014eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 --2- 172.21.15.40:0/2402981604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a4a30 0x7fc7e014eac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00665d0 tx=0x7fc7dc01c490 comp rx=0 tx=0).stop 2023-05-24T04:01:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- 172.21.15.40:0/2402981604 shutdown_connections 2023-05-24T04:01:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 --2- 172.21.15.40:0/2402981604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a4a30 0x7fc7e014eac0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 --2- 172.21.15.40:0/2402981604 >> v2:172.21.15.67:3300/0 conn(0x7fc7e0151c70 0x7fc7e0152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- 172.21.15.40:0/2402981604 >> 172.21.15.40:0/2402981604 conn(0x7fc7e00c0280 msgr2=0x7fc7e00c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- 172.21.15.40:0/2402981604 shutdown_connections 2023-05-24T04:01:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- 172.21.15.40:0/2402981604 wait complete. 2023-05-24T04:01:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 Processor -- start 2023-05-24T04:01:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- start start 2023-05-24T04:01:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 0x7fc7e013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e00a4a30 0x7fc7e014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e0151c70 0x7fc7e014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01eaa30 con 0x7fc7e00a3690 2023-05-24T04:01:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e014d0d0 con 0x7fc7e0151c70 2023-05-24T04:01:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.029+0000 7fc7e8242640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01400a0 con 0x7fc7e00a4a30 2023-05-24T04:01:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 0x7fc7e013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 0x7fc7e013fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39744/0 (socket says 172.21.15.40:39744) 2023-05-24T04:01:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 -- 172.21.15.40:0/3929724343 learned_addr learned my addr 172.21.15.40:0/3929724343 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e67df640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e0151c70 0x7fc7e014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e57dd640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e00a4a30 0x7fc7e014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 -- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e00a4a30 msgr2=0x7fc7e014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e00a4a30 0x7fc7e014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 -- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e0151c70 msgr2=0x7fc7e014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e0151c70 0x7fc7e014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 -- 172.21.15.40:0/3929724343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0094d0 con 0x7fc7e00a3690 2023-05-24T04:01:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e67df640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e0151c70 0x7fc7e014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e57dd640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e00a4a30 0x7fc7e014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e5fde640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 0x7fc7e013fb60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800cd30 tx=0x7fc7d800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80039a0 con 0x7fc7e00a3690 2023-05-24T04:01:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d8003b00 con 0x7fc7e00a3690 2023-05-24T04:01:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e015b710 con 0x7fc7e00a3690 2023-05-24T04:01:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8003e90 con 0x7fc7e00a3690 2023-05-24T04:01:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e015b580 con 0x7fc7e00a3690 2023-05-24T04:01:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e015b8a0 con 0x7fc7e00a3690 2023-05-24T04:01:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7d8004020 con 0x7fc7e00a3690 2023-05-24T04:01:03.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7d67fc640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7c40662b0 0x7fc7c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:03.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7d80847d0 con 0x7fc7e00a3690 2023-05-24T04:01:03.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e57dd640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7c40662b0 0x7fc7c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:03.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.033+0000 7fc7e57dd640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7c40662b0 0x7fc7c4068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7e013cb60 tx=0x7fc7d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:03.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.037+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7d8051a00 con 0x7fc7e00a3690 2023-05-24T04:01:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.201+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7e004ddd0 con 0x7fc7e00a3690 2023-05-24T04:01:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.201+0000 7fc7d67fc640 1 -- 172.21.15.40:0/3929724343 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc7d801d080 con 0x7fc7e00a3690 2023-05-24T04:01:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:01:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7c40662b0 msgr2=0x7fc7c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7c40662b0 0x7fc7c4068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7e013cb60 tx=0x7fc7d0009040 comp rx=0 tx=0).stop 2023-05-24T04:01:03.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 msgr2=0x7fc7e013fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:03.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 0x7fc7e013fb60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800cd30 tx=0x7fc7d800a5c0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 shutdown_connections 2023-05-24T04:01:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7c40662b0 0x7fc7c4068760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e0151c70 0x7fc7e014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e00a4a30 0x7fc7e014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 --2- 172.21.15.40:0/3929724343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e00a3690 0x7fc7e013fb60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 >> 172.21.15.40:0/3929724343 conn(0x7fc7e00c0280 msgr2=0x7fc7e006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 shutdown_connections 2023-05-24T04:01:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:03.205+0000 7fc7e8242640 1 -- 172.21.15.40:0/3929724343 wait complete. 2023-05-24T04:01:03.228 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2023-05-24T04:01:03.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:03.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-24T04:01:03.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[32304]: fuse finished with error 0 and tester_r 0 2023-05-24T04:01:03.250 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:01:09.352 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-05-24T04:01:09.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:09.353 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-24T04:01:09.360 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T04:01:09.361 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:01:09.368 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T04:01:09.368 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:01:09.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:01:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 Processor -- start 2023-05-24T04:01:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 -- start start 2023-05-24T04:01:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4dc0a6d40 0x7fe4dc071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0a4e20 con 0x7fe4dc0a5370 2023-05-24T04:01:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc14bd00 con 0x7fe4dc0a6d40 2023-05-24T04:01:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e25a7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0a4a70 con 0x7fe4dc14b860 2023-05-24T04:01:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4dbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4dc0a6d40 0x7fe4dc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4db7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe4dc0a5370 0x7fe4dc14e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36988/0 (socket says 172.21.15.40:36988) 2023-05-24T04:01:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4dbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4dc0a6d40 0x7fe4dc071180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39752/0 (socket says 172.21.15.40:39752) 2023-05-24T04:01:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4db7fe640 1 -- 172.21.15.40:0/115382022 learned_addr learned my addr 172.21.15.40:0/115382022 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e0b44640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4dbfff640 1 -- 172.21.15.40:0/115382022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 msgr2=0x7fe4dc14ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4dbfff640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4daffd640 1 -- 172.21.15.40:0/115382022 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345420229 0 0) 0x7fe4dc0a4e20 con 0x7fe4dc0a5370 2023-05-24T04:01:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4dbfff640 1 -- 172.21.15.40:0/115382022 >> v1:172.21.15.40:6789/0 conn(0x7fe4dc0a5370 legacy=0x7fe4dc14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4dbfff640 1 -- 172.21.15.40:0/115382022 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0a5070 con 0x7fe4dc0a6d40 2023-05-24T04:01:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.545+0000 7fe4e0b44640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4dbfff640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc071180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e53417a9ecd131 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4daffd640 1 -- 172.21.15.40:0/115382022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0ab610 con 0x7fe4dc0a6d40 2023-05-24T04:01:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4daffd640 1 -- 172.21.15.40:0/115382022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0ab770 con 0x7fe4dc0a6d40 2023-05-24T04:01:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4daffd640 1 -- 172.21.15.40:0/115382022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0abb00 con 0x7fe4dc0a6d40 2023-05-24T04:01:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- 172.21.15.40:0/115382022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a6d40 msgr2=0x7fe4dc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc071180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01c3f0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- 172.21.15.40:0/115382022 shutdown_connections 2023-05-24T04:01:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/115382022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc071180 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- 172.21.15.40:0/115382022 >> 172.21.15.40:0/115382022 conn(0x7fe4dc0c13f0 msgr2=0x7fe4dc0c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- 172.21.15.40:0/115382022 shutdown_connections 2023-05-24T04:01:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- 172.21.15.40:0/115382022 wait complete. 2023-05-24T04:01:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 Processor -- start 2023-05-24T04:01:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- start start 2023-05-24T04:01:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 0x7fe4dc1412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1472e0 con 0x7fe4dc0a5370 2023-05-24T04:01:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc142660 con 0x7fe4dc0a6d40 2023-05-24T04:01:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4e25a7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1491f0 con 0x7fe4dc14b860 2023-05-24T04:01:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 0x7fe4dc1412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.549+0000 7fe4dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 0x7fe4dc1412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39756/0 (socket says 172.21.15.40:39756) 2023-05-24T04:01:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 -- 172.21.15.40:0/184587451 learned_addr learned my addr 172.21.15.40:0/184587451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4e0b44640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4db7fe640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 -- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 msgr2=0x7fe4dc14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 -- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc0a6d40 msgr2=0x7fe4dc14c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc14c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 -- 172.21.15.40:0/184587451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009420 con 0x7fe4dc0a5370 2023-05-24T04:01:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4dbfff640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 0x7fe4dc1412a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:09.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc004220 con 0x7fe4dc0a5370 2023-05-24T04:01:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0b9070 con 0x7fe4dc0a5370 2023-05-24T04:01:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc071bd0 con 0x7fe4dc0a5370 2023-05-24T04:01:09.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc003620 con 0x7fe4dc0a5370 2023-05-24T04:01:09.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc071a40 con 0x7fe4dc0a5370 2023-05-24T04:01:09.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc14f4a0 con 0x7fe4dc0a5370 2023-05-24T04:01:09.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4cc003780 con 0x7fe4dc0a5370 2023-05-24T04:01:09.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4d8ff9640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4bc066280 0x7fe4bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4cc0bb070 con 0x7fe4dc0a5370 2023-05-24T04:01:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4db7fe640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4bc066280 0x7fe4bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.553+0000 7fe4db7fe640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4bc066280 0x7fe4bc068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0bd6b0 tx=0x7fe4c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:09.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.557+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe4cc0ebbd0 con 0x7fe4dc0a5370 2023-05-24T04:01:09.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.713+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4dc0a5dd0 con 0x7fe4dc0a5370 2023-05-24T04:01:09.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.717+0000 7fe4d8ff9640 1 -- 172.21.15.40:0/184587451 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7fe4cc0c4090 con 0x7fe4dc0a5370 2023-05-24T04:01:09.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:09.725 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:01:09.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4bc066280 msgr2=0x7fe4bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4bc066280 0x7fe4bc068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0bd6b0 tx=0x7fe4c4009040 comp rx=0 tx=0).stop 2023-05-24T04:01:09.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 msgr2=0x7fe4dc1412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 0x7fe4dc1412a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01ac30 comp rx=0 tx=0).stop 2023-05-24T04:01:09.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 shutdown_connections 2023-05-24T04:01:09.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fe4bc066280 0x7fe4bc068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4dc14b860 0x7fe4dc14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc0a6d40 0x7fe4dc14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 --2- 172.21.15.40:0/184587451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4dc0a5370 0x7fe4dc1412a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 >> 172.21.15.40:0/184587451 conn(0x7fe4dc0c13f0 msgr2=0x7fe4dc142a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:09.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 shutdown_connections 2023-05-24T04:01:09.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.721+0000 7fe4e25a7640 1 -- 172.21.15.40:0/184587451 wait complete. 2023-05-24T04:01:09.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:01:09.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:01:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.865+0000 7f27e91ae640 1 Processor -- start 2023-05-24T04:01:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.865+0000 7f27e91ae640 1 -- start start 2023-05-24T04:01:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27e414c1b0 0x7f27e4070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27e40bd4f0 0x7f27e406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40be160 con 0x7f27e4070fe0 2023-05-24T04:01:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40be8c0 con 0x7f27e40bd4f0 2023-05-24T04:01:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40a7ea0 con 0x7f27e414c1b0 2023-05-24T04:01:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e359e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f27e4070fe0 0x7f27e406e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37000/0 (socket says 172.21.15.40:37000) 2023-05-24T04:01:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e359e640 1 -- 172.21.15.40:0/3944676171 learned_addr learned my addr 172.21.15.40:0/3944676171 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27dbfff640 1 --2- 172.21.15.40:0/3944676171 >> v2:172.21.15.40:3300/0 conn(0x7f27e40bd4f0 0x7f27e406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e2d9d640 1 --2- 172.21.15.40:0/3944676171 >> v2:172.21.15.67:3300/0 conn(0x7f27e414c1b0 0x7f27e4070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e259c640 1 -- 172.21.15.40:0/3944676171 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544006454 0 0) 0x7f27dc0014a0 con 0x7f27e4070fe0 2023-05-24T04:01:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e259c640 1 -- 172.21.15.40:0/3944676171 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d0003530 con 0x7f27e4070fe0 2023-05-24T04:01:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27dbfff640 1 -- 172.21.15.40:0/3944676171 >> v2:172.21.15.67:3300/0 conn(0x7f27e414c1b0 msgr2=0x7f27e4070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27dbfff640 1 --2- 172.21.15.40:0/3944676171 >> v2:172.21.15.67:3300/0 conn(0x7f27e414c1b0 0x7f27e4070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27dbfff640 1 -- 172.21.15.40:0/3944676171 >> v1:172.21.15.40:6789/0 conn(0x7f27e4070fe0 legacy=0x7f27e406e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27dbfff640 1 -- 172.21.15.40:0/3944676171 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e414c580 con 0x7f27e40bd4f0 2023-05-24T04:01:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e2d9d640 1 --2- 172.21.15.40:0/3944676171 >> v2:172.21.15.67:3300/0 conn(0x7f27e414c1b0 0x7f27e4070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:09.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27dbfff640 1 --2- 172.21.15.40:0/3944676171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e40bd4f0 0x7f27e406dee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f27e40662a0 tx=0x7f27cc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e24be8b0422a2f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e259c640 1 -- 172.21.15.40:0/3944676171 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0ac620 con 0x7f27e40bd4f0 2023-05-24T04:01:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e259c640 1 -- 172.21.15.40:0/3944676171 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0ac780 con 0x7f27e40bd4f0 2023-05-24T04:01:09.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e259c640 1 -- 172.21.15.40:0/3944676171 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0acaf0 con 0x7f27e40bd4f0 2023-05-24T04:01:09.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 -- 172.21.15.40:0/3944676171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e40bd4f0 msgr2=0x7f27e406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 --2- 172.21.15.40:0/3944676171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e40bd4f0 0x7f27e406dee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f27e40662a0 tx=0x7f27cc01c3a0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 -- 172.21.15.40:0/3944676171 shutdown_connections 2023-05-24T04:01:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 --2- 172.21.15.40:0/3944676171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e40bd4f0 0x7f27e406dee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 --2- 172.21.15.40:0/3944676171 >> v2:172.21.15.67:3300/0 conn(0x7f27e414c1b0 0x7f27e4070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.869+0000 7f27e91ae640 1 -- 172.21.15.40:0/3944676171 >> 172.21.15.40:0/3944676171 conn(0x7f27e40c2540 msgr2=0x7f27e40c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:09.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- 172.21.15.40:0/3944676171 shutdown_connections 2023-05-24T04:01:09.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- 172.21.15.40:0/3944676171 wait complete. 2023-05-24T04:01:09.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 Processor -- start 2023-05-24T04:01:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- start start 2023-05-24T04:01:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 0x7f27e406b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e414c1b0 0x7f27e40c0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e40b4bf0 0x7f27e41e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c2190 con 0x7f27e4070fe0 2023-05-24T04:01:09.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4148290 con 0x7f27e414c1b0 2023-05-24T04:01:09.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4148570 con 0x7f27e40b4bf0 2023-05-24T04:01:09.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 0x7f27e406b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 0x7f27e406b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39774/0 (socket says 172.21.15.40:39774) 2023-05-24T04:01:09.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 -- 172.21.15.40:0/260068223 learned_addr learned my addr 172.21.15.40:0/260068223 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:09.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27dbfff640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e414c1b0 0x7f27e40c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e359e640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e40b4bf0 0x7f27e41e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 -- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e40b4bf0 msgr2=0x7f27e41e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e40b4bf0 0x7f27e41e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 -- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e414c1b0 msgr2=0x7f27e40c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:09.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e414c1b0 0x7f27e40c0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 -- 172.21.15.40:0/260068223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009420 con 0x7f27e4070fe0 2023-05-24T04:01:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27dbfff640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e414c1b0 0x7f27e40c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e359e640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e40b4bf0 0x7f27e41e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e2d9d640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 0x7f27e406b500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f27d400d800 tx=0x7f27d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:09.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40096c0 con 0x7f27e4070fe0 2023-05-24T04:01:09.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4009820 con 0x7f27e4070fe0 2023-05-24T04:01:09.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e40a55a0 con 0x7f27e4070fe0 2023-05-24T04:01:09.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4009bd0 con 0x7f27e4070fe0 2023-05-24T04:01:09.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40a83f0 con 0x7f27e4070fe0 2023-05-24T04:01:09.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.873+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40a5730 con 0x7f27e4070fe0 2023-05-24T04:01:09.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.877+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27d4009d30 con 0x7f27e4070fe0 2023-05-24T04:01:09.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.877+0000 7f27db7fe640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27c40662b0 0x7f27c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:09.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.877+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f27d40846b0 con 0x7f27e4070fe0 2023-05-24T04:01:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.877+0000 7f27dbfff640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27c40662b0 0x7f27c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.877+0000 7f27dbfff640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27c40662b0 0x7f27c4068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0ae000 tx=0x7f27cc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:09.881+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f27e40a5730 con 0x7f27e4070fe0 2023-05-24T04:01:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.037+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27e40a5730 con 0x7f27e4070fe0 2023-05-24T04:01:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.037+0000 7f27db7fe640 1 -- 172.21.15.40:0/260068223 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27e40a5730 con 0x7f27e4070fe0 2023-05-24T04:01:10.045 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:01:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27c40662b0 msgr2=0x7f27c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27c40662b0 0x7f27c4068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0ae000 tx=0x7f27cc0a7000 comp rx=0 tx=0).stop 2023-05-24T04:01:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 msgr2=0x7f27e406b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 0x7f27e406b500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f27d400d800 tx=0x7f27d400dcc0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 shutdown_connections 2023-05-24T04:01:10.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27c40662b0 0x7f27c4068760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e40b4bf0 0x7f27e41e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e414c1b0 0x7f27e40c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 --2- 172.21.15.40:0/260068223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27e4070fe0 0x7f27e406b500 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 >> 172.21.15.40:0/260068223 conn(0x7f27e40c2540 msgr2=0x7f27e40c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 shutdown_connections 2023-05-24T04:01:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.041+0000 7f27e91ae640 1 -- 172.21.15.40:0/260068223 wait complete. 2023-05-24T04:01:10.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:01:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d3c62640 1 Processor -- start 2023-05-24T04:01:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d3c62640 1 -- start start 2023-05-24T04:01:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d3c62640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60cc0be420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d3c62640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc06b010 con 0x7f60cc06c010 2023-05-24T04:01:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d3c62640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc06b730 con 0x7f60cc06bbc0 2023-05-24T04:01:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d3c62640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc06ada0 con 0x7f60cc152ae0 2023-05-24T04:01:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d21ff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f60cc06c010 0x7f60cc159430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37008/0 (socket says 172.21.15.40:37008) 2023-05-24T04:01:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.189+0000 7f60d21ff640 1 -- 172.21.15.40:0/2409672722 learned_addr learned my addr 172.21.15.40:0/2409672722 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d19fe640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60cc0be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607380438 0 0) 0x7f60cc06b010 con 0x7f60cc06c010 2023-05-24T04:01:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b8003530 con 0x7f60cc06c010 2023-05-24T04:01:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338144732 0 0) 0x7f60cc06b730 con 0x7f60cc06bbc0 2023-05-24T04:01:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60cc06b010 con 0x7f60cc06bbc0 2023-05-24T04:01:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2887017522 0 0) 0x7f60b8003530 con 0x7f60cc06c010 2023-05-24T04:01:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 msgr2=0x7f60cc0be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60cc0be420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 >> v1:172.21.15.67:6789/0 conn(0x7f60cc06bbc0 legacy=0x7f60cc070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc152100 con 0x7f60cc06c010 2023-05-24T04:01:10.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f60c4001a00 con 0x7f60cc06c010 2023-05-24T04:01:10.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 >> v1:172.21.15.40:6789/0 conn(0x7f60cc06c010 legacy=0x7f60cc159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60b80040a0 0x7f60b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8004d10 0x7f60b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc06ada0 con 0x7f60b8004d10 2023-05-24T04:01:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800bb20 con 0x7f60b80040a0 2023-05-24T04:01:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800bcb0 con 0x7f60cc152ae0 2023-05-24T04:01:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8004d10 0x7f60b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d19fe640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d11fd640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60b80040a0 0x7f60b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 -- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 msgr2=0x7f60b8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60b8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 -- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60b80040a0 msgr2=0x7f60b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60b80040a0 0x7f60b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 -- 172.21.15.40:0/2409672722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8003530 con 0x7f60b8004d10 2023-05-24T04:01:10.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d19fe640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc152ae0 0x7f60b8003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:10.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d11fd640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60b80040a0 0x7f60b80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:10.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d21ff640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8004d10 0x7f60b8005180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06c410 tx=0x7f60c401d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ab1021dab5692c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40ad630 con 0x7f60b8004d10 2023-05-24T04:01:10.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c40a8070 con 0x7f60b8004d10 2023-05-24T04:01:10.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.193+0000 7f60d09fc640 1 -- 172.21.15.40:0/2409672722 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40ada30 con 0x7f60b8004d10 2023-05-24T04:01:10.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/2409672722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8004d10 msgr2=0x7f60b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 --2- 172.21.15.40:0/2409672722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8004d10 0x7f60b8005180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06c410 tx=0x7f60c401d260 comp rx=0 tx=0).stop 2023-05-24T04:01:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d21ff640 1 -- 172.21.15.40:0/2409672722 reap_dead start 2023-05-24T04:01:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/2409672722 shutdown_connections 2023-05-24T04:01:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/2409672722 >> 172.21.15.40:0/2409672722 conn(0x7f60cc0c2540 msgr2=0x7f60cc0c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/2409672722 shutdown_connections 2023-05-24T04:01:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/2409672722 wait complete. 2023-05-24T04:01:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 Processor -- start 2023-05-24T04:01:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- start start 2023-05-24T04:01:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0b6330 0x7f60cc0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 0x7f60cc14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc14d150 0x7f60cc1e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b79b0 con 0x7f60cc0b8340 2023-05-24T04:01:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc14dae0 con 0x7f60cc0b6330 2023-05-24T04:01:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b7c10 con 0x7f60cc14d150 2023-05-24T04:01:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 0x7f60cc14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 0x7f60cc14cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39788/0 (socket says 172.21.15.40:39788) 2023-05-24T04:01:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 -- 172.21.15.40:0/3010144100 learned_addr learned my addr 172.21.15.40:0/3010144100 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d19fe640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0b6330 0x7f60cc0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d21ff640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc14d150 0x7f60cc1e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 -- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc14d150 msgr2=0x7f60cc1e6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc14d150 0x7f60cc1e6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 -- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0b6330 msgr2=0x7f60cc0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0b6330 0x7f60cc0b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 -- 172.21.15.40:0/3010144100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc153040 con 0x7f60cc0b8340 2023-05-24T04:01:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d11fd640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 0x7f60cc14cc10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00f8c0 tx=0x7f60bc00fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00d8d0 con 0x7f60cc0b8340 2023-05-24T04:01:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00da50 con 0x7f60cc0b8340 2023-05-24T04:01:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00de00 con 0x7f60cc0b8340 2023-05-24T04:01:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc152eb0 con 0x7f60cc0b8340 2023-05-24T04:01:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.197+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc071980 con 0x7f60cc0b8340 2023-05-24T04:01:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.201+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0b7dd0 con 0x7f60cc0b8340 2023-05-24T04:01:10.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.201+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60bc007020 con 0x7f60cc0b8340 2023-05-24T04:01:10.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.201+0000 7f60c27fc640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b0066280 0x7f60b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.201+0000 7f60d19fe640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b0066280 0x7f60b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.201+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f60bc086fe0 con 0x7f60cc0b8340 2023-05-24T04:01:10.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.201+0000 7f60d19fe640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b0066280 0x7f60b0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009ac0 tx=0x7f60c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.205+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f60bc054140 con 0x7f60cc0b8340 2023-05-24T04:01:10.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.357+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60cc14dc50 con 0x7f60cc0b8340 2023-05-24T04:01:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60c27fc640 1 -- 172.21.15.40:0/3010144100 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60bc021020 con 0x7f60cc0b8340 2023-05-24T04:01:10.371 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:01:10.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b0066280 msgr2=0x7f60b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b0066280 0x7f60b0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009ac0 tx=0x7f60c8008040 comp rx=0 tx=0).stop 2023-05-24T04:01:10.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 msgr2=0x7f60cc14cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 0x7f60cc14cc10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00f8c0 tx=0x7f60bc00fd80 comp rx=0 tx=0).stop 2023-05-24T04:01:10.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 shutdown_connections 2023-05-24T04:01:10.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b0066280 0x7f60b0068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc14d150 0x7f60cc1e6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60cc0b8340 0x7f60cc14cc10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 --2- 172.21.15.40:0/3010144100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0b6330 0x7f60cc0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 >> 172.21.15.40:0/3010144100 conn(0x7f60cc0c2540 msgr2=0x7f60cc0bcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 shutdown_connections 2023-05-24T04:01:10.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.361+0000 7f60d3c62640 1 -- 172.21.15.40:0/3010144100 wait complete. 2023-05-24T04:01:10.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:01:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c89a1640 1 Processor -- start 2023-05-24T04:01:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c89a1640 1 -- start start 2023-05-24T04:01:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c89a1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55c414f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c89a1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c414e970 con 0x7f55c414f6b0 2023-05-24T04:01:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c89a1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c414ec50 con 0x7f55c40bcc80 2023-05-24T04:01:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c89a1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c4152bc0 con 0x7f55c41526e0 2023-05-24T04:01:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f55c414f6b0 0x7f55c40699e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37016/0 (socket says 172.21.15.40:37016) 2023-05-24T04:01:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 -- 172.21.15.40:0/1587806187 learned_addr learned my addr 172.21.15.40:0/1587806187 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c1d9b640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55c414f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222040287 0 0) 0x7f55c414e970 con 0x7f55c414f6b0 2023-05-24T04:01:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ac003530 con 0x7f55c414f6b0 2023-05-24T04:01:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858080502 0 0) 0x7f55ac003530 con 0x7f55c414f6b0 2023-05-24T04:01:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 msgr2=0x7f55c414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55c414f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 >> v1:172.21.15.67:6789/0 conn(0x7f55c40bcc80 legacy=0x7f55c40bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c414e680 con 0x7f55c414f6b0 2023-05-24T04:01:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f55bc001a00 con 0x7f55c414f6b0 2023-05-24T04:01:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c1d9b640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55c414f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 >> v1:172.21.15.40:6789/0 conn(0x7f55c414f6b0 legacy=0x7f55c40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55ac0039b0 0x7f55ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55ac004d10 0x7f55ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c4152bc0 con 0x7f55ac004d10 2023-05-24T04:01:10.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac00ba70 con 0x7f55ac0039b0 2023-05-24T04:01:10.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac00bc30 con 0x7f55c41526e0 2023-05-24T04:01:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55ac004d10 0x7f55ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c259c640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55ac0039b0 0x7f55ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c1d9b640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 -- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 msgr2=0x7f55ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 -- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55ac0039b0 msgr2=0x7f55ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55ac0039b0 0x7f55ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c2d9d640 1 -- 172.21.15.40:0/1587806187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac003530 con 0x7f55ac004d10 2023-05-24T04:01:10.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.497+0000 7f55c1d9b640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c41526e0 0x7f55ac0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55ac004d10 0x7f55ac005180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00a800 tx=0x7f55bc01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca7bd2ede4f91e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0072d0 con 0x7f55ac004d10 2023-05-24T04:01:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc0a8070 con 0x7f55ac004d10 2023-05-24T04:01:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c159a640 1 -- 172.21.15.40:0/1587806187 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0076b0 con 0x7f55ac004d10 2023-05-24T04:01:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- 172.21.15.40:0/1587806187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55ac004d10 msgr2=0x7f55ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 --2- 172.21.15.40:0/1587806187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55ac004d10 0x7f55ac005180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00a800 tx=0x7f55bc01d300 comp rx=0 tx=0).stop 2023-05-24T04:01:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c2d9d640 1 -- 172.21.15.40:0/1587806187 reap_dead start 2023-05-24T04:01:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- 172.21.15.40:0/1587806187 shutdown_connections 2023-05-24T04:01:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- 172.21.15.40:0/1587806187 >> 172.21.15.40:0/1587806187 conn(0x7f55c406b780 msgr2=0x7f55c40c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- 172.21.15.40:0/1587806187 shutdown_connections 2023-05-24T04:01:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- 172.21.15.40:0/1587806187 wait complete. 2023-05-24T04:01:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 Processor -- start 2023-05-24T04:01:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- start start 2023-05-24T04:01:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c41d8670 0x7f55c40a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c414b730 0x7f55c41d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 0x7f55c41e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c414b200 con 0x7f55c41d8a40 2023-05-24T04:01:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c41da8c0 con 0x7f55c41d8670 2023-05-24T04:01:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c89a1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c414b450 con 0x7f55c414b730 2023-05-24T04:01:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.501+0000 7f55c2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 0x7f55c41e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 0x7f55c41e6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39814/0 (socket says 172.21.15.40:39814) 2023-05-24T04:01:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 -- 172.21.15.40:0/2099745628 learned_addr learned my addr 172.21.15.40:0/2099745628 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c1d9b640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c414b730 0x7f55c41d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c259c640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c41d8670 0x7f55c40a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 -- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c414b730 msgr2=0x7f55c41d9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c414b730 0x7f55c41d9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 -- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c41d8670 msgr2=0x7f55c40a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c41d8670 0x7f55c40a35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 -- 172.21.15.40:0/2099745628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c406a0f0 con 0x7f55c41d8a40 2023-05-24T04:01:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c259c640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c41d8670 0x7f55c40a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c2d9d640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 0x7f55c41e6f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f55bc098d20 tx=0x7f55ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0ba070 con 0x7f55c41d8a40 2023-05-24T04:01:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc001fb0 con 0x7f55c41d8a40 2023-05-24T04:01:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c406dbe0 con 0x7f55c41d8a40 2023-05-24T04:01:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0017c0 con 0x7f55c41d8a40 2023-05-24T04:01:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c40bd050 con 0x7f55c41d8a40 2023-05-24T04:01:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4066d70 con 0x7f55c41d8a40 2023-05-24T04:01:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55bc0aa030 con 0x7f55c41d8a40 2023-05-24T04:01:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55b2ffd640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f55a4066280 0x7f55a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c259c640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f55a4066280 0x7f55a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f55bc11d6f0 con 0x7f55c41d8a40 2023-05-24T04:01:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.505+0000 7f55c259c640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f55a4066280 0x7f55a4068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f55c40a7030 tx=0x7f55b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.509+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f55bc0ee360 con 0x7f55c41d8a40 2023-05-24T04:01:10.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.665+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55c40712b0 con 0x7f55c41d8a40 2023-05-24T04:01:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.665+0000 7f55b2ffd640 1 -- 172.21.15.40:0/2099745628 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55bc0edef0 con 0x7f55c41d8a40 2023-05-24T04:01:10.672 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f55a4066280 msgr2=0x7f55a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f55a4066280 0x7f55a4068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f55c40a7030 tx=0x7f55b8009040 comp rx=0 tx=0).stop 2023-05-24T04:01:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 msgr2=0x7f55c41e6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 0x7f55c41e6f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f55bc098d20 tx=0x7f55ac005800 comp rx=0 tx=0).stop 2023-05-24T04:01:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 shutdown_connections 2023-05-24T04:01:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f55a4066280 0x7f55a4068730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55c41d8a40 0x7f55c41e6f60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c414b730 0x7f55c41d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 --2- 172.21.15.40:0/2099745628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c41d8670 0x7f55c40a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 >> 172.21.15.40:0/2099745628 conn(0x7f55c406b780 msgr2=0x7f55c40bf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 shutdown_connections 2023-05-24T04:01:10.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.669+0000 7f55c89a1640 1 -- 172.21.15.40:0/2099745628 wait complete. 2023-05-24T04:01:10.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:01:10.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.801+0000 7f134bc68640 1 Processor -- start 2023-05-24T04:01:10.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.801+0000 7f134bc68640 1 -- start start 2023-05-24T04:01:10.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f134414bc80 0x7f13440a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f13440bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1344071ad0 con 0x7f1344071220 2023-05-24T04:01:10.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13440a5040 con 0x7f134414bc80 2023-05-24T04:01:10.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1344070ab0 con 0x7f1344071670 2023-05-24T04:01:10.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f134414bc80 0x7f13440a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f134414bc80 0x7f13440a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39816/0 (socket says 172.21.15.40:39816) 2023-05-24T04:01:10.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 -- 172.21.15.40:0/536395681 learned_addr learned my addr 172.21.15.40:0/536395681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:10.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134a205640 1 --2- 172.21.15.40:0/536395681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f13440bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 -- 172.21.15.40:0/536395681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 msgr2=0x7f13440bd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 --2- 172.21.15.40:0/536395681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f13440bd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 -- 172.21.15.40:0/536395681 >> v1:172.21.15.67:6789/0 conn(0x7f1344071220 legacy=0x7f13440bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:10.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 -- 172.21.15.40:0/536395681 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134414d0f0 con 0x7f134414bc80 2023-05-24T04:01:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1349a04640 1 --2- 172.21.15.40:0/536395681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f13440a33a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1340009870 tx=0x7f134001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945fd657ee65612d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1348a02640 1 -- 172.21.15.40:0/536395681 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13400ac600 con 0x7f134414bc80 2023-05-24T04:01:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1348a02640 1 -- 172.21.15.40:0/536395681 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13400a8050 con 0x7f134414bc80 2023-05-24T04:01:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f1348a02640 1 -- 172.21.15.40:0/536395681 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13400ac980 con 0x7f134414bc80 2023-05-24T04:01:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- 172.21.15.40:0/536395681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 msgr2=0x7f13440a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 --2- 172.21.15.40:0/536395681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f13440a33a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1340009870 tx=0x7f134001c3e0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- 172.21.15.40:0/536395681 shutdown_connections 2023-05-24T04:01:10.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 --2- 172.21.15.40:0/536395681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f13440bd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 --2- 172.21.15.40:0/536395681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f13440a33a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- 172.21.15.40:0/536395681 >> 172.21.15.40:0/536395681 conn(0x7f13440c0310 msgr2=0x7f13440c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- 172.21.15.40:0/536395681 shutdown_connections 2023-05-24T04:01:10.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.805+0000 7f134bc68640 1 -- 172.21.15.40:0/536395681 wait complete. 2023-05-24T04:01:10.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 Processor -- start 2023-05-24T04:01:10.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- start start 2023-05-24T04:01:10.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1344071220 0x7f1344139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f134413f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f134413bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1344140780 con 0x7f134414bc80 2023-05-24T04:01:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134413b5e0 con 0x7f1344071220 2023-05-24T04:01:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134413b300 con 0x7f1344071670 2023-05-24T04:01:10.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f134413bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f134413bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39824/0 (socket says 172.21.15.40:39824) 2023-05-24T04:01:10.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 -- 172.21.15.40:0/1134625965 learned_addr learned my addr 172.21.15.40:0/1134625965 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:10.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f1349a04640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1344071220 0x7f1344139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f1349203640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f134413f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 -- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 msgr2=0x7f134413f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f134413f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 -- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1344071220 msgr2=0x7f1344139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1344071220 0x7f1344139990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 -- 172.21.15.40:0/1134625965 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400094d0 con 0x7f134414bc80 2023-05-24T04:01:10.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f1349203640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f134413f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:10.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f1349a04640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1344071220 0x7f1344139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:10.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134a205640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f134413bd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f133c00cd70 tx=0x7f133c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c003ba0 con 0x7f134414bc80 2023-05-24T04:01:10.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c003d00 con 0x7f134414bc80 2023-05-24T04:01:10.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134406b1d0 con 0x7f134414bc80 2023-05-24T04:01:10.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c004240 con 0x7f134414bc80 2023-05-24T04:01:10.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13440bd970 con 0x7f134414bc80 2023-05-24T04:01:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.809+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134414c050 con 0x7f134414bc80 2023-05-24T04:01:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.813+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f133c0043a0 con 0x7f134414bc80 2023-05-24T04:01:10.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.813+0000 7f133a7fc640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1328066280 0x7f1328068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:10.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.813+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f133c012070 con 0x7f134414bc80 2023-05-24T04:01:10.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.813+0000 7f1349a04640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1328066280 0x7f1328068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.813+0000 7f1349a04640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1328066280 0x7f1328068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13400ae000 tx=0x7f1340008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.817+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f133c051b30 con 0x7f134414bc80 2023-05-24T04:01:10.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.969+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13440bcb90 con 0x7f134414bc80 2023-05-24T04:01:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f133a7fc640 1 -- 172.21.15.40:0/1134625965 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f133c055150 con 0x7f134414bc80 2023-05-24T04:01:10.981 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:01:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1328066280 msgr2=0x7f1328068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1328066280 0x7f1328068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13400ae000 tx=0x7f1340008040 comp rx=0 tx=0).stop 2023-05-24T04:01:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 msgr2=0x7f134413bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f134413bd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f133c00cd70 tx=0x7f133c00a660 comp rx=0 tx=0).stop 2023-05-24T04:01:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 shutdown_connections 2023-05-24T04:01:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1328066280 0x7f1328068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f134414bc80 0x7f134413bd90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1344071670 0x7f134413f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 --2- 172.21.15.40:0/1134625965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1344071220 0x7f1344139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 >> 172.21.15.40:0/1134625965 conn(0x7f13440c0310 msgr2=0x7f1344141940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 shutdown_connections 2023-05-24T04:01:10.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:10.973+0000 7f134bc68640 1 -- 172.21.15.40:0/1134625965 wait complete. 2023-05-24T04:01:10.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:01:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.117+0000 7fb92198e640 1 Processor -- start 2023-05-24T04:01:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.117+0000 7fb92198e640 1 -- start start 2023-05-24T04:01:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb92198e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c0714c0 0x7fb91c14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb92198e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c0c0e20 0x7fb91c14ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb92198e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb91c14f250 0x7fb91c14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb92198e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c06fe00 con 0x7fb91c0c0e20 2023-05-24T04:01:11.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb92198e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c0bd750 con 0x7fb91c14f250 2023-05-24T04:01:11.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb92198e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0a4800 con 0x7fb91c0714c0 2023-05-24T04:01:11.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c0c0e20 0x7fb91c14ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c0c0e20 0x7fb91c14ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39826/0 (socket says 172.21.15.40:39826) 2023-05-24T04:01:11.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 -- 172.21.15.40:0/1427962653 learned_addr learned my addr 172.21.15.40:0/1427962653 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:11.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91b7fe640 1 --2- 172.21.15.40:0/1427962653 >> v2:172.21.15.67:3300/0 conn(0x7fb91c14f250 0x7fb91c14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91affd640 1 --2- 172.21.15.40:0/1427962653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c0714c0 0x7fb91c14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 -- 172.21.15.40:0/1427962653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c0714c0 msgr2=0x7fb91c14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/1427962653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c0714c0 0x7fb91c14e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 -- 172.21.15.40:0/1427962653 >> v2:172.21.15.67:3300/0 conn(0x7fb91c14f250 msgr2=0x7fb91c14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/1427962653 >> v2:172.21.15.67:3300/0 conn(0x7fb91c14f250 0x7fb91c14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 -- 172.21.15.40:0/1427962653 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0a4ae0 con 0x7fb91c0c0e20 2023-05-24T04:01:11.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91b7fe640 1 --2- 172.21.15.40:0/1427962653 >> v2:172.21.15.67:3300/0 conn(0x7fb91c14f250 0x7fb91c14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:11.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/1427962653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14ed10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0bdd20 tx=0x7fb91001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b46c5f059c0091f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb919ffb640 1 -- 172.21.15.40:0/1427962653 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100ab620 con 0x7fb91c0c0e20 2023-05-24T04:01:11.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb919ffb640 1 -- 172.21.15.40:0/1427962653 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9100ab780 con 0x7fb91c0c0e20 2023-05-24T04:01:11.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.121+0000 7fb919ffb640 1 -- 172.21.15.40:0/1427962653 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100abb10 con 0x7fb91c0c0e20 2023-05-24T04:01:11.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/1427962653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0c0e20 msgr2=0x7fb91c14ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- 172.21.15.40:0/1427962653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14ed10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0bdd20 tx=0x7fb91001e680 comp rx=0 tx=0).stop 2023-05-24T04:01:11.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/1427962653 shutdown_connections 2023-05-24T04:01:11.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- 172.21.15.40:0/1427962653 >> v2:172.21.15.67:3300/0 conn(0x7fb91c14f250 0x7fb91c14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- 172.21.15.40:0/1427962653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14ed10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- 172.21.15.40:0/1427962653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c0714c0 0x7fb91c14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/1427962653 >> 172.21.15.40:0/1427962653 conn(0x7fb91c0c0310 msgr2=0x7fb91c0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/1427962653 shutdown_connections 2023-05-24T04:01:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/1427962653 wait complete. 2023-05-24T04:01:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 Processor -- start 2023-05-24T04:01:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- start start 2023-05-24T04:01:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 0x7fb91c13e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c14f250 0x7fb91c146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c1e62a0 con 0x7fb91c0714c0 2023-05-24T04:01:11.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c1e1e50 con 0x7fb91c0c0e20 2023-05-24T04:01:11.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c148360 con 0x7fb91c14f250 2023-05-24T04:01:11.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 0x7fb91c13e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 0x7fb91c13e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39830/0 (socket says 172.21.15.40:39830) 2023-05-24T04:01:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 -- 172.21.15.40:0/2080713016 learned_addr learned my addr 172.21.15.40:0/2080713016 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91b7fe640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c14f250 0x7fb91c146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 -- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c14f250 msgr2=0x7fb91c146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c14f250 0x7fb91c146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 -- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb91c0c0e20 msgr2=0x7fb91c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 -- 172.21.15.40:0/2080713016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100094d0 con 0x7fb91c0714c0 2023-05-24T04:01:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb91affd640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 0x7fb91c13e0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d800 tx=0x7fb90c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c009640 con 0x7fb91c0714c0 2023-05-24T04:01:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c0097a0 con 0x7fb91c0714c0 2023-05-24T04:01:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c071a20 con 0x7fb91c0714c0 2023-05-24T04:01:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c009930 con 0x7fb91c0714c0 2023-05-24T04:01:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c071890 con 0x7fb91c0714c0 2023-05-24T04:01:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.125+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c0a52e0 con 0x7fb91c0714c0 2023-05-24T04:01:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.129+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb90c009a90 con 0x7fb91c0714c0 2023-05-24T04:01:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.129+0000 7fb903fff640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb908066280 0x7fb908068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.129+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb90c084530 con 0x7fb91c0714c0 2023-05-24T04:01:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.129+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb908066280 0x7fb908068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.129+0000 7fb91a7fc640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb908066280 0x7fb908068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b0000 tx=0x7fb9100b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.133+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb90c0515e0 con 0x7fb91c0714c0 2023-05-24T04:01:11.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.289+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb91c148ba0 con 0x7fb91c0714c0 2023-05-24T04:01:11.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.289+0000 7fb903fff640 1 -- 172.21.15.40:0/2080713016 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb90c054c00 con 0x7fb91c0714c0 2023-05-24T04:01:11.296 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:11.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb908066280 msgr2=0x7fb908068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb908066280 0x7fb908068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b0000 tx=0x7fb9100b5040 comp rx=0 tx=0).stop 2023-05-24T04:01:11.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 msgr2=0x7fb91c13e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 0x7fb91c13e0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d800 tx=0x7fb90c00dcc0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 shutdown_connections 2023-05-24T04:01:11.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb908066280 0x7fb908068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb91c14f250 0x7fb91c146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb91c0c0e20 0x7fb91c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 --2- 172.21.15.40:0/2080713016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c0714c0 0x7fb91c13e0b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 >> 172.21.15.40:0/2080713016 conn(0x7fb91c0c0310 msgr2=0x7fb91c0a33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:11.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 shutdown_connections 2023-05-24T04:01:11.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.293+0000 7fb92198e640 1 -- 172.21.15.40:0/2080713016 wait complete. 2023-05-24T04:01:11.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:01:11.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 Processor -- start 2023-05-24T04:01:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 -- start start 2023-05-24T04:01:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac0c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97ac151e20 0x7f97ac1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0b8040 con 0x7f97ac0a3da0 2023-05-24T04:01:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0c4220 con 0x7f97ac151e20 2023-05-24T04:01:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97b0fbd640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0b7df0 con 0x7f97ac0bef60 2023-05-24T04:01:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97aad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97ac151e20 0x7f97ac1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97a9d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f97ac0a3da0 0x7f97ac0c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37024/0 (socket says 172.21.15.40:37024) 2023-05-24T04:01:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97a9d9b640 1 -- 172.21.15.40:0/2647546663 learned_addr learned my addr 172.21.15.40:0/2647546663 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.437+0000 7f97aa59c640 1 --2- 172.21.15.40:0/2647546663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac0c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97aad9d640 1 -- 172.21.15.40:0/2647546663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 msgr2=0x7f97ac0c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:11.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97aad9d640 1 --2- 172.21.15.40:0/2647546663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac0c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97aad9d640 1 -- 172.21.15.40:0/2647546663 >> v1:172.21.15.40:6789/0 conn(0x7f97ac0a3da0 legacy=0x7f97ac0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97aad9d640 1 -- 172.21.15.40:0/2647546663 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0a38d0 con 0x7f97ac151e20 2023-05-24T04:01:11.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97a959a640 1 -- 172.21.15.40:0/2647546663 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110014374 0 0) 0x7f97940014a0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97aad9d640 1 --2- 172.21.15.40:0/2647546663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac151e20 0x7f97ac1522c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f97a40097f0 tx=0x7f97a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f81fb8fdf4f32a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97a959a640 1 -- 172.21.15.40:0/2647546663 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40ab5f0 con 0x7f97ac151e20 2023-05-24T04:01:11.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97a959a640 1 -- 172.21.15.40:0/2647546663 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a40ab750 con 0x7f97ac151e20 2023-05-24T04:01:11.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97a959a640 1 -- 172.21.15.40:0/2647546663 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40abae0 con 0x7f97ac151e20 2023-05-24T04:01:11.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 -- 172.21.15.40:0/2647546663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac151e20 msgr2=0x7f97ac1522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/2647546663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac151e20 0x7f97ac1522c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f97a40097f0 tx=0x7f97a401c3d0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 -- 172.21.15.40:0/2647546663 shutdown_connections 2023-05-24T04:01:11.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/2647546663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac151e20 0x7f97ac1522c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/2647546663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac0c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 -- 172.21.15.40:0/2647546663 >> 172.21.15.40:0/2647546663 conn(0x7f97ac065bb0 msgr2=0x7f97ac0a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:11.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 -- 172.21.15.40:0/2647546663 shutdown_connections 2023-05-24T04:01:11.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.441+0000 7f97b0fbd640 1 -- 172.21.15.40:0/2647546663 wait complete. 2023-05-24T04:01:11.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 Processor -- start 2023-05-24T04:01:11.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- start start 2023-05-24T04:01:11.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 0x7f97ac0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac1e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97ac151e20 0x7f97ac1e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1e7340 con 0x7f97ac0a3da0 2023-05-24T04:01:11.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0a59b0 con 0x7f97ac151e20 2023-05-24T04:01:11.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0bdd10 con 0x7f97ac0bef60 2023-05-24T04:01:11.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 0x7f97ac0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 0x7f97ac0a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39854/0 (socket says 172.21.15.40:39854) 2023-05-24T04:01:11.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 -- 172.21.15.40:0/1137403090 learned_addr learned my addr 172.21.15.40:0/1137403090 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:11.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aad9d640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97ac151e20 0x7f97ac1e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97a9d9b640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac1e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 -- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 msgr2=0x7f97ac1e68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac1e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 -- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97ac151e20 msgr2=0x7f97ac1e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97ac151e20 0x7f97ac1e6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 -- 172.21.15.40:0/1137403090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4009420 con 0x7f97ac0a3da0 2023-05-24T04:01:11.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aad9d640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97ac151e20 0x7f97ac1e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:11.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97aa59c640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 0x7f97ac0a5470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f979c00d800 tx=0x7f979c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00b6c0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00b820 con 0x7f97ac0a3da0 2023-05-24T04:01:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00bb90 con 0x7f97ac0a3da0 2023-05-24T04:01:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac0bb440 con 0x7f97ac0a3da0 2023-05-24T04:01:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac0c3eb0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac0bb5d0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.445+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f979c00bcf0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.449+0000 7f97a2ffd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f978c066280 0x7f978c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.449+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f979c084700 con 0x7f97ac0a3da0 2023-05-24T04:01:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.449+0000 7f97a9d9b640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f978c066280 0x7f978c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.449+0000 7f97a9d9b640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f978c066280 0x7f978c068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9794007fd0 tx=0x7f9794009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.453+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f979c0551c0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.617+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97ac04ddd0 con 0x7f97ac0a3da0 2023-05-24T04:01:11.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.617+0000 7f97a2ffd640 1 -- 172.21.15.40:0/1137403090 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f979c054d50 con 0x7f97ac0a3da0 2023-05-24T04:01:11.624 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:01:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f978c066280 msgr2=0x7f978c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f978c066280 0x7f978c068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9794007fd0 tx=0x7f9794009040 comp rx=0 tx=0).stop 2023-05-24T04:01:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 msgr2=0x7f97ac0a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 0x7f97ac0a5470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f979c00d800 tx=0x7f979c00dcc0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 shutdown_connections 2023-05-24T04:01:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f978c066280 0x7f978c068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97ac151e20 0x7f97ac1e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97ac0bef60 0x7f97ac1e68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 --2- 172.21.15.40:0/1137403090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97ac0a3da0 0x7f97ac0a5470 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 >> 172.21.15.40:0/1137403090 conn(0x7f97ac065bb0 msgr2=0x7f97ac148e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 shutdown_connections 2023-05-24T04:01:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.621+0000 7f97b0fbd640 1 -- 172.21.15.40:0/1137403090 wait complete. 2023-05-24T04:01:11.644 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-05-24T04:01:11.644 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T04:01:11.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:01:11.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.761+0000 7f7bb8933640 1 Processor -- start 2023-05-24T04:01:11.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.761+0000 7f7bb8933640 1 -- start start 2023-05-24T04:01:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb8933640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bb414e030 0x7f7bb40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb8933640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7bb4071160 0x7f7bb4151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb8933640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb8933640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb414e400 con 0x7f7bb414e030 2023-05-24T04:01:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb8933640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb406fe80 con 0x7f7bb4071160 2023-05-24T04:01:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb8933640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40c2050 con 0x7f7bb4069f20 2023-05-24T04:01:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bb414e030 0x7f7bb40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bb414e030 0x7f7bb40699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49086/0 (socket says 172.21.15.40:49086) 2023-05-24T04:01:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 -- 172.21.15.40:0/1929797128 learned_addr learned my addr 172.21.15.40:0/1929797128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 -- 172.21.15.40:0/1929797128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 msgr2=0x7f7bb4152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1929797128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 -- 172.21.15.40:0/1929797128 >> v2:172.21.15.67:3300/0 conn(0x7f7bb4071160 msgr2=0x7f7bb4151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb1d9b640 1 --2- 172.21.15.40:0/1929797128 >> v2:172.21.15.67:3300/0 conn(0x7f7bb4071160 0x7f7bb4151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1929797128 >> v2:172.21.15.67:3300/0 conn(0x7f7bb4071160 0x7f7bb4151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 -- 172.21.15.40:0/1929797128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4070160 con 0x7f7bb414e030 2023-05-24T04:01:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb1d9b640 1 --2- 172.21.15.40:0/1929797128 >> v2:172.21.15.67:3300/0 conn(0x7f7bb4071160 0x7f7bb4151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1929797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb414e030 0x7f7bb40699e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7bb414f8b0 tx=0x7f7ba401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a1e6182f8e251f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb159a640 1 -- 172.21.15.40:0/1929797128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40aa610 con 0x7f7bb414e030 2023-05-24T04:01:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb159a640 1 -- 172.21.15.40:0/1929797128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba40a6040 con 0x7f7bb414e030 2023-05-24T04:01:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.765+0000 7f7bb159a640 1 -- 172.21.15.40:0/1929797128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40aa990 con 0x7f7bb414e030 2023-05-24T04:01:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1929797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb414e030 msgr2=0x7f7bb40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1929797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb414e030 0x7f7bb40699e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7bb414f8b0 tx=0x7f7ba401c4d0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1929797128 shutdown_connections 2023-05-24T04:01:11.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1929797128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1929797128 >> v2:172.21.15.67:3300/0 conn(0x7f7bb4071160 0x7f7bb4151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1929797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb414e030 0x7f7bb40699e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1929797128 >> 172.21.15.40:0/1929797128 conn(0x7f7bb40c13f0 msgr2=0x7f7bb40c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1929797128 shutdown_connections 2023-05-24T04:01:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1929797128 wait complete. 2023-05-24T04:01:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 Processor -- start 2023-05-24T04:01:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- start start 2023-05-24T04:01:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 0x7f7bb4142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bb414e030 0x7f7bb4143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41510d0 con 0x7f7bb4071160 2023-05-24T04:01:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4149780 con 0x7f7bb414e030 2023-05-24T04:01:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41436b0 con 0x7f7bb4069f20 2023-05-24T04:01:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 0x7f7bb4142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 0x7f7bb4142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49090/0 (socket says 172.21.15.40:49090) 2023-05-24T04:01:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 -- 172.21.15.40:0/1922992509 learned_addr learned my addr 172.21.15.40:0/1922992509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb2d9d640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bb414e030 0x7f7bb4143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 -- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 msgr2=0x7f7bb4149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 -- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bb414e030 msgr2=0x7f7bb4143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bb414e030 0x7f7bb4143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 -- 172.21.15.40:0/1922992509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40094d0 con 0x7f7bb4071160 2023-05-24T04:01:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb2d9d640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bb414e030 0x7f7bb4143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb1d9b640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 0x7f7bb4142c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c7f0 tx=0x7f7ba800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800cea0 con 0x7f7bb4071160 2023-05-24T04:01:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8007a30 con 0x7f7bb4071160 2023-05-24T04:01:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb406d680 con 0x7f7bb4071160 2023-05-24T04:01:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007dc0 con 0x7f7bb4071160 2023-05-24T04:01:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.769+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb406d4f0 con 0x7f7bb4071160 2023-05-24T04:01:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.773+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb406d810 con 0x7f7bb4071160 2023-05-24T04:01:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.773+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ba80113f0 con 0x7f7bb4071160 2023-05-24T04:01:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.773+0000 7f7ba2ffd640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b94066280 0x7f7b94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.773+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7ba80841e0 con 0x7f7bb4071160 2023-05-24T04:01:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.773+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b94066280 0x7f7b94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.773+0000 7f7bb259c640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b94066280 0x7f7b94068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40ae000 tx=0x7f7ba4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.777+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7ba8051330 con 0x7f7bb4071160 2023-05-24T04:01:11.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.933+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bb4066d70 con 0x7f7bb4071160 2023-05-24T04:01:11.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7ba2ffd640 1 -- 172.21.15.40:0/1922992509 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7f7ba8054950 con 0x7f7bb4071160 2023-05-24T04:01:11.942 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:11.942 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:01:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b94066280 msgr2=0x7f7b94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b94066280 0x7f7b94068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40ae000 tx=0x7f7ba4008040 comp rx=0 tx=0).stop 2023-05-24T04:01:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 msgr2=0x7f7bb4142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 0x7f7bb4142c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c7f0 tx=0x7f7ba800ccb0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 shutdown_connections 2023-05-24T04:01:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b94066280 0x7f7b94068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bb414e030 0x7f7bb4143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb4071160 0x7f7bb4142c30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 --2- 172.21.15.40:0/1922992509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bb4069f20 0x7f7bb4149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 >> 172.21.15.40:0/1922992509 conn(0x7f7bb40c13f0 msgr2=0x7f7bb40a5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 shutdown_connections 2023-05-24T04:01:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:11.937+0000 7f7bb8933640 1 -- 172.21.15.40:0/1922992509 wait complete. 2023-05-24T04:01:11.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:59:46.596983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:59:52.226202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:59:56.290859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:59:56.868620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:59:59.952259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T04:01:11.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T04:01:12.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76e488640 1 Processor -- start 2023-05-24T04:01:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76e488640 1 -- start start 2023-05-24T04:01:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76e488640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 0x7fa768157120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76e488640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa768070850 con 0x7fa76806d9a0 2023-05-24T04:01:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76e488640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76814b220 con 0x7fa76806d5d0 2023-05-24T04:01:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76e488640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76806ddf0 con 0x7fa76806f130 2023-05-24T04:01:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa76806d9a0 0x7fa7681539f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51568/0 (socket says 172.21.15.40:51568) 2023-05-24T04:01:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 -- 172.21.15.40:0/2707556996 learned_addr learned my addr 172.21.15.40:0/2707556996 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76ca25640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 0x7fa768157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096600822 0 0) 0x7fa768070850 con 0x7fa76806d9a0 2023-05-24T04:01:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa750005740 con 0x7fa76806d9a0 2023-05-24T04:01:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558890062 0 0) 0x7fa750005740 con 0x7fa76806d9a0 2023-05-24T04:01:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 msgr2=0x7fa768157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 0x7fa768157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 >> v1:172.21.15.67:6789/0 conn(0x7fa76806d5d0 legacy=0x7fa76814b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76806f5b0 con 0x7fa76806d9a0 2023-05-24T04:01:12.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fa75c001680 con 0x7fa76806d9a0 2023-05-24T04:01:12.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 >> v1:172.21.15.40:6789/0 conn(0x7fa76806d9a0 legacy=0x7fa7681539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 0x7fa750005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7500069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa750006f20 0x7fa750007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76806ddf0 con 0x7fa750006140 2023-05-24T04:01:12.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75000dc80 con 0x7fa750006f20 2023-05-24T04:01:12.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75000de40 con 0x7fa76806f130 2023-05-24T04:01:12.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7500069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa767fff640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 0x7fa750005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76ca25640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa750006f20 0x7fa750007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 -- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 msgr2=0x7fa750005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa76806f130 0x7fa750005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 -- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa750006f20 msgr2=0x7fa750007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa750006f20 0x7fa750007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa7677fe640 1 -- 172.21.15.40:0/2707556996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750005740 con 0x7fa750006140 2023-05-24T04:01:12.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.089+0000 7fa76ca25640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa750006f20 0x7fa750007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:12.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa7677fe640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7500069e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c210 tx=0x7fa75c01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fbf7577269af49 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c005ae0 con 0x7fa750006140 2023-05-24T04:01:12.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0ab070 con 0x7fa750006140 2023-05-24T04:01:12.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa766ffd640 1 -- 172.21.15.40:0/2707556996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c007070 con 0x7fa750006140 2023-05-24T04:01:12.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- 172.21.15.40:0/2707556996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 msgr2=0x7fa7500069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 --2- 172.21.15.40:0/2707556996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7500069e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c210 tx=0x7fa75c01f370 comp rx=0 tx=0).stop 2023-05-24T04:01:12.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76ca25640 1 -- 172.21.15.40:0/2707556996 reap_dead start 2023-05-24T04:01:12.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- 172.21.15.40:0/2707556996 shutdown_connections 2023-05-24T04:01:12.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- 172.21.15.40:0/2707556996 >> 172.21.15.40:0/2707556996 conn(0x7fa7680c0ba0 msgr2=0x7fa7680c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:12.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- 172.21.15.40:0/2707556996 shutdown_connections 2023-05-24T04:01:12.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- 172.21.15.40:0/2707556996 wait complete. 2023-05-24T04:01:12.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 Processor -- start 2023-05-24T04:01:12.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- start start 2023-05-24T04:01:12.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7680bc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7680b9570 0x7fa7680b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76814ebf0 0x7fa7681e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680b8110 con 0x7fa750006140 2023-05-24T04:01:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680badd0 con 0x7fa76814ebf0 2023-05-24T04:01:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.093+0000 7fa76e488640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681e2a40 con 0x7fa7680b9570 2023-05-24T04:01:12.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7680bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7680bc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49104/0 (socket says 172.21.15.40:49104) 2023-05-24T04:01:12.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 -- 172.21.15.40:0/122793812 learned_addr learned my addr 172.21.15.40:0/122793812 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:12.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa76ca25640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76814ebf0 0x7fa7681e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa7677fe640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7680b9570 0x7fa7680b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 -- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7680b9570 msgr2=0x7fa7680b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7680b9570 0x7fa7680b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 -- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76814ebf0 msgr2=0x7fa7681e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76814ebf0 0x7fa7681e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 -- 172.21.15.40:0/122793812 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768070aa0 con 0x7fa750006140 2023-05-24T04:01:12.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa7677fe640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7680b9570 0x7fa7680b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:12.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa767fff640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7680bc880 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa75800e5b0 tx=0x7fa75800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580052e0 con 0x7fa750006140 2023-05-24T04:01:12.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa758005440 con 0x7fa750006140 2023-05-24T04:01:12.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7680bd350 con 0x7fa750006140 2023-05-24T04:01:12.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758003820 con 0x7fa750006140 2023-05-24T04:01:12.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7680704e0 con 0x7fa750006140 2023-05-24T04:01:12.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7680b9fb0 con 0x7fa750006140 2023-05-24T04:01:12.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa758003980 con 0x7fa750006140 2023-05-24T04:01:12.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa764ff9640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa7540662b0 0x7fa754068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa758083c50 con 0x7fa750006140 2023-05-24T04:01:12.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa7677fe640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa7540662b0 0x7fa754068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.097+0000 7fa7677fe640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa7540662b0 0x7fa754068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0af000 tx=0x7fa75c0aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.101+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa758050d00 con 0x7fa750006140 2023-05-24T04:01:12.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa768066d70 con 0x7fa750006140 2023-05-24T04:01:12.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa764ff9640 1 -- 172.21.15.40:0/122793812 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa758054320 con 0x7fa750006140 2023-05-24T04:01:12.260 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-24T04:01:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa7540662b0 msgr2=0x7fa754068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa7540662b0 0x7fa754068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0af000 tx=0x7fa75c0aa000 comp rx=0 tx=0).stop 2023-05-24T04:01:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 msgr2=0x7fa7680bc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7680bc880 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa75800e5b0 tx=0x7fa75800ea70 comp rx=0 tx=0).stop 2023-05-24T04:01:12.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 shutdown_connections 2023-05-24T04:01:12.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa7540662b0 0x7fa754068760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76814ebf0 0x7fa7681e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7680b9570 0x7fa7680b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.253+0000 7fa76e488640 1 --2- 172.21.15.40:0/122793812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa750006140 0x7fa7680bc880 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.257+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 >> 172.21.15.40:0/122793812 conn(0x7fa7680c0ba0 msgr2=0x7fa768145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.257+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 shutdown_connections 2023-05-24T04:01:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.257+0000 7fa76e488640 1 -- 172.21.15.40:0/122793812 wait complete. 2023-05-24T04:01:12.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T04:01:12.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc7b6a640 1 Processor -- start 2023-05-24T04:01:12.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc7b6a640 1 -- start start 2023-05-24T04:01:12.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc7b6a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fc0152140 0x7f9fc00a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc7b6a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc014f730 con 0x7f9fc00a4860 2023-05-24T04:01:12.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc7b6a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc006eb50 con 0x7f9fc0151d70 2023-05-24T04:01:12.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc7b6a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc006f030 con 0x7f9fc0152140 2023-05-24T04:01:12.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc5105640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fc0152140 0x7f9fc00a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc5105640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fc0152140 0x7f9fc00a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49114/0 (socket says 172.21.15.40:49114) 2023-05-24T04:01:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc5105640 1 -- 172.21.15.40:0/2914795696 learned_addr learned my addr 172.21.15.40:0/2914795696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc6107640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9fc00a4860 0x7f9fc0071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51584/0 (socket says 172.21.15.40:51584) 2023-05-24T04:01:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc5105640 1 -- 172.21.15.40:0/2914795696 >> v1:172.21.15.67:6789/0 conn(0x7f9fc0151d70 legacy=0x7f9fc014f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc4904640 1 -- 172.21.15.40:0/2914795696 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682716984 0 0) 0x7f9fc014f730 con 0x7f9fc00a4860 2023-05-24T04:01:12.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc5105640 1 -- 172.21.15.40:0/2914795696 >> v1:172.21.15.40:6789/0 conn(0x7f9fc00a4860 legacy=0x7f9fc0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.389+0000 7f9fc5105640 1 -- 172.21.15.40:0/2914795696 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc01526a0 con 0x7f9fc0152140 2023-05-24T04:01:12.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 --2- 172.21.15.40:0/2914795696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0152140 0x7f9fc00a33a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009e50 tx=0x7f9fb001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16d22e5226b0ef9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc4904640 1 -- 172.21.15.40:0/2914795696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a5750 con 0x7f9fc0152140 2023-05-24T04:01:12.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc4904640 1 -- 172.21.15.40:0/2914795696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb00a58b0 con 0x7f9fc0152140 2023-05-24T04:01:12.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc4904640 1 -- 172.21.15.40:0/2914795696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a5c40 con 0x7f9fc0152140 2023-05-24T04:01:12.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/2914795696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0152140 msgr2=0x7f9fc00a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/2914795696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0152140 0x7f9fc00a33a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009e50 tx=0x7f9fb001c980 comp rx=0 tx=0).stop 2023-05-24T04:01:12.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/2914795696 shutdown_connections 2023-05-24T04:01:12.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/2914795696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0152140 0x7f9fc00a33a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/2914795696 >> 172.21.15.40:0/2914795696 conn(0x7f9fc00c0310 msgr2=0x7f9fc00c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:12.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/2914795696 shutdown_connections 2023-05-24T04:01:12.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/2914795696 wait complete. 2023-05-24T04:01:12.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 Processor -- start 2023-05-24T04:01:12.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- start start 2023-05-24T04:01:12.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fc00a4860 0x7f9fc0151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 0x7f9fc013e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc0152140 0x7f9fc013e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0144700 con 0x7f9fc0151d70 2023-05-24T04:01:12.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0143a00 con 0x7f9fc0152140 2023-05-24T04:01:12.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0143820 con 0x7f9fc00a4860 2023-05-24T04:01:12.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 0x7f9fc013e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 0x7f9fc013e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49116/0 (socket says 172.21.15.40:49116) 2023-05-24T04:01:12.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 -- 172.21.15.40:0/3796464921 learned_addr learned my addr 172.21.15.40:0/3796464921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:12.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc6107640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc0152140 0x7f9fc013e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 -- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fc00a4860 msgr2=0x7f9fc0151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fc00a4860 0x7f9fc0151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 -- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc0152140 msgr2=0x7f9fc013e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc0152140 0x7f9fc013e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 -- 172.21.15.40:0/3796464921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009b30 con 0x7f9fc0151d70 2023-05-24T04:01:12.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc5105640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 0x7f9fc013e000 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00af040 tx=0x7f9fb0019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00039a0 con 0x7f9fc0151d70 2023-05-24T04:01:12.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb0003b00 con 0x7f9fc0151d70 2023-05-24T04:01:12.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc0071e10 con 0x7f9fc0151d70 2023-05-24T04:01:12.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0003e70 con 0x7f9fc0151d70 2023-05-24T04:01:12.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.393+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc0071c80 con 0x7f9fc0151d70 2023-05-24T04:01:12.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.397+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc015c670 con 0x7f9fc0151d70 2023-05-24T04:01:12.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.397+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fb00b8650 con 0x7f9fc0151d70 2023-05-24T04:01:12.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.397+0000 7f9fbe7fc640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9fac066280 0x7f9fac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.397+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9fb011f0f0 con 0x7f9fc0151d70 2023-05-24T04:01:12.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.397+0000 7f9fc5906640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9fac066280 0x7f9fac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.397+0000 7f9fc5906640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9fac066280 0x7f9fac068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000f70 tx=0x7f9fb40079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.401+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9fb00ec250 con 0x7f9fc0151d70 2023-05-24T04:01:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.553+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9fc004ddd0 con 0x7f9fc0151d70 2023-05-24T04:01:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fbe7fc640 1 -- 172.21.15.40:0/3796464921 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fb00ef870 con 0x7f9fc0151d70 2023-05-24T04:01:12.562 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-24T04:01:12.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9fac066280 msgr2=0x7f9fac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9fac066280 0x7f9fac068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000f70 tx=0x7f9fb40079c0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 msgr2=0x7f9fc013e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 0x7f9fc013e000 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00af040 tx=0x7f9fb0019720 comp rx=0 tx=0).stop 2023-05-24T04:01:12.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 shutdown_connections 2023-05-24T04:01:12.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9fac066280 0x7f9fac068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc0152140 0x7f9fc013e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc0151d70 0x7f9fc013e000 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 --2- 172.21.15.40:0/3796464921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fc00a4860 0x7f9fc0151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 >> 172.21.15.40:0/3796464921 conn(0x7f9fc00c0310 msgr2=0x7f9fc00bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:12.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 shutdown_connections 2023-05-24T04:01:12.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.557+0000 7f9fc7b6a640 1 -- 172.21.15.40:0/3796464921 wait complete. 2023-05-24T04:01:12.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T04:01:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85fcfc640 1 Processor -- start 2023-05-24T04:01:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85fcfc640 1 -- start start 2023-05-24T04:01:12.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85fcfc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8580714c0 0x7fa85814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85fcfc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580bd750 con 0x7fa8580c0e20 2023-05-24T04:01:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85fcfc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580a4800 con 0x7fa85814b800 2023-05-24T04:01:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85fcfc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85806fe00 con 0x7fa8580714c0 2023-05-24T04:01:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8580c0e20 0x7fa85814ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51588/0 (socket says 172.21.15.40:51588) 2023-05-24T04:01:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 -- 172.21.15.40:0/1840536712 learned_addr learned my addr 172.21.15.40:0/1840536712 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85da98640 1 --2- 172.21.15.40:0/1840536712 >> v2:172.21.15.67:3300/0 conn(0x7fa8580714c0 0x7fa85814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895189898 0 0) 0x7fa8580bd750 con 0x7fa8580c0e20 2023-05-24T04:01:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa844003530 con 0x7fa8580c0e20 2023-05-24T04:01:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428840832 0 0) 0x7fa844003530 con 0x7fa8580c0e20 2023-05-24T04:01:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 >> v2:172.21.15.67:3300/0 conn(0x7fa8580714c0 msgr2=0x7fa85814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 --2- 172.21.15.40:0/1840536712 >> v2:172.21.15.67:3300/0 conn(0x7fa8580714c0 0x7fa85814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 >> v1:172.21.15.67:6789/0 conn(0x7fa85814b800 legacy=0x7fa858155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580a4ae0 con 0x7fa8580c0e20 2023-05-24T04:01:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fa848001680 con 0x7fa8580c0e20 2023-05-24T04:01:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 >> v1:172.21.15.40:6789/0 conn(0x7fa8580c0e20 legacy=0x7fa85814ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa844003980 0x7fa844003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8440047d0 0x7fa844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa844005180 0x7fa84400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84400c060 con 0x7fa8440047d0 2023-05-24T04:01:12.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84400c1d0 con 0x7fa844005180 2023-05-24T04:01:12.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84400c390 con 0x7fa844003980 2023-05-24T04:01:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8440047d0 0x7fa844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85da98640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa844003980 0x7fa844003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85e299640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa844005180 0x7fa84400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 -- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa844003980 msgr2=0x7fa844003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa844003980 0x7fa844003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 -- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa844005180 msgr2=0x7fa84400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:12.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa844005180 0x7fa84400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85d297640 1 -- 172.21.15.40:0/1840536712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844003530 con 0x7fa8440047d0 2023-05-24T04:01:12.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.709+0000 7fa85e299640 1 -- 172.21.15.40:0/1840536712 reap_dead start 2023-05-24T04:01:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85d297640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8440047d0 0x7fa844004c40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c240 tx=0x7fa84801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd9a1a24aa0f9d2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480a5b10 con 0x7fa8440047d0 2023-05-24T04:01:12.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480a5c90 con 0x7fa8440047d0 2023-05-24T04:01:12.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85ca96640 1 -- 172.21.15.40:0/1840536712 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480058e0 con 0x7fa8440047d0 2023-05-24T04:01:12.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1840536712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8440047d0 msgr2=0x7fa844004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8440047d0 0x7fa844004c40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c240 tx=0x7fa84801cc10 comp rx=0 tx=0).stop 2023-05-24T04:01:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1840536712 shutdown_connections 2023-05-24T04:01:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1840536712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8440047d0 0x7fa844004c40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1840536712 >> 172.21.15.40:0/1840536712 conn(0x7fa8580c0310 msgr2=0x7fa8580c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1840536712 shutdown_connections 2023-05-24T04:01:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1840536712 wait complete. 2023-05-24T04:01:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 Processor -- start 2023-05-24T04:01:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.713+0000 7fa85fcfc640 1 -- start start 2023-05-24T04:01:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8440047d0 0x7fa8581d7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 0x7fa8581473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa858148ad0 0x7fa858147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858147e60 con 0x7fa8580b6e50 2023-05-24T04:01:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858148820 con 0x7fa858148ad0 2023-05-24T04:01:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581480d0 con 0x7fa8440047d0 2023-05-24T04:01:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 0x7fa8581473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 0x7fa8581473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49122/0 (socket says 172.21.15.40:49122) 2023-05-24T04:01:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 -- 172.21.15.40:0/1608283042 learned_addr learned my addr 172.21.15.40:0/1608283042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85e299640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa858148ad0 0x7fa858147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85da98640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8440047d0 0x7fa8581d7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 -- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8440047d0 msgr2=0x7fa8581d7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8440047d0 0x7fa8581d7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 -- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa858148ad0 msgr2=0x7fa858147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa858148ad0 0x7fa858147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 -- 172.21.15.40:0/1608283042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858071a20 con 0x7fa8580b6e50 2023-05-24T04:01:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85e299640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa858148ad0 0x7fa858147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85d297640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 0x7fa8581473e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa84801ca40 tx=0x7fa844005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480b4070 con 0x7fa8580b6e50 2023-05-24T04:01:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848004e90 con 0x7fa8580b6e50 2023-05-24T04:01:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848000ee0 con 0x7fa8580b6e50 2023-05-24T04:01:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa858071890 con 0x7fa8580b6e50 2023-05-24T04:01:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8580a52e0 con 0x7fa8580b6e50 2023-05-24T04:01:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85804ddd0 con 0x7fa8580b6e50 2023-05-24T04:01:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa848001480 con 0x7fa8580b6e50 2023-05-24T04:01:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa84e7fc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa83c0662b0 0x7fa83c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa84811db50 con 0x7fa8580b6e50 2023-05-24T04:01:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.717+0000 7fa85da98640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa83c0662b0 0x7fa83c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.721+0000 7fa85da98640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa83c0662b0 0x7fa83c068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa854009ab0 tx=0x7fa854008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.721+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa8480ead40 con 0x7fa8580b6e50 2023-05-24T04:01:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.877+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8580b52a0 con 0x7fa8580b6e50 2023-05-24T04:01:12.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.877+0000 7fa84e7fc640 1 -- 172.21.15.40:0/1608283042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8480ee360 con 0x7fa8580b6e50 2023-05-24T04:01:12.884 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa83c0662b0 msgr2=0x7fa83c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa83c0662b0 0x7fa83c068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa854009ab0 tx=0x7fa854008040 comp rx=0 tx=0).stop 2023-05-24T04:01:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 msgr2=0x7fa8581473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 0x7fa8581473e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa84801ca40 tx=0x7fa844005800 comp rx=0 tx=0).stop 2023-05-24T04:01:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 shutdown_connections 2023-05-24T04:01:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fa83c0662b0 0x7fa83c068760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa858148ad0 0x7fa858147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8580b6e50 0x7fa8581473e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 --2- 172.21.15.40:0/1608283042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8440047d0 0x7fa8581d7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 >> 172.21.15.40:0/1608283042 conn(0x7fa8580c0310 msgr2=0x7fa85806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:12.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 shutdown_connections 2023-05-24T04:01:12.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:12.881+0000 7fa85fcfc640 1 -- 172.21.15.40:0/1608283042 wait complete. 2023-05-24T04:01:12.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T04:01:13.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.025+0000 7f484071a640 1 Processor -- start 2023-05-24T04:01:13.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.025+0000 7f484071a640 1 -- start start 2023-05-24T04:01:13.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f484071a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48380a4d10 0x7f48380bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f484071a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380bdb60 0x7f4838155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f484071a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4838148760 con 0x7f4838148390 2023-05-24T04:01:13.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f484071a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483806eac0 con 0x7f48380a4d10 2023-05-24T04:01:13.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f484071a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380702d0 con 0x7f48380bdb60 2023-05-24T04:01:13.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483dcb5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48380a4d10 0x7f48380bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483ecb7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380bdb60 0x7f4838155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483e4b6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4838148390 0x7f4838071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:44682/0 (socket says 172.21.15.40:44682) 2023-05-24T04:01:13.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483e4b6640 1 -- 172.21.15.40:0/3571947868 learned_addr learned my addr 172.21.15.40:0/3571947868 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:13.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483dcb5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48380a4d10 0x7f48380bd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:60408/0 (socket says 172.21.15.40:60408) 2023-05-24T04:01:13.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483d4b4640 1 -- 172.21.15.40:0/3571947868 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124706200 0 0) 0x7f4838148760 con 0x7f4838148390 2023-05-24T04:01:13.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483d4b4640 1 -- 172.21.15.40:0/3571947868 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4824003530 con 0x7f4838148390 2023-05-24T04:01:13.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483dcb5640 1 -- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380bdb60 msgr2=0x7f4838155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:13.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483dcb5640 1 --2- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380bdb60 0x7f4838155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483dcb5640 1 -- 172.21.15.40:0/3571947868 >> v1:172.21.15.67:6789/0 conn(0x7f4838148390 legacy=0x7f4838071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483dcb5640 1 -- 172.21.15.40:0/3571947868 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380a5150 con 0x7f48380a4d10 2023-05-24T04:01:13.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.029+0000 7f483ecb7640 1 --2- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380bdb60 0x7f4838155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:01:13.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f483dcb5640 1 --2- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380a4d10 0x7f48380bd620 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f482800a960 tx=0x7f482801d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd9ecbc5926ac27 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f483d4b4640 1 -- 172.21.15.40:0/3571947868 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280a6850 con 0x7f48380a4d10 2023-05-24T04:01:13.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f483d4b4640 1 -- 172.21.15.40:0/3571947868 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48280a69b0 con 0x7f48380a4d10 2023-05-24T04:01:13.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f483d4b4640 1 -- 172.21.15.40:0/3571947868 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280a6d20 con 0x7f48380a4d10 2023-05-24T04:01:13.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380a4d10 msgr2=0x7f48380bd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 --2- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380a4d10 0x7f48380bd620 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f482800a960 tx=0x7f482801d820 comp rx=0 tx=0).stop 2023-05-24T04:01:13.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- 172.21.15.40:0/3571947868 shutdown_connections 2023-05-24T04:01:13.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 --2- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380bdb60 0x7f4838155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 --2- 172.21.15.40:0/3571947868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380a4d10 0x7f48380bd620 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- 172.21.15.40:0/3571947868 >> 172.21.15.40:0/3571947868 conn(0x7f48380c0310 msgr2=0x7f48380c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:13.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- 172.21.15.40:0/3571947868 shutdown_connections 2023-05-24T04:01:13.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- 172.21.15.40:0/3571947868 wait complete. 2023-05-24T04:01:13.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 Processor -- start 2023-05-24T04:01:13.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- start start 2023-05-24T04:01:13.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380a4d10 0x7f4838140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 0x7f4838154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838148390 0x7f4838154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381422a0 con 0x7f48380bdb60 2023-05-24T04:01:13.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838140a60 con 0x7f4838148390 2023-05-24T04:01:13.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.033+0000 7f484071a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4838142540 con 0x7f48380a4d10 2023-05-24T04:01:13.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 0x7f4838154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 0x7f4838154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49128/0 (socket says 172.21.15.40:49128) 2023-05-24T04:01:13.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 -- 172.21.15.40:0/2904135497 learned_addr learned my addr 172.21.15.40:0/2904135497 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:13.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483ecb7640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838148390 0x7f4838154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483e4b6640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380a4d10 0x7f4838140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 -- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380a4d10 msgr2=0x7f4838140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380a4d10 0x7f4838140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 -- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838148390 msgr2=0x7f4838154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838148390 0x7f4838154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 -- 172.21.15.40:0/2904135497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830009a70 con 0x7f48380bdb60 2023-05-24T04:01:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483ecb7640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838148390 0x7f4838154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483dcb5640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 0x7f4838154750 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4828000c10 tx=0x7f482801a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280a6850 con 0x7f48380bdb60 2023-05-24T04:01:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828004450 con 0x7f48380bdb60 2023-05-24T04:01:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828003820 con 0x7f48380bdb60 2023-05-24T04:01:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482800a5c0 con 0x7f48380bdb60 2023-05-24T04:01:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380c1100 con 0x7f48380bdb60 2023-05-24T04:01:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483806ed10 con 0x7f48380bdb60 2023-05-24T04:01:13.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48280b5040 con 0x7f48380bdb60 2023-05-24T04:01:13.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f482effd640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f481c066280 0x7f481c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483e4b6640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f481c066280 0x7f481c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f482811e570 con 0x7f48380bdb60 2023-05-24T04:01:13.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.037+0000 7f483e4b6640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f481c066280 0x7f481c068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4834005890 tx=0x7f4834009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.041+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48280eb870 con 0x7f48380bdb60 2023-05-24T04:01:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.193+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48380bc8e0 con 0x7f48380bdb60 2023-05-24T04:01:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f482effd640 1 -- 172.21.15.40:0/2904135497 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48280eee90 con 0x7f48380bdb60 2023-05-24T04:01:13.202 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-24T04:01:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f481c066280 msgr2=0x7f481c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f481c066280 0x7f481c068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4834005890 tx=0x7f4834009040 comp rx=0 tx=0).stop 2023-05-24T04:01:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 msgr2=0x7f4838154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 0x7f4838154750 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4828000c10 tx=0x7f482801a5c0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 shutdown_connections 2023-05-24T04:01:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f481c066280 0x7f481c068730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838148390 0x7f4838154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48380bdb60 0x7f4838154750 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 --2- 172.21.15.40:0/2904135497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48380a4d10 0x7f4838140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 >> 172.21.15.40:0/2904135497 conn(0x7f48380c0310 msgr2=0x7f48381451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 shutdown_connections 2023-05-24T04:01:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.197+0000 7f484071a640 1 -- 172.21.15.40:0/2904135497 wait complete. 2023-05-24T04:01:13.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T04:01:13.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 Processor -- start 2023-05-24T04:01:13.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 -- start start 2023-05-24T04:01:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b3014b000 0x7f7b3014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b300bd1a0 0x7f7b3014bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3014f7a0 con 0x7f7b3006d020 2023-05-24T04:01:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3014f240 con 0x7f7b3014b000 2023-05-24T04:01:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b37152640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300bb850 con 0x7f7b300bd1a0 2023-05-24T04:01:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b2ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b3014b000 0x7f7b3014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b356ef640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b300bd1a0 0x7f7b3014bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b34eee640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7b3006d020 0x7f7b3014a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:44684/0 (socket says 172.21.15.40:44684) 2023-05-24T04:01:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b2ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b3014b000 0x7f7b3014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:60412/0 (socket says 172.21.15.40:60412) 2023-05-24T04:01:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b34eee640 1 -- 172.21.15.40:0/2609300452 learned_addr learned my addr 172.21.15.40:0/2609300452 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b2ffff640 1 -- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b300bd1a0 msgr2=0x7f7b3014bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b2ffff640 1 --2- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b300bd1a0 0x7f7b3014bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b2ffff640 1 -- 172.21.15.40:0/2609300452 >> v1:172.21.15.67:6789/0 conn(0x7f7b3006d020 legacy=0x7f7b3014a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.345+0000 7f7b2ffff640 1 -- 172.21.15.40:0/2609300452 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3014c430 con 0x7f7b3014b000 2023-05-24T04:01:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b2ffff640 1 --2- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b000 0x7f7b3014b9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097c0 tx=0x7f7b2401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f294d06945ae05f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b2f7fe640 1 -- 172.21.15.40:0/2609300452 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240ab650 con 0x7f7b3014b000 2023-05-24T04:01:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b2f7fe640 1 -- 172.21.15.40:0/2609300452 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240ab7b0 con 0x7f7b3014b000 2023-05-24T04:01:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b2f7fe640 1 -- 172.21.15.40:0/2609300452 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240abb40 con 0x7f7b3014b000 2023-05-24T04:01:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 -- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b000 msgr2=0x7f7b3014b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 --2- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b000 0x7f7b3014b9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097c0 tx=0x7f7b2401c450 comp rx=0 tx=0).stop 2023-05-24T04:01:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 -- 172.21.15.40:0/2609300452 shutdown_connections 2023-05-24T04:01:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 --2- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b300bd1a0 0x7f7b3014bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 --2- 172.21.15.40:0/2609300452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b000 0x7f7b3014b9b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 -- 172.21.15.40:0/2609300452 >> 172.21.15.40:0/2609300452 conn(0x7f7b300c1420 msgr2=0x7f7b300c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 -- 172.21.15.40:0/2609300452 shutdown_connections 2023-05-24T04:01:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.349+0000 7f7b37152640 1 -- 172.21.15.40:0/2609300452 wait complete. 2023-05-24T04:01:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 Processor -- start 2023-05-24T04:01:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- start start 2023-05-24T04:01:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3006d020 0x7f7b3014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 0x7f7b30145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b3014b000 0x7f7b3013c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3014ef50 con 0x7f7b300bd1a0 2023-05-24T04:01:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3013e7b0 con 0x7f7b3006d020 2023-05-24T04:01:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b301e89c0 con 0x7f7b3014b000 2023-05-24T04:01:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 0x7f7b30145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 0x7f7b30145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49130/0 (socket says 172.21.15.40:49130) 2023-05-24T04:01:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 -- 172.21.15.40:0/913641106 learned_addr learned my addr 172.21.15.40:0/913641106 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b34eee640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3006d020 0x7f7b3014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b356ef640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b3014b000 0x7f7b3013c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 -- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b3014b000 msgr2=0x7f7b3013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b3014b000 0x7f7b3013c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 -- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3006d020 msgr2=0x7f7b3014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3006d020 0x7f7b3014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 -- 172.21.15.40:0/913641106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009420 con 0x7f7b300bd1a0 2023-05-24T04:01:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2ffff640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 0x7f7b30145490 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7b2401a080 tx=0x7f7b240191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240abdf0 con 0x7f7b300bd1a0 2023-05-24T04:01:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240bf450 con 0x7f7b300bd1a0 2023-05-24T04:01:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3006d580 con 0x7f7b300bd1a0 2023-05-24T04:01:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240bf7e0 con 0x7f7b300bd1a0 2023-05-24T04:01:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3006d3f0 con 0x7f7b300bd1a0 2023-05-24T04:01:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.353+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b301563a0 con 0x7f7b300bd1a0 2023-05-24T04:01:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.357+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b240bf940 con 0x7f7b300bd1a0 2023-05-24T04:01:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.357+0000 7f7b2d7fa640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b1c066280 0x7f7b1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.357+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b2411ee70 con 0x7f7b300bd1a0 2023-05-24T04:01:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.357+0000 7f7b34eee640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b1c066280 0x7f7b1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.357+0000 7f7b34eee640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b1c066280 0x7f7b1c068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005c10 tx=0x7f7b28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.361+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7b240ec250 con 0x7f7b300bd1a0 2023-05-24T04:01:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.513+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7b30066d70 con 0x7f7b300bd1a0 2023-05-24T04:01:13.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.513+0000 7f7b2d7fa640 1 -- 172.21.15.40:0/913641106 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7b240ef870 con 0x7f7b300bd1a0 2023-05-24T04:01:13.530 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-24T04:01:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b1c066280 msgr2=0x7f7b1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b1c066280 0x7f7b1c068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005c10 tx=0x7f7b28009040 comp rx=0 tx=0).stop 2023-05-24T04:01:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 msgr2=0x7f7b30145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 0x7f7b30145490 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7b2401a080 tx=0x7f7b240191f0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 shutdown_connections 2023-05-24T04:01:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7b1c066280 0x7f7b1c068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b3014b000 0x7f7b3013c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b300bd1a0 0x7f7b30145490 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 --2- 172.21.15.40:0/913641106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3006d020 0x7f7b3014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 >> 172.21.15.40:0/913641106 conn(0x7f7b300c1420 msgr2=0x7f7b3014b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 shutdown_connections 2023-05-24T04:01:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.517+0000 7f7b37152640 1 -- 172.21.15.40:0/913641106 wait complete. 2023-05-24T04:01:13.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T04:01:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 Processor -- start 2023-05-24T04:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 -- start start 2023-05-24T04:01:13.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24100a52f0 0x7f241014a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2410070c50 0x7f24100710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24100bcb70 con 0x7f241014a340 2023-05-24T04:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24100a4da0 con 0x7f24100a52f0 2023-05-24T04:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2415133640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100bc800 con 0x7f2410070c50 2023-05-24T04:01:13.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24100a52f0 0x7f241014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24100a52f0 0x7f241014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49146/0 (socket says 172.21.15.40:49146) 2023-05-24T04:01:13.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f240ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f241014a340 0x7f241006c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51594/0 (socket says 172.21.15.40:51594) 2023-05-24T04:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 -- 172.21.15.40:0/2706088382 learned_addr learned my addr 172.21.15.40:0/2706088382 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f240f59e640 1 --2- 172.21.15.40:0/2706088382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2410070c50 0x7f24100710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 -- 172.21.15.40:0/2706088382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2410070c50 msgr2=0x7f24100710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 --2- 172.21.15.40:0/2706088382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2410070c50 0x7f24100710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 -- 172.21.15.40:0/2706088382 >> v1:172.21.15.40:6789/0 conn(0x7f241014a340 legacy=0x7f241006c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.665+0000 7f2407fff640 1 -- 172.21.15.40:0/2706088382 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241006ca60 con 0x7f24100a52f0 2023-05-24T04:01:13.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2407fff640 1 --2- 172.21.15.40:0/2706088382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24100a52f0 0x7f241014a710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009870 tx=0x7f23f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7121c25c7a394087 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f240e59c640 1 -- 172.21.15.40:0/2706088382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f80ab600 con 0x7f24100a52f0 2023-05-24T04:01:13.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f240e59c640 1 -- 172.21.15.40:0/2706088382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f80a7050 con 0x7f24100a52f0 2023-05-24T04:01:13.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f240e59c640 1 -- 172.21.15.40:0/2706088382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f80ab980 con 0x7f24100a52f0 2023-05-24T04:01:13.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- 172.21.15.40:0/2706088382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24100a52f0 msgr2=0x7f241014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 --2- 172.21.15.40:0/2706088382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24100a52f0 0x7f241014a710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009870 tx=0x7f23f801c4b0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- 172.21.15.40:0/2706088382 shutdown_connections 2023-05-24T04:01:13.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 --2- 172.21.15.40:0/2706088382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24100a52f0 0x7f241014a710 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 --2- 172.21.15.40:0/2706088382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2410070c50 0x7f24100710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- 172.21.15.40:0/2706088382 >> 172.21.15.40:0/2706088382 conn(0x7f24100c0280 msgr2=0x7f24100c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:13.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- 172.21.15.40:0/2706088382 shutdown_connections 2023-05-24T04:01:13.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- 172.21.15.40:0/2706088382 wait complete. 2023-05-24T04:01:13.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 Processor -- start 2023-05-24T04:01:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- start start 2023-05-24T04:01:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 0x7f2410146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24100a52f0 0x7f24101457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241014a340 0x7f2410141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24100bf4d0 con 0x7f2410070c50 2023-05-24T04:01:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241014c850 con 0x7f241014a340 2023-05-24T04:01:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f2415133640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241014caf0 con 0x7f24100a52f0 2023-05-24T04:01:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f240ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 0x7f2410146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f240ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 0x7f2410146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49148/0 (socket says 172.21.15.40:49148) 2023-05-24T04:01:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.669+0000 7f240ed9d640 1 -- 172.21.15.40:0/982876664 learned_addr learned my addr 172.21.15.40:0/982876664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f2407fff640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24100a52f0 0x7f24101457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240ed9d640 1 -- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24100a52f0 msgr2=0x7f24101457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240f59e640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241014a340 0x7f2410141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240ed9d640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24100a52f0 0x7f24101457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240ed9d640 1 -- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241014a340 msgr2=0x7f2410141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240ed9d640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241014a340 0x7f2410141280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240ed9d640 1 -- 172.21.15.40:0/982876664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80094d0 con 0x7f2410070c50 2023-05-24T04:01:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f240ed9d640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 0x7f2410146b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f240000c430 tx=0x7f240000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000074e0 con 0x7f2410070c50 2023-05-24T04:01:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2400007640 con 0x7f2410070c50 2023-05-24T04:01:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241006d1c0 con 0x7f2410070c50 2023-05-24T04:01:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400004a10 con 0x7f2410070c50 2023-05-24T04:01:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241006d030 con 0x7f2410070c50 2023-05-24T04:01:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24101551f0 con 0x7f2410070c50 2023-05-24T04:01:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2400004b70 con 0x7f2410070c50 2023-05-24T04:01:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f24077fe640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f0066280 0x7f23f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:13.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f24000839f0 con 0x7f2410070c50 2023-05-24T04:01:13.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f2407fff640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f0066280 0x7f23f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:13.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.673+0000 7f2407fff640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f0066280 0x7f23f0068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f23f80ad000 tx=0x7f23f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:13.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.677+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2400050bd0 con 0x7f2410070c50 2023-05-24T04:01:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f241014cc60 con 0x7f2410070c50 2023-05-24T04:01:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f24077fe640 1 -- 172.21.15.40:0/982876664 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f24000541f0 con 0x7f2410070c50 2023-05-24T04:01:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-24T04:01:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f0066280 msgr2=0x7f23f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f0066280 0x7f23f0068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f23f80ad000 tx=0x7f23f8008040 comp rx=0 tx=0).stop 2023-05-24T04:01:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 msgr2=0x7f2410146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 0x7f2410146b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f240000c430 tx=0x7f240000c8f0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 shutdown_connections 2023-05-24T04:01:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f23f0066280 0x7f23f0068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f241014a340 0x7f2410141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24100a52f0 0x7f24101457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 --2- 172.21.15.40:0/982876664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2410070c50 0x7f2410146b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 >> 172.21.15.40:0/982876664 conn(0x7f24100c0280 msgr2=0x7f241006c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 shutdown_connections 2023-05-24T04:01:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:13.841+0000 7f2415133640 1 -- 172.21.15.40:0/982876664 wait complete. 2023-05-24T04:01:13.864 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi162.front.sepia.ceph.com... 2023-05-24T04:01:13.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:13.865 DEBUG:teuthology.orchestra.run.smithi162:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-24T04:01:13.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi162.stderr:ceph-fuse[32313]: fuse finished with error 0 and tester_r 0 2023-05-24T04:01:13.885 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:01:13.932 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2023-05-24T04:01:13.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:13.934 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-24T04:01:13.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:13.996 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-05-24T04:01:14.030 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 0) 2023-05-24T04:01:14.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-24T04:01:14.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.086 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-05-24T04:01:14.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.328 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-05-24T04:01:14.335 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-24T04:01:14.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-24T04:01:14.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.394 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2023-05-24T04:01:14.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.581 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-05-24T04:01:14.588 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-24T04:01:14.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.590 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-24T04:01:14.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T04:01:14.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-05-24T04:01:14.827 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-05-24T04:01:14.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-24T04:01:14.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:01:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 Processor -- start 2023-05-24T04:01:14.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 -- start start 2023-05-24T04:01:14.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda20070c90 0x7fda20151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fda2006aaf0 0x7fda20152360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006b040 0x7fda200bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda20151990 con 0x7fda20070c90 2023-05-24T04:01:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda201528a0 con 0x7fda2006aaf0 2023-05-24T04:01:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda2640f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2006e8d0 con 0x7fda2006b040 2023-05-24T04:01:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda20070c90 0x7fda20151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda20070c90 0x7fda20151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49162/0 (socket says 172.21.15.40:49162) 2023-05-24T04:01:14.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 -- 172.21.15.40:0/1043851425 learned_addr learned my addr 172.21.15.40:0/1043851425 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:14.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1f7fe640 1 --2- 172.21.15.40:0/1043851425 >> v2:172.21.15.67:3300/0 conn(0x7fda2006aaf0 0x7fda20152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda249ac640 1 --2- 172.21.15.40:0/1043851425 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006b040 0x7fda200bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 -- 172.21.15.40:0/1043851425 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006b040 msgr2=0x7fda200bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:14.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 --2- 172.21.15.40:0/1043851425 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006b040 0x7fda200bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 -- 172.21.15.40:0/1043851425 >> v2:172.21.15.67:3300/0 conn(0x7fda2006aaf0 msgr2=0x7fda20152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:14.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 --2- 172.21.15.40:0/1043851425 >> v2:172.21.15.67:3300/0 conn(0x7fda2006aaf0 0x7fda20152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.969+0000 7fda1ffff640 1 -- 172.21.15.40:0/1043851425 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2006ed80 con 0x7fda20070c90 2023-05-24T04:01:14.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1ffff640 1 --2- 172.21.15.40:0/1043851425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda20151e20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fda200664f0 tx=0x7fda1001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d459a2fb4096ac server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:14.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1effd640 1 -- 172.21.15.40:0/1043851425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100ab600 con 0x7fda20070c90 2023-05-24T04:01:14.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1effd640 1 -- 172.21.15.40:0/1043851425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda100a7050 con 0x7fda20070c90 2023-05-24T04:01:14.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1effd640 1 -- 172.21.15.40:0/1043851425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100ab980 con 0x7fda20070c90 2023-05-24T04:01:14.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- 172.21.15.40:0/1043851425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 msgr2=0x7fda20151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:14.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- 172.21.15.40:0/1043851425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda20151e20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fda200664f0 tx=0x7fda1001c210 comp rx=0 tx=0).stop 2023-05-24T04:01:14.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- 172.21.15.40:0/1043851425 shutdown_connections 2023-05-24T04:01:14.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- 172.21.15.40:0/1043851425 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006b040 0x7fda200bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- 172.21.15.40:0/1043851425 >> v2:172.21.15.67:3300/0 conn(0x7fda2006aaf0 0x7fda20152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- 172.21.15.40:0/1043851425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda20151e20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- 172.21.15.40:0/1043851425 >> 172.21.15.40:0/1043851425 conn(0x7fda200c2510 msgr2=0x7fda200c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:14.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- 172.21.15.40:0/1043851425 shutdown_connections 2023-05-24T04:01:14.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- 172.21.15.40:0/1043851425 wait complete. 2023-05-24T04:01:14.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 Processor -- start 2023-05-24T04:01:14.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- start start 2023-05-24T04:01:14.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006aaf0 0x7fda201499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda2006b040 0x7fda20143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda201e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201e6670 con 0x7fda20070c90 2023-05-24T04:01:14.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201ea5c0 con 0x7fda2006b040 2023-05-24T04:01:14.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda2640f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda201e6300 con 0x7fda2006aaf0 2023-05-24T04:01:14.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda201e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda201e6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49172/0 (socket says 172.21.15.40:49172) 2023-05-24T04:01:14.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 -- 172.21.15.40:0/3864738100 learned_addr learned my addr 172.21.15.40:0/3864738100 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:14.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1f7fe640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda2006b040 0x7fda20143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1ffff640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006aaf0 0x7fda201499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 -- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006aaf0 msgr2=0x7fda201499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:14.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006aaf0 0x7fda201499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 -- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda2006b040 msgr2=0x7fda20143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:14.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda2006b040 0x7fda20143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:14.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda249ac640 1 -- 172.21.15.40:0/3864738100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda100094d0 con 0x7fda20070c90 2023-05-24T04:01:14.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.973+0000 7fda1ffff640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006aaf0 0x7fda201499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:14.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda249ac640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda201e6b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fda18007e40 tx=0x7fda1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:14.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18014620 con 0x7fda20070c90 2023-05-24T04:01:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800ee90 con 0x7fda20070c90 2023-05-24T04:01:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2014d9d0 con 0x7fda20070c90 2023-05-24T04:01:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180149e0 con 0x7fda20070c90 2023-05-24T04:01:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2014d840 con 0x7fda20070c90 2023-05-24T04:01:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2014db60 con 0x7fda20070c90 2023-05-24T04:01:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda18014b40 con 0x7fda20070c90 2023-05-24T04:01:14.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1cff9640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fda0c0662b0 0x7fda0c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:14.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1ffff640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fda0c0662b0 0x7fda0c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:14.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda180849a0 con 0x7fda20070c90 2023-05-24T04:01:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.977+0000 7fda1ffff640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fda0c0662b0 0x7fda0c068760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda100ad000 tx=0x7fda10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:14.981+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fda18051a50 con 0x7fda20070c90 2023-05-24T04:01:15.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.125+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda2004ddd0 con 0x7fda0c0662b0 2023-05-24T04:01:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.141+0000 7fda1cff9640 1 -- 172.21.15.40:0/3864738100 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389905 (secure 0 0 0) 0x7fda2004ddd0 con 0x7fda0c0662b0 2023-05-24T04:01:15.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:01:15.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fda0c0662b0 msgr2=0x7fda0c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fda0c0662b0 0x7fda0c068760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda100ad000 tx=0x7fda10008040 comp rx=0 tx=0).stop 2023-05-24T04:01:15.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 msgr2=0x7fda201e6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda201e6b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fda18007e40 tx=0x7fda1800e4b0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 shutdown_connections 2023-05-24T04:01:15.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fda0c0662b0 0x7fda0c068760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda20070c90 0x7fda201e6b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda2006b040 0x7fda20143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 --2- 172.21.15.40:0/3864738100 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fda2006aaf0 0x7fda201499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 >> 172.21.15.40:0/3864738100 conn(0x7fda200c2510 msgr2=0x7fda200c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:15.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 shutdown_connections 2023-05-24T04:01:15.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.145+0000 7fda2640f640 1 -- 172.21.15.40:0/3864738100 wait complete. 2023-05-24T04:01:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-05-24T04:01:14.549126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596609,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005161"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098134+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:40.098134+0000","last_peered":"2023-05-24T04:00:40.098134+0000","last_clean":"2023-05-24T04:00:40.098134+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:40.098134+0000","last_undegraded":"2023-05-24T04:00:40.098134+0000","last_fullsized":"2023-05-24T04:00:40.098134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:25:30.173497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811843+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:39.811843+0000","last_peered":"2023-05-24T04:00:39.811843+0000","last_clean":"2023-05-24T04:00:39.811843+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:39.811843+0000","last_undegraded":"2023-05-24T04:00:39.811843+0000","last_fullsized":"2023-05-24T04:00:39.811843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808631+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808631+0000","last_peered":"2023-05-24T04:00:39.808631+0000","last_clean":"2023-05-24T04:00:39.808631+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808631+0000","last_undegraded":"2023-05-24T04:00:39.808631+0000","last_fullsized":"2023-05-24T04:00:39.808631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:47:07.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807713+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807713+0000","last_peered":"2023-05-24T04:00:39.807713+0000","last_clean":"2023-05-24T04:00:39.807713+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807713+0000","last_undegraded":"2023-05-24T04:00:39.807713+0000","last_fullsized":"2023-05-24T04:00:39.807713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:54:29.409167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101558+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:40.101558+0000","last_peered":"2023-05-24T04:00:40.101558+0000","last_clean":"2023-05-24T04:00:40.101558+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:40.101558+0000","last_undegraded":"2023-05-24T04:00:40.101558+0000","last_fullsized":"2023-05-24T04:00:40.101558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:49:14.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100127+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:40.100127+0000","last_peered":"2023-05-24T04:00:40.100127+0000","last_clean":"2023-05-24T04:00:40.100127+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:40.100127+0000","last_undegraded":"2023-05-24T04:00:40.100127+0000","last_fullsized":"2023-05-24T04:00:40.100127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101621+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101621+0000","last_peered":"2023-05-24T04:00:40.101621+0000","last_clean":"2023-05-24T04:00:40.101621+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101621+0000","last_undegraded":"2023-05-24T04:00:40.101621+0000","last_fullsized":"2023-05-24T04:00:40.101621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102900+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:40.102900+0000","last_peered":"2023-05-24T04:00:40.102900+0000","last_clean":"2023-05-24T04:00:40.102900+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:40.102900+0000","last_undegraded":"2023-05-24T04:00:40.102900+0000","last_fullsized":"2023-05-24T04:00:40.102900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809068+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:39.809068+0000","last_peered":"2023-05-24T04:00:39.809068+0000","last_clean":"2023-05-24T04:00:39.809068+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:39.809068+0000","last_undegraded":"2023-05-24T04:00:39.809068+0000","last_fullsized":"2023-05-24T04:00:39.809068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:12:56.539054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099216+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099216+0000","last_peered":"2023-05-24T04:00:40.099216+0000","last_clean":"2023-05-24T04:00:40.099216+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099216+0000","last_undegraded":"2023-05-24T04:00:40.099216+0000","last_fullsized":"2023-05-24T04:00:40.099216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101865+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:40.101865+0000","last_peered":"2023-05-24T04:00:40.101865+0000","last_clean":"2023-05-24T04:00:40.101865+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:40.101865+0000","last_undegraded":"2023-05-24T04:00:40.101865+0000","last_fullsized":"2023-05-24T04:00:40.101865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:54.557612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809755+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:39.809755+0000","last_peered":"2023-05-24T04:00:39.809755+0000","last_clean":"2023-05-24T04:00:39.809755+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:39.809755+0000","last_undegraded":"2023-05-24T04:00:39.809755+0000","last_fullsized":"2023-05-24T04:00:39.809755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:45.203491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102303+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:40.102303+0000","last_peered":"2023-05-24T04:00:40.102303+0000","last_clean":"2023-05-24T04:00:40.102303+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:40.102303+0000","last_undegraded":"2023-05-24T04:00:40.102303+0000","last_fullsized":"2023-05-24T04:00:40.102303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:04:41.791492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811965+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:39.811965+0000","last_peered":"2023-05-24T04:00:39.811965+0000","last_clean":"2023-05-24T04:00:39.811965+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:39.811965+0000","last_undegraded":"2023-05-24T04:00:39.811965+0000","last_fullsized":"2023-05-24T04:00:39.811965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806100+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:39.806100+0000","last_peered":"2023-05-24T04:00:39.806100+0000","last_clean":"2023-05-24T04:00:39.806100+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:39.806100+0000","last_undegraded":"2023-05-24T04:00:39.806100+0000","last_fullsized":"2023-05-24T04:00:39.806100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:37:15.796537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809729+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:39.809729+0000","last_peered":"2023-05-24T04:00:39.809729+0000","last_clean":"2023-05-24T04:00:39.809729+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:39.809729+0000","last_undegraded":"2023-05-24T04:00:39.809729+0000","last_fullsized":"2023-05-24T04:00:39.809729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:06:22.746009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101645+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:40.101645+0000","last_peered":"2023-05-24T04:00:40.101645+0000","last_clean":"2023-05-24T04:00:40.101645+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:40.101645+0000","last_undegraded":"2023-05-24T04:00:40.101645+0000","last_fullsized":"2023-05-24T04:00:40.101645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:20:52.502756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812080+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:39.812080+0000","last_peered":"2023-05-24T04:00:39.812080+0000","last_clean":"2023-05-24T04:00:39.812080+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:39.812080+0000","last_undegraded":"2023-05-24T04:00:39.812080+0000","last_fullsized":"2023-05-24T04:00:39.812080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:31.402385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811197+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:39.811197+0000","last_peered":"2023-05-24T04:00:39.811197+0000","last_clean":"2023-05-24T04:00:39.811197+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:39.811197+0000","last_undegraded":"2023-05-24T04:00:39.811197+0000","last_fullsized":"2023-05-24T04:00:39.811197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810982+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:39.810982+0000","last_peered":"2023-05-24T04:00:39.810982+0000","last_clean":"2023-05-24T04:00:39.810982+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:39.810982+0000","last_undegraded":"2023-05-24T04:00:39.810982+0000","last_fullsized":"2023-05-24T04:00:39.810982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099052+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:40.099052+0000","last_peered":"2023-05-24T04:00:40.099052+0000","last_clean":"2023-05-24T04:00:40.099052+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:40.099052+0000","last_undegraded":"2023-05-24T04:00:40.099052+0000","last_fullsized":"2023-05-24T04:00:40.099052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:23.810199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812582+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:39.812582+0000","last_peered":"2023-05-24T04:00:39.812582+0000","last_clean":"2023-05-24T04:00:39.812582+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:39.812582+0000","last_undegraded":"2023-05-24T04:00:39.812582+0000","last_fullsized":"2023-05-24T04:00:39.812582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098638+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:40.098638+0000","last_peered":"2023-05-24T04:00:40.098638+0000","last_clean":"2023-05-24T04:00:40.098638+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:40.098638+0000","last_undegraded":"2023-05-24T04:00:40.098638+0000","last_fullsized":"2023-05-24T04:00:40.098638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812113+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:39.812113+0000","last_peered":"2023-05-24T04:00:39.812113+0000","last_clean":"2023-05-24T04:00:39.812113+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:39.812113+0000","last_undegraded":"2023-05-24T04:00:39.812113+0000","last_fullsized":"2023-05-24T04:00:39.812113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808823+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:39.808823+0000","last_peered":"2023-05-24T04:00:39.808823+0000","last_clean":"2023-05-24T04:00:39.808823+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:39.808823+0000","last_undegraded":"2023-05-24T04:00:39.808823+0000","last_fullsized":"2023-05-24T04:00:39.808823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:36.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099608+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:40.099608+0000","last_peered":"2023-05-24T04:00:40.099608+0000","last_clean":"2023-05-24T04:00:40.099608+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:40.099608+0000","last_undegraded":"2023-05-24T04:00:40.099608+0000","last_fullsized":"2023-05-24T04:00:40.099608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:13.713373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103289+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:40.103289+0000","last_peered":"2023-05-24T04:00:40.103289+0000","last_clean":"2023-05-24T04:00:40.103289+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:40.103289+0000","last_undegraded":"2023-05-24T04:00:40.103289+0000","last_fullsized":"2023-05-24T04:00:40.103289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098253+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:40.098253+0000","last_peered":"2023-05-24T04:00:40.098253+0000","last_clean":"2023-05-24T04:00:40.098253+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:40.098253+0000","last_undegraded":"2023-05-24T04:00:40.098253+0000","last_fullsized":"2023-05-24T04:00:40.098253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100587+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:40.100587+0000","last_peered":"2023-05-24T04:00:40.100587+0000","last_clean":"2023-05-24T04:00:40.100587+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:40.100587+0000","last_undegraded":"2023-05-24T04:00:40.100587+0000","last_fullsized":"2023-05-24T04:00:40.100587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100516+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:40.100516+0000","last_peered":"2023-05-24T04:00:40.100516+0000","last_clean":"2023-05-24T04:00:40.100516+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:40.100516+0000","last_undegraded":"2023-05-24T04:00:40.100516+0000","last_fullsized":"2023-05-24T04:00:40.100516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:25:01.484129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099676+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099676+0000","last_peered":"2023-05-24T04:00:40.099676+0000","last_clean":"2023-05-24T04:00:40.099676+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099676+0000","last_undegraded":"2023-05-24T04:00:40.099676+0000","last_fullsized":"2023-05-24T04:00:40.099676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:49.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'16","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:52.682070+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:52.682070+0000","last_peered":"2023-05-24T04:00:52.682070+0000","last_clean":"2023-05-24T04:00:52.682070+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:52.682070+0000","last_undegraded":"2023-05-24T04:00:52.682070+0000","last_fullsized":"2023-05-24T04:00:52.682070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:13.476915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5443,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:39:14.636334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099694+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:40.099694+0000","last_peered":"2023-05-24T04:00:40.099694+0000","last_clean":"2023-05-24T04:00:40.099694+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:40.099694+0000","last_undegraded":"2023-05-24T04:00:40.099694+0000","last_fullsized":"2023-05-24T04:00:40.099694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:00.182042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808228+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:39.808228+0000","last_peered":"2023-05-24T04:00:39.808228+0000","last_clean":"2023-05-24T04:00:39.808228+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:39.808228+0000","last_undegraded":"2023-05-24T04:00:39.808228+0000","last_fullsized":"2023-05-24T04:00:39.808228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:32.909184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812908+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:39.812908+0000","last_peered":"2023-05-24T04:00:39.812908+0000","last_clean":"2023-05-24T04:00:39.812908+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:39.812908+0000","last_undegraded":"2023-05-24T04:00:39.812908+0000","last_fullsized":"2023-05-24T04:00:39.812908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:45.501543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811949+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:39.811949+0000","last_peered":"2023-05-24T04:00:39.811949+0000","last_clean":"2023-05-24T04:00:39.811949+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:39.811949+0000","last_undegraded":"2023-05-24T04:00:39.811949+0000","last_fullsized":"2023-05-24T04:00:39.811949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.097881+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:40.097881+0000","last_peered":"2023-05-24T04:00:40.097881+0000","last_clean":"2023-05-24T04:00:40.097881+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:40.097881+0000","last_undegraded":"2023-05-24T04:00:40.097881+0000","last_fullsized":"2023-05-24T04:00:40.097881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098933+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:40.098933+0000","last_peered":"2023-05-24T04:00:40.098933+0000","last_clean":"2023-05-24T04:00:40.098933+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:40.098933+0000","last_undegraded":"2023-05-24T04:00:40.098933+0000","last_fullsized":"2023-05-24T04:00:40.098933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104154+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:40.104154+0000","last_peered":"2023-05-24T04:00:40.104154+0000","last_clean":"2023-05-24T04:00:40.104154+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:40.104154+0000","last_undegraded":"2023-05-24T04:00:40.104154+0000","last_fullsized":"2023-05-24T04:00:40.104154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102855+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:40.102855+0000","last_peered":"2023-05-24T04:00:40.102855+0000","last_clean":"2023-05-24T04:00:40.102855+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:40.102855+0000","last_undegraded":"2023-05-24T04:00:40.102855+0000","last_fullsized":"2023-05-24T04:00:40.102855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:21:15.498619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807527+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:39.807527+0000","last_peered":"2023-05-24T04:00:39.807527+0000","last_clean":"2023-05-24T04:00:39.807527+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:39.807527+0000","last_undegraded":"2023-05-24T04:00:39.807527+0000","last_fullsized":"2023-05-24T04:00:39.807527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:50:20.457205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811559+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:39.811559+0000","last_peered":"2023-05-24T04:00:39.811559+0000","last_clean":"2023-05-24T04:00:39.811559+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:39.811559+0000","last_undegraded":"2023-05-24T04:00:39.811559+0000","last_fullsized":"2023-05-24T04:00:39.811559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101081+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:40.101081+0000","last_peered":"2023-05-24T04:00:40.101081+0000","last_clean":"2023-05-24T04:00:40.101081+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:40.101081+0000","last_undegraded":"2023-05-24T04:00:40.101081+0000","last_fullsized":"2023-05-24T04:00:40.101081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:43.311066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102093+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:40.102093+0000","last_peered":"2023-05-24T04:00:40.102093+0000","last_clean":"2023-05-24T04:00:40.102093+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:40.102093+0000","last_undegraded":"2023-05-24T04:00:40.102093+0000","last_fullsized":"2023-05-24T04:00:40.102093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:38.719131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809601+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:39.809601+0000","last_peered":"2023-05-24T04:00:39.809601+0000","last_clean":"2023-05-24T04:00:39.809601+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:39.809601+0000","last_undegraded":"2023-05-24T04:00:39.809601+0000","last_fullsized":"2023-05-24T04:00:39.809601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:59.234197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100812+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:40.100812+0000","last_peered":"2023-05-24T04:00:40.100812+0000","last_clean":"2023-05-24T04:00:40.100812+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:40.100812+0000","last_undegraded":"2023-05-24T04:00:40.100812+0000","last_fullsized":"2023-05-24T04:00:40.100812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:35:54.009858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102670+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:40.102670+0000","last_peered":"2023-05-24T04:00:40.102670+0000","last_clean":"2023-05-24T04:00:40.102670+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:40.102670+0000","last_undegraded":"2023-05-24T04:00:40.102670+0000","last_fullsized":"2023-05-24T04:00:40.102670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:32.061491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103107+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:40.103107+0000","last_peered":"2023-05-24T04:00:40.103107+0000","last_clean":"2023-05-24T04:00:40.103107+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:40.103107+0000","last_undegraded":"2023-05-24T04:00:40.103107+0000","last_fullsized":"2023-05-24T04:00:40.103107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:47.353354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811169+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:39.811169+0000","last_peered":"2023-05-24T04:00:39.811169+0000","last_clean":"2023-05-24T04:00:39.811169+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:39.811169+0000","last_undegraded":"2023-05-24T04:00:39.811169+0000","last_fullsized":"2023-05-24T04:00:39.811169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:42.314974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101790+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:40.101790+0000","last_peered":"2023-05-24T04:00:40.101790+0000","last_clean":"2023-05-24T04:00:40.101790+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:40.101790+0000","last_undegraded":"2023-05-24T04:00:40.101790+0000","last_fullsized":"2023-05-24T04:00:40.101790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:00:21.503763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810092+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:39.810092+0000","last_peered":"2023-05-24T04:00:39.810092+0000","last_clean":"2023-05-24T04:00:39.810092+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:39.810092+0000","last_undegraded":"2023-05-24T04:00:39.810092+0000","last_fullsized":"2023-05-24T04:00:39.810092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:36.913572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100241+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:40.100241+0000","last_peered":"2023-05-24T04:00:40.100241+0000","last_clean":"2023-05-24T04:00:40.100241+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:40.100241+0000","last_undegraded":"2023-05-24T04:00:40.100241+0000","last_fullsized":"2023-05-24T04:00:40.100241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811058+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:39.811058+0000","last_peered":"2023-05-24T04:00:39.811058+0000","last_clean":"2023-05-24T04:00:39.811058+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:39.811058+0000","last_undegraded":"2023-05-24T04:00:39.811058+0000","last_fullsized":"2023-05-24T04:00:39.811058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:45:01.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104757+0000","last_change":"2023-05-24T04:00:40.102360+0000","last_active":"2023-05-24T04:00:40.104757+0000","last_peered":"2023-05-24T04:00:40.104757+0000","last_clean":"2023-05-24T04:00:40.104757+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:00:40.104757+0000","last_undegraded":"2023-05-24T04:00:40.104757+0000","last_fullsized":"2023-05-24T04:00:40.104757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098405+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:40.098405+0000","last_peered":"2023-05-24T04:00:40.098405+0000","last_clean":"2023-05-24T04:00:40.098405+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:40.098405+0000","last_undegraded":"2023-05-24T04:00:40.098405+0000","last_fullsized":"2023-05-24T04:00:40.098405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:22:56.621238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806011+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:39.806011+0000","last_peered":"2023-05-24T04:00:39.806011+0000","last_clean":"2023-05-24T04:00:39.806011+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:39.806011+0000","last_undegraded":"2023-05-24T04:00:39.806011+0000","last_fullsized":"2023-05-24T04:00:39.806011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:17.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806066+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:39.806066+0000","last_peered":"2023-05-24T04:00:39.806066+0000","last_clean":"2023-05-24T04:00:39.806066+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:39.806066+0000","last_undegraded":"2023-05-24T04:00:39.806066+0000","last_fullsized":"2023-05-24T04:00:39.806066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811579+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:39.811579+0000","last_peered":"2023-05-24T04:00:39.811579+0000","last_clean":"2023-05-24T04:00:39.811579+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:39.811579+0000","last_undegraded":"2023-05-24T04:00:39.811579+0000","last_fullsized":"2023-05-24T04:00:39.811579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810390+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:39.810390+0000","last_peered":"2023-05-24T04:00:39.810390+0000","last_clean":"2023-05-24T04:00:39.810390+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:39.810390+0000","last_undegraded":"2023-05-24T04:00:39.810390+0000","last_fullsized":"2023-05-24T04:00:39.810390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:36.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098998+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:40.098998+0000","last_peered":"2023-05-24T04:00:40.098998+0000","last_clean":"2023-05-24T04:00:40.098998+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:40.098998+0000","last_undegraded":"2023-05-24T04:00:40.098998+0000","last_fullsized":"2023-05-24T04:00:40.098998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:33.846674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103363+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:40.103363+0000","last_peered":"2023-05-24T04:00:40.103363+0000","last_clean":"2023-05-24T04:00:40.103363+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:40.103363+0000","last_undegraded":"2023-05-24T04:00:40.103363+0000","last_fullsized":"2023-05-24T04:00:40.103363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811513+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:39.811513+0000","last_peered":"2023-05-24T04:00:39.811513+0000","last_clean":"2023-05-24T04:00:39.811513+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:39.811513+0000","last_undegraded":"2023-05-24T04:00:39.811513+0000","last_fullsized":"2023-05-24T04:00:39.811513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:20.313678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100288+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:40.100288+0000","last_peered":"2023-05-24T04:00:40.100288+0000","last_clean":"2023-05-24T04:00:40.100288+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:40.100288+0000","last_undegraded":"2023-05-24T04:00:40.100288+0000","last_fullsized":"2023-05-24T04:00:40.100288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101907+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:40.101907+0000","last_peered":"2023-05-24T04:00:40.101907+0000","last_clean":"2023-05-24T04:00:40.101907+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:40.101907+0000","last_undegraded":"2023-05-24T04:00:40.101907+0000","last_fullsized":"2023-05-24T04:00:40.101907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:08.298712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099345+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:40.099345+0000","last_peered":"2023-05-24T04:00:40.099345+0000","last_clean":"2023-05-24T04:00:40.099345+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:40.099345+0000","last_undegraded":"2023-05-24T04:00:40.099345+0000","last_fullsized":"2023-05-24T04:00:40.099345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.596528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099215+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:40.099215+0000","last_peered":"2023-05-24T04:00:40.099215+0000","last_clean":"2023-05-24T04:00:40.099215+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:40.099215+0000","last_undegraded":"2023-05-24T04:00:40.099215+0000","last_fullsized":"2023-05-24T04:00:40.099215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103467+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:40.103467+0000","last_peered":"2023-05-24T04:00:40.103467+0000","last_clean":"2023-05-24T04:00:40.103467+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:40.103467+0000","last_undegraded":"2023-05-24T04:00:40.103467+0000","last_fullsized":"2023-05-24T04:00:40.103467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:36.522307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099294+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:40.099294+0000","last_peered":"2023-05-24T04:00:40.099294+0000","last_clean":"2023-05-24T04:00:40.099294+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:40.099294+0000","last_undegraded":"2023-05-24T04:00:40.099294+0000","last_fullsized":"2023-05-24T04:00:40.099294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812016+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:39.812016+0000","last_peered":"2023-05-24T04:00:39.812016+0000","last_clean":"2023-05-24T04:00:39.812016+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:39.812016+0000","last_undegraded":"2023-05-24T04:00:39.812016+0000","last_fullsized":"2023-05-24T04:00:39.812016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:57.390669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811982+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:39.811982+0000","last_peered":"2023-05-24T04:00:39.811982+0000","last_clean":"2023-05-24T04:00:39.811982+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:39.811982+0000","last_undegraded":"2023-05-24T04:00:39.811982+0000","last_fullsized":"2023-05-24T04:00:39.811982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:17:19.685408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808375+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:39.808375+0000","last_peered":"2023-05-24T04:00:39.808375+0000","last_clean":"2023-05-24T04:00:39.808375+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:39.808375+0000","last_undegraded":"2023-05-24T04:00:39.808375+0000","last_fullsized":"2023-05-24T04:00:39.808375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:17.724238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102989+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:40.102989+0000","last_peered":"2023-05-24T04:00:40.102989+0000","last_clean":"2023-05-24T04:00:40.102989+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:40.102989+0000","last_undegraded":"2023-05-24T04:00:40.102989+0000","last_fullsized":"2023-05-24T04:00:40.102989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:50.312748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811159+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:39.811159+0000","last_peered":"2023-05-24T04:00:39.811159+0000","last_clean":"2023-05-24T04:00:39.811159+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:39.811159+0000","last_undegraded":"2023-05-24T04:00:39.811159+0000","last_fullsized":"2023-05-24T04:00:39.811159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:56:00.664781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810571+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:39.810571+0000","last_peered":"2023-05-24T04:00:39.810571+0000","last_clean":"2023-05-24T04:00:39.810571+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:39.810571+0000","last_undegraded":"2023-05-24T04:00:39.810571+0000","last_fullsized":"2023-05-24T04:00:39.810571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:19.952827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100969+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:40.100969+0000","last_peered":"2023-05-24T04:00:40.100969+0000","last_clean":"2023-05-24T04:00:40.100969+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:40.100969+0000","last_undegraded":"2023-05-24T04:00:40.100969+0000","last_fullsized":"2023-05-24T04:00:40.100969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:41:02.080284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810519+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:39.810519+0000","last_peered":"2023-05-24T04:00:39.810519+0000","last_clean":"2023-05-24T04:00:39.810519+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:39.810519+0000","last_undegraded":"2023-05-24T04:00:39.810519+0000","last_fullsized":"2023-05-24T04:00:39.810519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:35:05.654962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100459+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:40.100459+0000","last_peered":"2023-05-24T04:00:40.100459+0000","last_clean":"2023-05-24T04:00:40.100459+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:40.100459+0000","last_undegraded":"2023-05-24T04:00:40.100459+0000","last_fullsized":"2023-05-24T04:00:40.100459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:15.156228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806108+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:39.806108+0000","last_peered":"2023-05-24T04:00:39.806108+0000","last_clean":"2023-05-24T04:00:39.806108+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:39.806108+0000","last_undegraded":"2023-05-24T04:00:39.806108+0000","last_fullsized":"2023-05-24T04:00:39.806108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:50.350647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811381+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:39.811381+0000","last_peered":"2023-05-24T04:00:39.811381+0000","last_clean":"2023-05-24T04:00:39.811381+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:39.811381+0000","last_undegraded":"2023-05-24T04:00:39.811381+0000","last_fullsized":"2023-05-24T04:00:39.811381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:39.191708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101832+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:40.101832+0000","last_peered":"2023-05-24T04:00:40.101832+0000","last_clean":"2023-05-24T04:00:40.101832+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:40.101832+0000","last_undegraded":"2023-05-24T04:00:40.101832+0000","last_fullsized":"2023-05-24T04:00:40.101832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:44.836669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805566+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:39.805566+0000","last_peered":"2023-05-24T04:00:39.805566+0000","last_clean":"2023-05-24T04:00:39.805566+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:39.805566+0000","last_undegraded":"2023-05-24T04:00:39.805566+0000","last_fullsized":"2023-05-24T04:00:39.805566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809938+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:39.809938+0000","last_peered":"2023-05-24T04:00:39.809938+0000","last_clean":"2023-05-24T04:00:39.809938+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:39.809938+0000","last_undegraded":"2023-05-24T04:00:39.809938+0000","last_fullsized":"2023-05-24T04:00:39.809938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100839+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:40.100839+0000","last_peered":"2023-05-24T04:00:40.100839+0000","last_clean":"2023-05-24T04:00:40.100839+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:40.100839+0000","last_undegraded":"2023-05-24T04:00:40.100839+0000","last_fullsized":"2023-05-24T04:00:40.100839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:45.886736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805477+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:39.805477+0000","last_peered":"2023-05-24T04:00:39.805477+0000","last_clean":"2023-05-24T04:00:39.805477+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:39.805477+0000","last_undegraded":"2023-05-24T04:00:39.805477+0000","last_fullsized":"2023-05-24T04:00:39.805477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:38.716971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807987+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:39.807987+0000","last_peered":"2023-05-24T04:00:39.807987+0000","last_clean":"2023-05-24T04:00:39.807987+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:39.807987+0000","last_undegraded":"2023-05-24T04:00:39.807987+0000","last_fullsized":"2023-05-24T04:00:39.807987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:51.406995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100571+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:40.100571+0000","last_peered":"2023-05-24T04:00:40.100571+0000","last_clean":"2023-05-24T04:00:40.100571+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:40.100571+0000","last_undegraded":"2023-05-24T04:00:40.100571+0000","last_fullsized":"2023-05-24T04:00:40.100571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805132+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:39.805132+0000","last_peered":"2023-05-24T04:00:39.805132+0000","last_clean":"2023-05-24T04:00:39.805132+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:39.805132+0000","last_undegraded":"2023-05-24T04:00:39.805132+0000","last_fullsized":"2023-05-24T04:00:39.805132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100792+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:40.100792+0000","last_peered":"2023-05-24T04:00:40.100792+0000","last_clean":"2023-05-24T04:00:40.100792+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:40.100792+0000","last_undegraded":"2023-05-24T04:00:40.100792+0000","last_fullsized":"2023-05-24T04:00:40.100792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101157+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:40.101157+0000","last_peered":"2023-05-24T04:00:40.101157+0000","last_clean":"2023-05-24T04:00:40.101157+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:40.101157+0000","last_undegraded":"2023-05-24T04:00:40.101157+0000","last_fullsized":"2023-05-24T04:00:40.101157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099062+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:40.099062+0000","last_peered":"2023-05-24T04:00:40.099062+0000","last_clean":"2023-05-24T04:00:40.099062+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:40.099062+0000","last_undegraded":"2023-05-24T04:00:40.099062+0000","last_fullsized":"2023-05-24T04:00:40.099062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:56.328860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102734+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102734+0000","last_peered":"2023-05-24T04:00:40.102734+0000","last_clean":"2023-05-24T04:00:40.102734+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102734+0000","last_undegraded":"2023-05-24T04:00:40.102734+0000","last_fullsized":"2023-05-24T04:00:40.102734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:30.684575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807393+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:39.807393+0000","last_peered":"2023-05-24T04:00:39.807393+0000","last_clean":"2023-05-24T04:00:39.807393+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:39.807393+0000","last_undegraded":"2023-05-24T04:00:39.807393+0000","last_fullsized":"2023-05-24T04:00:39.807393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:25.129357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102591+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:40.102591+0000","last_peered":"2023-05-24T04:00:40.102591+0000","last_clean":"2023-05-24T04:00:40.102591+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:40.102591+0000","last_undegraded":"2023-05-24T04:00:40.102591+0000","last_fullsized":"2023-05-24T04:00:40.102591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:16.625550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102270+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102270+0000","last_peered":"2023-05-24T04:00:40.102270+0000","last_clean":"2023-05-24T04:00:40.102270+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102270+0000","last_undegraded":"2023-05-24T04:00:40.102270+0000","last_fullsized":"2023-05-24T04:00:40.102270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:59.527296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100090+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:40.100090+0000","last_peered":"2023-05-24T04:00:40.100090+0000","last_clean":"2023-05-24T04:00:40.100090+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:40.100090+0000","last_undegraded":"2023-05-24T04:00:40.100090+0000","last_fullsized":"2023-05-24T04:00:40.100090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811649+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:39.811649+0000","last_peered":"2023-05-24T04:00:39.811649+0000","last_clean":"2023-05-24T04:00:39.811649+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:39.811649+0000","last_undegraded":"2023-05-24T04:00:39.811649+0000","last_fullsized":"2023-05-24T04:00:39.811649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810652+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:39.810652+0000","last_peered":"2023-05-24T04:00:39.810652+0000","last_clean":"2023-05-24T04:00:39.810652+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:39.810652+0000","last_undegraded":"2023-05-24T04:00:39.810652+0000","last_fullsized":"2023-05-24T04:00:39.810652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:35.507344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102742+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:40.102742+0000","last_peered":"2023-05-24T04:00:40.102742+0000","last_clean":"2023-05-24T04:00:40.102742+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:40.102742+0000","last_undegraded":"2023-05-24T04:00:40.102742+0000","last_fullsized":"2023-05-24T04:00:40.102742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100738+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:40.100738+0000","last_peered":"2023-05-24T04:00:40.100738+0000","last_clean":"2023-05-24T04:00:40.100738+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:40.100738+0000","last_undegraded":"2023-05-24T04:00:40.100738+0000","last_fullsized":"2023-05-24T04:00:40.100738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099965+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:40.099965+0000","last_peered":"2023-05-24T04:00:40.099965+0000","last_clean":"2023-05-24T04:00:40.099965+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:40.099965+0000","last_undegraded":"2023-05-24T04:00:40.099965+0000","last_fullsized":"2023-05-24T04:00:40.099965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101072+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:40.101072+0000","last_peered":"2023-05-24T04:00:40.101072+0000","last_clean":"2023-05-24T04:00:40.101072+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:40.101072+0000","last_undegraded":"2023-05-24T04:00:40.101072+0000","last_fullsized":"2023-05-24T04:00:40.101072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:59.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102049+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102049+0000","last_peered":"2023-05-24T04:00:40.102049+0000","last_clean":"2023-05-24T04:00:40.102049+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102049+0000","last_undegraded":"2023-05-24T04:00:40.102049+0000","last_fullsized":"2023-05-24T04:00:40.102049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:28.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807099+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:39.807099+0000","last_peered":"2023-05-24T04:00:39.807099+0000","last_clean":"2023-05-24T04:00:39.807099+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:39.807099+0000","last_undegraded":"2023-05-24T04:00:39.807099+0000","last_fullsized":"2023-05-24T04:00:39.807099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809456+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:39.809456+0000","last_peered":"2023-05-24T04:00:39.809456+0000","last_clean":"2023-05-24T04:00:39.809456+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:39.809456+0000","last_undegraded":"2023-05-24T04:00:39.809456+0000","last_fullsized":"2023-05-24T04:00:39.809456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:48.519772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100215+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:40.100215+0000","last_peered":"2023-05-24T04:00:40.100215+0000","last_clean":"2023-05-24T04:00:40.100215+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:40.100215+0000","last_undegraded":"2023-05-24T04:00:40.100215+0000","last_fullsized":"2023-05-24T04:00:40.100215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:48.368318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102380+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:40.102380+0000","last_peered":"2023-05-24T04:00:40.102380+0000","last_clean":"2023-05-24T04:00:40.102380+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:40.102380+0000","last_undegraded":"2023-05-24T04:00:40.102380+0000","last_fullsized":"2023-05-24T04:00:40.102380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:08:23.587331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102517+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:40.102517+0000","last_peered":"2023-05-24T04:00:40.102517+0000","last_clean":"2023-05-24T04:00:40.102517+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:40.102517+0000","last_undegraded":"2023-05-24T04:00:40.102517+0000","last_fullsized":"2023-05-24T04:00:40.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103708+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:40.103708+0000","last_peered":"2023-05-24T04:00:40.103708+0000","last_clean":"2023-05-24T04:00:40.103708+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:40.103708+0000","last_undegraded":"2023-05-24T04:00:40.103708+0000","last_fullsized":"2023-05-24T04:00:40.103708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103303+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:40.103303+0000","last_peered":"2023-05-24T04:00:40.103303+0000","last_clean":"2023-05-24T04:00:40.103303+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:40.103303+0000","last_undegraded":"2023-05-24T04:00:40.103303+0000","last_fullsized":"2023-05-24T04:00:40.103303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098609+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:40.098609+0000","last_peered":"2023-05-24T04:00:40.098609+0000","last_clean":"2023-05-24T04:00:40.098609+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:40.098609+0000","last_undegraded":"2023-05-24T04:00:40.098609+0000","last_fullsized":"2023-05-24T04:00:40.098609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:58.307422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099080+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:40.099080+0000","last_peered":"2023-05-24T04:00:40.099080+0000","last_clean":"2023-05-24T04:00:40.099080+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:40.099080+0000","last_undegraded":"2023-05-24T04:00:40.099080+0000","last_fullsized":"2023-05-24T04:00:40.099080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810553+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:39.810553+0000","last_peered":"2023-05-24T04:00:39.810553+0000","last_clean":"2023-05-24T04:00:39.810553+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:39.810553+0000","last_undegraded":"2023-05-24T04:00:39.810553+0000","last_fullsized":"2023-05-24T04:00:39.810553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099745+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:40.099745+0000","last_peered":"2023-05-24T04:00:40.099745+0000","last_clean":"2023-05-24T04:00:40.099745+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:40.099745+0000","last_undegraded":"2023-05-24T04:00:40.099745+0000","last_fullsized":"2023-05-24T04:00:40.099745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810343+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:39.810343+0000","last_peered":"2023-05-24T04:00:39.810343+0000","last_clean":"2023-05-24T04:00:39.810343+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:39.810343+0000","last_undegraded":"2023-05-24T04:00:39.810343+0000","last_fullsized":"2023-05-24T04:00:39.810343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:40:56.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806510+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:39.806510+0000","last_peered":"2023-05-24T04:00:39.806510+0000","last_clean":"2023-05-24T04:00:39.806510+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:39.806510+0000","last_undegraded":"2023-05-24T04:00:39.806510+0000","last_fullsized":"2023-05-24T04:00:39.806510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811625+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:39.811625+0000","last_peered":"2023-05-24T04:00:39.811625+0000","last_clean":"2023-05-24T04:00:39.811625+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:39.811625+0000","last_undegraded":"2023-05-24T04:00:39.811625+0000","last_fullsized":"2023-05-24T04:00:39.811625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:00:33.695719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811728+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:39.811728+0000","last_peered":"2023-05-24T04:00:39.811728+0000","last_clean":"2023-05-24T04:00:39.811728+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:39.811728+0000","last_undegraded":"2023-05-24T04:00:39.811728+0000","last_fullsized":"2023-05-24T04:00:39.811728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808246+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:39.808246+0000","last_peered":"2023-05-24T04:00:39.808246+0000","last_clean":"2023-05-24T04:00:39.808246+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:39.808246+0000","last_undegraded":"2023-05-24T04:00:39.808246+0000","last_fullsized":"2023-05-24T04:00:39.808246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:53:24.077758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099764+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:40.099764+0000","last_peered":"2023-05-24T04:00:40.099764+0000","last_clean":"2023-05-24T04:00:40.099764+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:40.099764+0000","last_undegraded":"2023-05-24T04:00:40.099764+0000","last_fullsized":"2023-05-24T04:00:40.099764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099726+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:40.099726+0000","last_peered":"2023-05-24T04:00:40.099726+0000","last_clean":"2023-05-24T04:00:40.099726+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:40.099726+0000","last_undegraded":"2023-05-24T04:00:40.099726+0000","last_fullsized":"2023-05-24T04:00:40.099726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805582+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:39.805582+0000","last_peered":"2023-05-24T04:00:39.805582+0000","last_clean":"2023-05-24T04:00:39.805582+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:39.805582+0000","last_undegraded":"2023-05-24T04:00:39.805582+0000","last_fullsized":"2023-05-24T04:00:39.805582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:39.556891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806045+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:39.806045+0000","last_peered":"2023-05-24T04:00:39.806045+0000","last_clean":"2023-05-24T04:00:39.806045+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:39.806045+0000","last_undegraded":"2023-05-24T04:00:39.806045+0000","last_fullsized":"2023-05-24T04:00:39.806045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811204+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:39.811204+0000","last_peered":"2023-05-24T04:00:39.811204+0000","last_clean":"2023-05-24T04:00:39.811204+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:39.811204+0000","last_undegraded":"2023-05-24T04:00:39.811204+0000","last_fullsized":"2023-05-24T04:00:39.811204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:17:13.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103332+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:40.103332+0000","last_peered":"2023-05-24T04:00:40.103332+0000","last_clean":"2023-05-24T04:00:40.103332+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:40.103332+0000","last_undegraded":"2023-05-24T04:00:40.103332+0000","last_fullsized":"2023-05-24T04:00:40.103332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:16.171192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811397+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:39.811397+0000","last_peered":"2023-05-24T04:00:39.811397+0000","last_clean":"2023-05-24T04:00:39.811397+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:39.811397+0000","last_undegraded":"2023-05-24T04:00:39.811397+0000","last_fullsized":"2023-05-24T04:00:39.811397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:45.851633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100566+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:40.100566+0000","last_peered":"2023-05-24T04:00:40.100566+0000","last_clean":"2023-05-24T04:00:40.100566+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:40.100566+0000","last_undegraded":"2023-05-24T04:00:40.100566+0000","last_fullsized":"2023-05-24T04:00:40.100566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:38.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099443+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:40.099443+0000","last_peered":"2023-05-24T04:00:40.099443+0000","last_clean":"2023-05-24T04:00:40.099443+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:40.099443+0000","last_undegraded":"2023-05-24T04:00:40.099443+0000","last_fullsized":"2023-05-24T04:00:40.099443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807440+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:39.807440+0000","last_peered":"2023-05-24T04:00:39.807440+0000","last_clean":"2023-05-24T04:00:39.807440+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:39.807440+0000","last_undegraded":"2023-05-24T04:00:39.807440+0000","last_fullsized":"2023-05-24T04:00:39.807440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:55:03.048298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.816564+0000","last_change":"2023-05-24T04:00:39.816564+0000","last_active":"2023-05-24T04:00:39.816564+0000","last_peered":"2023-05-24T04:00:39.816564+0000","last_clean":"2023-05-24T04:00:39.816564+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:00:39.816564+0000","last_undegraded":"2023-05-24T04:00:39.816564+0000","last_fullsized":"2023-05-24T04:00:39.816564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809247+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:39.809247+0000","last_peered":"2023-05-24T04:00:39.809247+0000","last_clean":"2023-05-24T04:00:39.809247+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:39.809247+0000","last_undegraded":"2023-05-24T04:00:39.809247+0000","last_fullsized":"2023-05-24T04:00:39.809247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810954+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:39.810954+0000","last_peered":"2023-05-24T04:00:39.810954+0000","last_clean":"2023-05-24T04:00:39.810954+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:39.810954+0000","last_undegraded":"2023-05-24T04:00:39.810954+0000","last_fullsized":"2023-05-24T04:00:39.810954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:30:14.563105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102982+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:40.102982+0000","last_peered":"2023-05-24T04:00:40.102982+0000","last_clean":"2023-05-24T04:00:40.102982+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:40.102982+0000","last_undegraded":"2023-05-24T04:00:40.102982+0000","last_fullsized":"2023-05-24T04:00:40.102982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:46.157393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807362+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:39.807362+0000","last_peered":"2023-05-24T04:00:39.807362+0000","last_clean":"2023-05-24T04:00:39.807362+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:39.807362+0000","last_undegraded":"2023-05-24T04:00:39.807362+0000","last_fullsized":"2023-05-24T04:00:39.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6241,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.76700000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.98899999999999999}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.1279999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0369999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.2390000000000001}]},{"osd":2,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.101}]},{"osd":3,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.871}]},{"osd":4,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.198},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.91100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.202},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.748}]},{"osd":1,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.105}]},{"osd":3,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.343},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.0569999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.4299999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.145},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.304}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.0469999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.84099999999999997}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.68500000000000005}]},{"osd":3,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.26}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.2130000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.173},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.345}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.749}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95199999999999996}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.78600000000000003}]},{"osd":7,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.96999999999999997}]},{"osd":3,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.103},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.395}]},{"osd":6,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.139}]},{"osd":7,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.339},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.177}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.92800000000000005}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.089}]},{"osd":7,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:01:15.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:01:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.325+0000 7fc7ea603640 1 Processor -- start 2023-05-24T04:01:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.325+0000 7fc7ea603640 1 -- start start 2023-05-24T04:01:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7ea603640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e4070b20 0x7fc7e406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7ea603640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7e406c000 0x7fc7e4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7ea603640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e406ea20 con 0x7fc7e414fa70 2023-05-24T04:01:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7ea603640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e4070460 con 0x7fc7e406c000 2023-05-24T04:01:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7ea603640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e406ec70 con 0x7fc7e4070b20 2023-05-24T04:01:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc7e414fa70 0x7fc7e406fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51600/0 (socket says 172.21.15.40:51600) 2023-05-24T04:01:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e3fff640 1 -- 172.21.15.40:0/260612119 learned_addr learned my addr 172.21.15.40:0/260612119 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e8ba0640 1 --2- 172.21.15.40:0/260612119 >> v2:172.21.15.40:3300/0 conn(0x7fc7e406c000 0x7fc7e4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e37fe640 1 --2- 172.21.15.40:0/260612119 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e4070b20 0x7fc7e406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e2ffd640 1 -- 172.21.15.40:0/260612119 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704491775 0 0) 0x7fc7e406ea20 con 0x7fc7e414fa70 2023-05-24T04:01:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e2ffd640 1 -- 172.21.15.40:0/260612119 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc003530 con 0x7fc7e414fa70 2023-05-24T04:01:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/260612119 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e4070b20 msgr2=0x7fc7e406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e8ba0640 1 --2- 172.21.15.40:0/260612119 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e4070b20 0x7fc7e406bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/260612119 >> v1:172.21.15.40:6789/0 conn(0x7fc7e414fa70 legacy=0x7fc7e406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/260612119 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4150230 con 0x7fc7e406c000 2023-05-24T04:01:15.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e8ba0640 1 --2- 172.21.15.40:0/260612119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e406c000 0x7fc7e4145df0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e649efdfe722b51b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e2ffd640 1 -- 172.21.15.40:0/260612119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0a5810 con 0x7fc7e406c000 2023-05-24T04:01:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e2ffd640 1 -- 172.21.15.40:0/260612119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0a5970 con 0x7fc7e406c000 2023-05-24T04:01:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.329+0000 7fc7e2ffd640 1 -- 172.21.15.40:0/260612119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0a5d00 con 0x7fc7e406c000 2023-05-24T04:01:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/260612119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e406c000 msgr2=0x7fc7e4145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 --2- 172.21.15.40:0/260612119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e406c000 0x7fc7e4145df0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc01c950 comp rx=0 tx=0).stop 2023-05-24T04:01:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/260612119 shutdown_connections 2023-05-24T04:01:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 --2- 172.21.15.40:0/260612119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e406c000 0x7fc7e4145df0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 --2- 172.21.15.40:0/260612119 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e4070b20 0x7fc7e406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/260612119 >> 172.21.15.40:0/260612119 conn(0x7fc7e40c0280 msgr2=0x7fc7e40c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/260612119 shutdown_connections 2023-05-24T04:01:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/260612119 wait complete. 2023-05-24T04:01:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 Processor -- start 2023-05-24T04:01:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- start start 2023-05-24T04:01:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e406c000 0x7fc7e413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e4070b20 0x7fc7e413e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 0x7fc7e41e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41419e0 con 0x7fc7e414fa70 2023-05-24T04:01:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4140ca0 con 0x7fc7e4070b20 2023-05-24T04:01:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41567f0 con 0x7fc7e406c000 2023-05-24T04:01:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 0x7fc7e41e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 0x7fc7e41e43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49202/0 (socket says 172.21.15.40:49202) 2023-05-24T04:01:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/691610326 learned_addr learned my addr 172.21.15.40:0/691610326 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e3fff640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e406c000 0x7fc7e413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e37fe640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e4070b20 0x7fc7e413e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e406c000 msgr2=0x7fc7e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e406c000 0x7fc7e413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e4070b20 msgr2=0x7fc7e413e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e4070b20 0x7fc7e413e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 -- 172.21.15.40:0/691610326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009a70 con 0x7fc7e414fa70 2023-05-24T04:01:15.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e3fff640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e406c000 0x7fc7e413f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:15.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e8ba0640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 0x7fc7e41e43c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:15.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0b9860 con 0x7fc7e414fa70 2023-05-24T04:01:15.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0b99c0 con 0x7fc7e414fa70 2023-05-24T04:01:15.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0b9d70 con 0x7fc7e414fa70 2023-05-24T04:01:15.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e414ffd0 con 0x7fc7e414fa70 2023-05-24T04:01:15.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e414fe40 con 0x7fc7e414fa70 2023-05-24T04:01:15.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.333+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e41593c0 con 0x7fc7e414fa70 2023-05-24T04:01:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.337+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7dc0c4460 con 0x7fc7e414fa70 2023-05-24T04:01:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.337+0000 7fc7e0ff9640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7d0066280 0x7fc7d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.337+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7dc11f290 con 0x7fc7e414fa70 2023-05-24T04:01:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.337+0000 7fc7e3fff640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7d0066280 0x7fc7d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.337+0000 7fc7e3fff640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7d0066280 0x7fc7d0068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40011f0 tx=0x7fc7d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:15.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.341+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7dc0ec500 con 0x7fc7e414fa70 2023-05-24T04:01:15.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.489+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7e4144950 con 0x7fc7d0066280 2023-05-24T04:01:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.517+0000 7fc7e0ff9640 1 -- 172.21.15.40:0/691610326 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389905 (secure 0 0 0) 0x7fc7e4144950 con 0x7fc7d0066280 2023-05-24T04:01:15.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:15.529 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:01:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7d0066280 msgr2=0x7fc7d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7d0066280 0x7fc7d0068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40011f0 tx=0x7fc7d4009040 comp rx=0 tx=0).stop 2023-05-24T04:01:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 msgr2=0x7fc7e41e43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 0x7fc7e41e43c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc0196f0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 shutdown_connections 2023-05-24T04:01:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc7d0066280 0x7fc7d0068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7e414fa70 0x7fc7e41e43c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7e4070b20 0x7fc7e413e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 --2- 172.21.15.40:0/691610326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7e406c000 0x7fc7e413f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 >> 172.21.15.40:0/691610326 conn(0x7fc7e40c0280 msgr2=0x7fc7e406ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 shutdown_connections 2023-05-24T04:01:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.525+0000 7fc7ea603640 1 -- 172.21.15.40:0/691610326 wait complete. 2023-05-24T04:01:15.547 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-05-24T04:01:14.549126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596609,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005161"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098134+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:40.098134+0000","last_peered":"2023-05-24T04:00:40.098134+0000","last_clean":"2023-05-24T04:00:40.098134+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:40.098134+0000","last_undegraded":"2023-05-24T04:00:40.098134+0000","last_fullsized":"2023-05-24T04:00:40.098134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:25:30.173497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811843+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:39.811843+0000","last_peered":"2023-05-24T04:00:39.811843+0000","last_clean":"2023-05-24T04:00:39.811843+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:39.811843+0000","last_undegraded":"2023-05-24T04:00:39.811843+0000","last_fullsized":"2023-05-24T04:00:39.811843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808631+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808631+0000","last_peered":"2023-05-24T04:00:39.808631+0000","last_clean":"2023-05-24T04:00:39.808631+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808631+0000","last_undegraded":"2023-05-24T04:00:39.808631+0000","last_fullsized":"2023-05-24T04:00:39.808631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:47:07.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807713+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807713+0000","last_peered":"2023-05-24T04:00:39.807713+0000","last_clean":"2023-05-24T04:00:39.807713+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807713+0000","last_undegraded":"2023-05-24T04:00:39.807713+0000","last_fullsized":"2023-05-24T04:00:39.807713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:54:29.409167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101558+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:40.101558+0000","last_peered":"2023-05-24T04:00:40.101558+0000","last_clean":"2023-05-24T04:00:40.101558+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:40.101558+0000","last_undegraded":"2023-05-24T04:00:40.101558+0000","last_fullsized":"2023-05-24T04:00:40.101558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:49:14.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100127+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:40.100127+0000","last_peered":"2023-05-24T04:00:40.100127+0000","last_clean":"2023-05-24T04:00:40.100127+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:40.100127+0000","last_undegraded":"2023-05-24T04:00:40.100127+0000","last_fullsized":"2023-05-24T04:00:40.100127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101621+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101621+0000","last_peered":"2023-05-24T04:00:40.101621+0000","last_clean":"2023-05-24T04:00:40.101621+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101621+0000","last_undegraded":"2023-05-24T04:00:40.101621+0000","last_fullsized":"2023-05-24T04:00:40.101621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102900+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:40.102900+0000","last_peered":"2023-05-24T04:00:40.102900+0000","last_clean":"2023-05-24T04:00:40.102900+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:40.102900+0000","last_undegraded":"2023-05-24T04:00:40.102900+0000","last_fullsized":"2023-05-24T04:00:40.102900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809068+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:39.809068+0000","last_peered":"2023-05-24T04:00:39.809068+0000","last_clean":"2023-05-24T04:00:39.809068+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:39.809068+0000","last_undegraded":"2023-05-24T04:00:39.809068+0000","last_fullsized":"2023-05-24T04:00:39.809068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:12:56.539054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099216+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099216+0000","last_peered":"2023-05-24T04:00:40.099216+0000","last_clean":"2023-05-24T04:00:40.099216+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099216+0000","last_undegraded":"2023-05-24T04:00:40.099216+0000","last_fullsized":"2023-05-24T04:00:40.099216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101865+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:40.101865+0000","last_peered":"2023-05-24T04:00:40.101865+0000","last_clean":"2023-05-24T04:00:40.101865+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:40.101865+0000","last_undegraded":"2023-05-24T04:00:40.101865+0000","last_fullsized":"2023-05-24T04:00:40.101865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:54.557612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809755+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:39.809755+0000","last_peered":"2023-05-24T04:00:39.809755+0000","last_clean":"2023-05-24T04:00:39.809755+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:39.809755+0000","last_undegraded":"2023-05-24T04:00:39.809755+0000","last_fullsized":"2023-05-24T04:00:39.809755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:45.203491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102303+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:40.102303+0000","last_peered":"2023-05-24T04:00:40.102303+0000","last_clean":"2023-05-24T04:00:40.102303+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:40.102303+0000","last_undegraded":"2023-05-24T04:00:40.102303+0000","last_fullsized":"2023-05-24T04:00:40.102303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:04:41.791492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811965+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:39.811965+0000","last_peered":"2023-05-24T04:00:39.811965+0000","last_clean":"2023-05-24T04:00:39.811965+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:39.811965+0000","last_undegraded":"2023-05-24T04:00:39.811965+0000","last_fullsized":"2023-05-24T04:00:39.811965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806100+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:39.806100+0000","last_peered":"2023-05-24T04:00:39.806100+0000","last_clean":"2023-05-24T04:00:39.806100+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:39.806100+0000","last_undegraded":"2023-05-24T04:00:39.806100+0000","last_fullsized":"2023-05-24T04:00:39.806100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:37:15.796537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809729+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:39.809729+0000","last_peered":"2023-05-24T04:00:39.809729+0000","last_clean":"2023-05-24T04:00:39.809729+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:39.809729+0000","last_undegraded":"2023-05-24T04:00:39.809729+0000","last_fullsized":"2023-05-24T04:00:39.809729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:06:22.746009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101645+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:40.101645+0000","last_peered":"2023-05-24T04:00:40.101645+0000","last_clean":"2023-05-24T04:00:40.101645+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:40.101645+0000","last_undegraded":"2023-05-24T04:00:40.101645+0000","last_fullsized":"2023-05-24T04:00:40.101645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:20:52.502756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812080+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:39.812080+0000","last_peered":"2023-05-24T04:00:39.812080+0000","last_clean":"2023-05-24T04:00:39.812080+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:39.812080+0000","last_undegraded":"2023-05-24T04:00:39.812080+0000","last_fullsized":"2023-05-24T04:00:39.812080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:31.402385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811197+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:39.811197+0000","last_peered":"2023-05-24T04:00:39.811197+0000","last_clean":"2023-05-24T04:00:39.811197+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:39.811197+0000","last_undegraded":"2023-05-24T04:00:39.811197+0000","last_fullsized":"2023-05-24T04:00:39.811197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810982+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:39.810982+0000","last_peered":"2023-05-24T04:00:39.810982+0000","last_clean":"2023-05-24T04:00:39.810982+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:39.810982+0000","last_undegraded":"2023-05-24T04:00:39.810982+0000","last_fullsized":"2023-05-24T04:00:39.810982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099052+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:40.099052+0000","last_peered":"2023-05-24T04:00:40.099052+0000","last_clean":"2023-05-24T04:00:40.099052+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:40.099052+0000","last_undegraded":"2023-05-24T04:00:40.099052+0000","last_fullsized":"2023-05-24T04:00:40.099052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:23.810199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812582+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:39.812582+0000","last_peered":"2023-05-24T04:00:39.812582+0000","last_clean":"2023-05-24T04:00:39.812582+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:39.812582+0000","last_undegraded":"2023-05-24T04:00:39.812582+0000","last_fullsized":"2023-05-24T04:00:39.812582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098638+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:40.098638+0000","last_peered":"2023-05-24T04:00:40.098638+0000","last_clean":"2023-05-24T04:00:40.098638+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:40.098638+0000","last_undegraded":"2023-05-24T04:00:40.098638+0000","last_fullsized":"2023-05-24T04:00:40.098638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812113+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:39.812113+0000","last_peered":"2023-05-24T04:00:39.812113+0000","last_clean":"2023-05-24T04:00:39.812113+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:39.812113+0000","last_undegraded":"2023-05-24T04:00:39.812113+0000","last_fullsized":"2023-05-24T04:00:39.812113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808823+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:39.808823+0000","last_peered":"2023-05-24T04:00:39.808823+0000","last_clean":"2023-05-24T04:00:39.808823+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:39.808823+0000","last_undegraded":"2023-05-24T04:00:39.808823+0000","last_fullsized":"2023-05-24T04:00:39.808823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:36.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099608+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:40.099608+0000","last_peered":"2023-05-24T04:00:40.099608+0000","last_clean":"2023-05-24T04:00:40.099608+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:40.099608+0000","last_undegraded":"2023-05-24T04:00:40.099608+0000","last_fullsized":"2023-05-24T04:00:40.099608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:13.713373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103289+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:40.103289+0000","last_peered":"2023-05-24T04:00:40.103289+0000","last_clean":"2023-05-24T04:00:40.103289+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:40.103289+0000","last_undegraded":"2023-05-24T04:00:40.103289+0000","last_fullsized":"2023-05-24T04:00:40.103289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098253+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:40.098253+0000","last_peered":"2023-05-24T04:00:40.098253+0000","last_clean":"2023-05-24T04:00:40.098253+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:40.098253+0000","last_undegraded":"2023-05-24T04:00:40.098253+0000","last_fullsized":"2023-05-24T04:00:40.098253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100587+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:40.100587+0000","last_peered":"2023-05-24T04:00:40.100587+0000","last_clean":"2023-05-24T04:00:40.100587+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:40.100587+0000","last_undegraded":"2023-05-24T04:00:40.100587+0000","last_fullsized":"2023-05-24T04:00:40.100587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100516+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:40.100516+0000","last_peered":"2023-05-24T04:00:40.100516+0000","last_clean":"2023-05-24T04:00:40.100516+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:40.100516+0000","last_undegraded":"2023-05-24T04:00:40.100516+0000","last_fullsized":"2023-05-24T04:00:40.100516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:25:01.484129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099676+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099676+0000","last_peered":"2023-05-24T04:00:40.099676+0000","last_clean":"2023-05-24T04:00:40.099676+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099676+0000","last_undegraded":"2023-05-24T04:00:40.099676+0000","last_fullsized":"2023-05-24T04:00:40.099676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:49.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'16","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:52.682070+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:52.682070+0000","last_peered":"2023-05-24T04:00:52.682070+0000","last_clean":"2023-05-24T04:00:52.682070+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:52.682070+0000","last_undegraded":"2023-05-24T04:00:52.682070+0000","last_fullsized":"2023-05-24T04:00:52.682070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:13.476915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5443,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:39:14.636334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099694+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:40.099694+0000","last_peered":"2023-05-24T04:00:40.099694+0000","last_clean":"2023-05-24T04:00:40.099694+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:40.099694+0000","last_undegraded":"2023-05-24T04:00:40.099694+0000","last_fullsized":"2023-05-24T04:00:40.099694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:00.182042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808228+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:39.808228+0000","last_peered":"2023-05-24T04:00:39.808228+0000","last_clean":"2023-05-24T04:00:39.808228+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:39.808228+0000","last_undegraded":"2023-05-24T04:00:39.808228+0000","last_fullsized":"2023-05-24T04:00:39.808228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:32.909184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812908+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:39.812908+0000","last_peered":"2023-05-24T04:00:39.812908+0000","last_clean":"2023-05-24T04:00:39.812908+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:39.812908+0000","last_undegraded":"2023-05-24T04:00:39.812908+0000","last_fullsized":"2023-05-24T04:00:39.812908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:45.501543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811949+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:39.811949+0000","last_peered":"2023-05-24T04:00:39.811949+0000","last_clean":"2023-05-24T04:00:39.811949+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:39.811949+0000","last_undegraded":"2023-05-24T04:00:39.811949+0000","last_fullsized":"2023-05-24T04:00:39.811949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.097881+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:40.097881+0000","last_peered":"2023-05-24T04:00:40.097881+0000","last_clean":"2023-05-24T04:00:40.097881+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:40.097881+0000","last_undegraded":"2023-05-24T04:00:40.097881+0000","last_fullsized":"2023-05-24T04:00:40.097881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098933+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:40.098933+0000","last_peered":"2023-05-24T04:00:40.098933+0000","last_clean":"2023-05-24T04:00:40.098933+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:40.098933+0000","last_undegraded":"2023-05-24T04:00:40.098933+0000","last_fullsized":"2023-05-24T04:00:40.098933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104154+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:40.104154+0000","last_peered":"2023-05-24T04:00:40.104154+0000","last_clean":"2023-05-24T04:00:40.104154+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:40.104154+0000","last_undegraded":"2023-05-24T04:00:40.104154+0000","last_fullsized":"2023-05-24T04:00:40.104154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102855+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:40.102855+0000","last_peered":"2023-05-24T04:00:40.102855+0000","last_clean":"2023-05-24T04:00:40.102855+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:40.102855+0000","last_undegraded":"2023-05-24T04:00:40.102855+0000","last_fullsized":"2023-05-24T04:00:40.102855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:21:15.498619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807527+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:39.807527+0000","last_peered":"2023-05-24T04:00:39.807527+0000","last_clean":"2023-05-24T04:00:39.807527+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:39.807527+0000","last_undegraded":"2023-05-24T04:00:39.807527+0000","last_fullsized":"2023-05-24T04:00:39.807527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:50:20.457205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811559+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:39.811559+0000","last_peered":"2023-05-24T04:00:39.811559+0000","last_clean":"2023-05-24T04:00:39.811559+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:39.811559+0000","last_undegraded":"2023-05-24T04:00:39.811559+0000","last_fullsized":"2023-05-24T04:00:39.811559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101081+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:40.101081+0000","last_peered":"2023-05-24T04:00:40.101081+0000","last_clean":"2023-05-24T04:00:40.101081+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:40.101081+0000","last_undegraded":"2023-05-24T04:00:40.101081+0000","last_fullsized":"2023-05-24T04:00:40.101081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:43.311066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102093+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:40.102093+0000","last_peered":"2023-05-24T04:00:40.102093+0000","last_clean":"2023-05-24T04:00:40.102093+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:40.102093+0000","last_undegraded":"2023-05-24T04:00:40.102093+0000","last_fullsized":"2023-05-24T04:00:40.102093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:38.719131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809601+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:39.809601+0000","last_peered":"2023-05-24T04:00:39.809601+0000","last_clean":"2023-05-24T04:00:39.809601+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:39.809601+0000","last_undegraded":"2023-05-24T04:00:39.809601+0000","last_fullsized":"2023-05-24T04:00:39.809601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:59.234197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100812+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:40.100812+0000","last_peered":"2023-05-24T04:00:40.100812+0000","last_clean":"2023-05-24T04:00:40.100812+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:40.100812+0000","last_undegraded":"2023-05-24T04:00:40.100812+0000","last_fullsized":"2023-05-24T04:00:40.100812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:35:54.009858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102670+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:40.102670+0000","last_peered":"2023-05-24T04:00:40.102670+0000","last_clean":"2023-05-24T04:00:40.102670+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:40.102670+0000","last_undegraded":"2023-05-24T04:00:40.102670+0000","last_fullsized":"2023-05-24T04:00:40.102670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:32.061491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103107+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:40.103107+0000","last_peered":"2023-05-24T04:00:40.103107+0000","last_clean":"2023-05-24T04:00:40.103107+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:40.103107+0000","last_undegraded":"2023-05-24T04:00:40.103107+0000","last_fullsized":"2023-05-24T04:00:40.103107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:47.353354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811169+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:39.811169+0000","last_peered":"2023-05-24T04:00:39.811169+0000","last_clean":"2023-05-24T04:00:39.811169+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:39.811169+0000","last_undegraded":"2023-05-24T04:00:39.811169+0000","last_fullsized":"2023-05-24T04:00:39.811169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:42.314974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101790+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:40.101790+0000","last_peered":"2023-05-24T04:00:40.101790+0000","last_clean":"2023-05-24T04:00:40.101790+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:40.101790+0000","last_undegraded":"2023-05-24T04:00:40.101790+0000","last_fullsized":"2023-05-24T04:00:40.101790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:00:21.503763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810092+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:39.810092+0000","last_peered":"2023-05-24T04:00:39.810092+0000","last_clean":"2023-05-24T04:00:39.810092+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:39.810092+0000","last_undegraded":"2023-05-24T04:00:39.810092+0000","last_fullsized":"2023-05-24T04:00:39.810092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:36.913572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100241+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:40.100241+0000","last_peered":"2023-05-24T04:00:40.100241+0000","last_clean":"2023-05-24T04:00:40.100241+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:40.100241+0000","last_undegraded":"2023-05-24T04:00:40.100241+0000","last_fullsized":"2023-05-24T04:00:40.100241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811058+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:39.811058+0000","last_peered":"2023-05-24T04:00:39.811058+0000","last_clean":"2023-05-24T04:00:39.811058+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:39.811058+0000","last_undegraded":"2023-05-24T04:00:39.811058+0000","last_fullsized":"2023-05-24T04:00:39.811058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:45:01.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104757+0000","last_change":"2023-05-24T04:00:40.102360+0000","last_active":"2023-05-24T04:00:40.104757+0000","last_peered":"2023-05-24T04:00:40.104757+0000","last_clean":"2023-05-24T04:00:40.104757+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:00:40.104757+0000","last_undegraded":"2023-05-24T04:00:40.104757+0000","last_fullsized":"2023-05-24T04:00:40.104757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098405+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:40.098405+0000","last_peered":"2023-05-24T04:00:40.098405+0000","last_clean":"2023-05-24T04:00:40.098405+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:40.098405+0000","last_undegraded":"2023-05-24T04:00:40.098405+0000","last_fullsized":"2023-05-24T04:00:40.098405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:22:56.621238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806011+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:39.806011+0000","last_peered":"2023-05-24T04:00:39.806011+0000","last_clean":"2023-05-24T04:00:39.806011+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:39.806011+0000","last_undegraded":"2023-05-24T04:00:39.806011+0000","last_fullsized":"2023-05-24T04:00:39.806011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:17.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806066+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:39.806066+0000","last_peered":"2023-05-24T04:00:39.806066+0000","last_clean":"2023-05-24T04:00:39.806066+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:39.806066+0000","last_undegraded":"2023-05-24T04:00:39.806066+0000","last_fullsized":"2023-05-24T04:00:39.806066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811579+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:39.811579+0000","last_peered":"2023-05-24T04:00:39.811579+0000","last_clean":"2023-05-24T04:00:39.811579+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:39.811579+0000","last_undegraded":"2023-05-24T04:00:39.811579+0000","last_fullsized":"2023-05-24T04:00:39.811579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810390+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:39.810390+0000","last_peered":"2023-05-24T04:00:39.810390+0000","last_clean":"2023-05-24T04:00:39.810390+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:39.810390+0000","last_undegraded":"2023-05-24T04:00:39.810390+0000","last_fullsized":"2023-05-24T04:00:39.810390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:36.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098998+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:40.098998+0000","last_peered":"2023-05-24T04:00:40.098998+0000","last_clean":"2023-05-24T04:00:40.098998+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:40.098998+0000","last_undegraded":"2023-05-24T04:00:40.098998+0000","last_fullsized":"2023-05-24T04:00:40.098998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:33.846674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103363+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:40.103363+0000","last_peered":"2023-05-24T04:00:40.103363+0000","last_clean":"2023-05-24T04:00:40.103363+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:40.103363+0000","last_undegraded":"2023-05-24T04:00:40.103363+0000","last_fullsized":"2023-05-24T04:00:40.103363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811513+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:39.811513+0000","last_peered":"2023-05-24T04:00:39.811513+0000","last_clean":"2023-05-24T04:00:39.811513+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:39.811513+0000","last_undegraded":"2023-05-24T04:00:39.811513+0000","last_fullsized":"2023-05-24T04:00:39.811513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:20.313678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100288+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:40.100288+0000","last_peered":"2023-05-24T04:00:40.100288+0000","last_clean":"2023-05-24T04:00:40.100288+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:40.100288+0000","last_undegraded":"2023-05-24T04:00:40.100288+0000","last_fullsized":"2023-05-24T04:00:40.100288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101907+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:40.101907+0000","last_peered":"2023-05-24T04:00:40.101907+0000","last_clean":"2023-05-24T04:00:40.101907+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:40.101907+0000","last_undegraded":"2023-05-24T04:00:40.101907+0000","last_fullsized":"2023-05-24T04:00:40.101907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:08.298712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099345+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:40.099345+0000","last_peered":"2023-05-24T04:00:40.099345+0000","last_clean":"2023-05-24T04:00:40.099345+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:40.099345+0000","last_undegraded":"2023-05-24T04:00:40.099345+0000","last_fullsized":"2023-05-24T04:00:40.099345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.596528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099215+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:40.099215+0000","last_peered":"2023-05-24T04:00:40.099215+0000","last_clean":"2023-05-24T04:00:40.099215+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:40.099215+0000","last_undegraded":"2023-05-24T04:00:40.099215+0000","last_fullsized":"2023-05-24T04:00:40.099215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103467+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:40.103467+0000","last_peered":"2023-05-24T04:00:40.103467+0000","last_clean":"2023-05-24T04:00:40.103467+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:40.103467+0000","last_undegraded":"2023-05-24T04:00:40.103467+0000","last_fullsized":"2023-05-24T04:00:40.103467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:36.522307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099294+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:40.099294+0000","last_peered":"2023-05-24T04:00:40.099294+0000","last_clean":"2023-05-24T04:00:40.099294+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:40.099294+0000","last_undegraded":"2023-05-24T04:00:40.099294+0000","last_fullsized":"2023-05-24T04:00:40.099294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812016+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:39.812016+0000","last_peered":"2023-05-24T04:00:39.812016+0000","last_clean":"2023-05-24T04:00:39.812016+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:39.812016+0000","last_undegraded":"2023-05-24T04:00:39.812016+0000","last_fullsized":"2023-05-24T04:00:39.812016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:57.390669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811982+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:39.811982+0000","last_peered":"2023-05-24T04:00:39.811982+0000","last_clean":"2023-05-24T04:00:39.811982+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:39.811982+0000","last_undegraded":"2023-05-24T04:00:39.811982+0000","last_fullsized":"2023-05-24T04:00:39.811982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:17:19.685408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808375+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:39.808375+0000","last_peered":"2023-05-24T04:00:39.808375+0000","last_clean":"2023-05-24T04:00:39.808375+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:39.808375+0000","last_undegraded":"2023-05-24T04:00:39.808375+0000","last_fullsized":"2023-05-24T04:00:39.808375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:17.724238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102989+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:40.102989+0000","last_peered":"2023-05-24T04:00:40.102989+0000","last_clean":"2023-05-24T04:00:40.102989+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:40.102989+0000","last_undegraded":"2023-05-24T04:00:40.102989+0000","last_fullsized":"2023-05-24T04:00:40.102989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:50.312748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811159+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:39.811159+0000","last_peered":"2023-05-24T04:00:39.811159+0000","last_clean":"2023-05-24T04:00:39.811159+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:39.811159+0000","last_undegraded":"2023-05-24T04:00:39.811159+0000","last_fullsized":"2023-05-24T04:00:39.811159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:56:00.664781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810571+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:39.810571+0000","last_peered":"2023-05-24T04:00:39.810571+0000","last_clean":"2023-05-24T04:00:39.810571+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:39.810571+0000","last_undegraded":"2023-05-24T04:00:39.810571+0000","last_fullsized":"2023-05-24T04:00:39.810571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:19.952827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100969+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:40.100969+0000","last_peered":"2023-05-24T04:00:40.100969+0000","last_clean":"2023-05-24T04:00:40.100969+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:40.100969+0000","last_undegraded":"2023-05-24T04:00:40.100969+0000","last_fullsized":"2023-05-24T04:00:40.100969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:41:02.080284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810519+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:39.810519+0000","last_peered":"2023-05-24T04:00:39.810519+0000","last_clean":"2023-05-24T04:00:39.810519+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:39.810519+0000","last_undegraded":"2023-05-24T04:00:39.810519+0000","last_fullsized":"2023-05-24T04:00:39.810519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:35:05.654962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100459+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:40.100459+0000","last_peered":"2023-05-24T04:00:40.100459+0000","last_clean":"2023-05-24T04:00:40.100459+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:40.100459+0000","last_undegraded":"2023-05-24T04:00:40.100459+0000","last_fullsized":"2023-05-24T04:00:40.100459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:15.156228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806108+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:39.806108+0000","last_peered":"2023-05-24T04:00:39.806108+0000","last_clean":"2023-05-24T04:00:39.806108+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:39.806108+0000","last_undegraded":"2023-05-24T04:00:39.806108+0000","last_fullsized":"2023-05-24T04:00:39.806108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:50.350647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811381+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:39.811381+0000","last_peered":"2023-05-24T04:00:39.811381+0000","last_clean":"2023-05-24T04:00:39.811381+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:39.811381+0000","last_undegraded":"2023-05-24T04:00:39.811381+0000","last_fullsized":"2023-05-24T04:00:39.811381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:39.191708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101832+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:40.101832+0000","last_peered":"2023-05-24T04:00:40.101832+0000","last_clean":"2023-05-24T04:00:40.101832+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:40.101832+0000","last_undegraded":"2023-05-24T04:00:40.101832+0000","last_fullsized":"2023-05-24T04:00:40.101832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:44.836669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805566+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:39.805566+0000","last_peered":"2023-05-24T04:00:39.805566+0000","last_clean":"2023-05-24T04:00:39.805566+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:39.805566+0000","last_undegraded":"2023-05-24T04:00:39.805566+0000","last_fullsized":"2023-05-24T04:00:39.805566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809938+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:39.809938+0000","last_peered":"2023-05-24T04:00:39.809938+0000","last_clean":"2023-05-24T04:00:39.809938+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:39.809938+0000","last_undegraded":"2023-05-24T04:00:39.809938+0000","last_fullsized":"2023-05-24T04:00:39.809938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100839+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:40.100839+0000","last_peered":"2023-05-24T04:00:40.100839+0000","last_clean":"2023-05-24T04:00:40.100839+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:40.100839+0000","last_undegraded":"2023-05-24T04:00:40.100839+0000","last_fullsized":"2023-05-24T04:00:40.100839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:45.886736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805477+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:39.805477+0000","last_peered":"2023-05-24T04:00:39.805477+0000","last_clean":"2023-05-24T04:00:39.805477+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:39.805477+0000","last_undegraded":"2023-05-24T04:00:39.805477+0000","last_fullsized":"2023-05-24T04:00:39.805477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:38.716971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807987+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:39.807987+0000","last_peered":"2023-05-24T04:00:39.807987+0000","last_clean":"2023-05-24T04:00:39.807987+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:39.807987+0000","last_undegraded":"2023-05-24T04:00:39.807987+0000","last_fullsized":"2023-05-24T04:00:39.807987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:51.406995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100571+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:40.100571+0000","last_peered":"2023-05-24T04:00:40.100571+0000","last_clean":"2023-05-24T04:00:40.100571+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:40.100571+0000","last_undegraded":"2023-05-24T04:00:40.100571+0000","last_fullsized":"2023-05-24T04:00:40.100571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805132+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:39.805132+0000","last_peered":"2023-05-24T04:00:39.805132+0000","last_clean":"2023-05-24T04:00:39.805132+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:39.805132+0000","last_undegraded":"2023-05-24T04:00:39.805132+0000","last_fullsized":"2023-05-24T04:00:39.805132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100792+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:40.100792+0000","last_peered":"2023-05-24T04:00:40.100792+0000","last_clean":"2023-05-24T04:00:40.100792+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:40.100792+0000","last_undegraded":"2023-05-24T04:00:40.100792+0000","last_fullsized":"2023-05-24T04:00:40.100792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101157+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:40.101157+0000","last_peered":"2023-05-24T04:00:40.101157+0000","last_clean":"2023-05-24T04:00:40.101157+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:40.101157+0000","last_undegraded":"2023-05-24T04:00:40.101157+0000","last_fullsized":"2023-05-24T04:00:40.101157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099062+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:40.099062+0000","last_peered":"2023-05-24T04:00:40.099062+0000","last_clean":"2023-05-24T04:00:40.099062+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:40.099062+0000","last_undegraded":"2023-05-24T04:00:40.099062+0000","last_fullsized":"2023-05-24T04:00:40.099062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:56.328860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102734+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102734+0000","last_peered":"2023-05-24T04:00:40.102734+0000","last_clean":"2023-05-24T04:00:40.102734+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102734+0000","last_undegraded":"2023-05-24T04:00:40.102734+0000","last_fullsized":"2023-05-24T04:00:40.102734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:30.684575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807393+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:39.807393+0000","last_peered":"2023-05-24T04:00:39.807393+0000","last_clean":"2023-05-24T04:00:39.807393+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:39.807393+0000","last_undegraded":"2023-05-24T04:00:39.807393+0000","last_fullsized":"2023-05-24T04:00:39.807393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:25.129357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102591+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:40.102591+0000","last_peered":"2023-05-24T04:00:40.102591+0000","last_clean":"2023-05-24T04:00:40.102591+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:40.102591+0000","last_undegraded":"2023-05-24T04:00:40.102591+0000","last_fullsized":"2023-05-24T04:00:40.102591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:16.625550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102270+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102270+0000","last_peered":"2023-05-24T04:00:40.102270+0000","last_clean":"2023-05-24T04:00:40.102270+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102270+0000","last_undegraded":"2023-05-24T04:00:40.102270+0000","last_fullsized":"2023-05-24T04:00:40.102270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:59.527296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100090+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:40.100090+0000","last_peered":"2023-05-24T04:00:40.100090+0000","last_clean":"2023-05-24T04:00:40.100090+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:40.100090+0000","last_undegraded":"2023-05-24T04:00:40.100090+0000","last_fullsized":"2023-05-24T04:00:40.100090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811649+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:39.811649+0000","last_peered":"2023-05-24T04:00:39.811649+0000","last_clean":"2023-05-24T04:00:39.811649+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:39.811649+0000","last_undegraded":"2023-05-24T04:00:39.811649+0000","last_fullsized":"2023-05-24T04:00:39.811649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810652+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:39.810652+0000","last_peered":"2023-05-24T04:00:39.810652+0000","last_clean":"2023-05-24T04:00:39.810652+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:39.810652+0000","last_undegraded":"2023-05-24T04:00:39.810652+0000","last_fullsized":"2023-05-24T04:00:39.810652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:35.507344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102742+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:40.102742+0000","last_peered":"2023-05-24T04:00:40.102742+0000","last_clean":"2023-05-24T04:00:40.102742+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:40.102742+0000","last_undegraded":"2023-05-24T04:00:40.102742+0000","last_fullsized":"2023-05-24T04:00:40.102742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100738+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:40.100738+0000","last_peered":"2023-05-24T04:00:40.100738+0000","last_clean":"2023-05-24T04:00:40.100738+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:40.100738+0000","last_undegraded":"2023-05-24T04:00:40.100738+0000","last_fullsized":"2023-05-24T04:00:40.100738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099965+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:40.099965+0000","last_peered":"2023-05-24T04:00:40.099965+0000","last_clean":"2023-05-24T04:00:40.099965+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:40.099965+0000","last_undegraded":"2023-05-24T04:00:40.099965+0000","last_fullsized":"2023-05-24T04:00:40.099965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101072+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:40.101072+0000","last_peered":"2023-05-24T04:00:40.101072+0000","last_clean":"2023-05-24T04:00:40.101072+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:40.101072+0000","last_undegraded":"2023-05-24T04:00:40.101072+0000","last_fullsized":"2023-05-24T04:00:40.101072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:59.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102049+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102049+0000","last_peered":"2023-05-24T04:00:40.102049+0000","last_clean":"2023-05-24T04:00:40.102049+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102049+0000","last_undegraded":"2023-05-24T04:00:40.102049+0000","last_fullsized":"2023-05-24T04:00:40.102049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:28.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807099+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:39.807099+0000","last_peered":"2023-05-24T04:00:39.807099+0000","last_clean":"2023-05-24T04:00:39.807099+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:39.807099+0000","last_undegraded":"2023-05-24T04:00:39.807099+0000","last_fullsized":"2023-05-24T04:00:39.807099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809456+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:39.809456+0000","last_peered":"2023-05-24T04:00:39.809456+0000","last_clean":"2023-05-24T04:00:39.809456+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:39.809456+0000","last_undegraded":"2023-05-24T04:00:39.809456+0000","last_fullsized":"2023-05-24T04:00:39.809456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:48.519772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100215+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:40.100215+0000","last_peered":"2023-05-24T04:00:40.100215+0000","last_clean":"2023-05-24T04:00:40.100215+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:40.100215+0000","last_undegraded":"2023-05-24T04:00:40.100215+0000","last_fullsized":"2023-05-24T04:00:40.100215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:48.368318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102380+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:40.102380+0000","last_peered":"2023-05-24T04:00:40.102380+0000","last_clean":"2023-05-24T04:00:40.102380+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:40.102380+0000","last_undegraded":"2023-05-24T04:00:40.102380+0000","last_fullsized":"2023-05-24T04:00:40.102380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:08:23.587331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102517+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:40.102517+0000","last_peered":"2023-05-24T04:00:40.102517+0000","last_clean":"2023-05-24T04:00:40.102517+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:40.102517+0000","last_undegraded":"2023-05-24T04:00:40.102517+0000","last_fullsized":"2023-05-24T04:00:40.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103708+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:40.103708+0000","last_peered":"2023-05-24T04:00:40.103708+0000","last_clean":"2023-05-24T04:00:40.103708+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:40.103708+0000","last_undegraded":"2023-05-24T04:00:40.103708+0000","last_fullsized":"2023-05-24T04:00:40.103708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103303+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:40.103303+0000","last_peered":"2023-05-24T04:00:40.103303+0000","last_clean":"2023-05-24T04:00:40.103303+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:40.103303+0000","last_undegraded":"2023-05-24T04:00:40.103303+0000","last_fullsized":"2023-05-24T04:00:40.103303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098609+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:40.098609+0000","last_peered":"2023-05-24T04:00:40.098609+0000","last_clean":"2023-05-24T04:00:40.098609+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:40.098609+0000","last_undegraded":"2023-05-24T04:00:40.098609+0000","last_fullsized":"2023-05-24T04:00:40.098609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:58.307422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099080+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:40.099080+0000","last_peered":"2023-05-24T04:00:40.099080+0000","last_clean":"2023-05-24T04:00:40.099080+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:40.099080+0000","last_undegraded":"2023-05-24T04:00:40.099080+0000","last_fullsized":"2023-05-24T04:00:40.099080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810553+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:39.810553+0000","last_peered":"2023-05-24T04:00:39.810553+0000","last_clean":"2023-05-24T04:00:39.810553+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:39.810553+0000","last_undegraded":"2023-05-24T04:00:39.810553+0000","last_fullsized":"2023-05-24T04:00:39.810553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099745+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:40.099745+0000","last_peered":"2023-05-24T04:00:40.099745+0000","last_clean":"2023-05-24T04:00:40.099745+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:40.099745+0000","last_undegraded":"2023-05-24T04:00:40.099745+0000","last_fullsized":"2023-05-24T04:00:40.099745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810343+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:39.810343+0000","last_peered":"2023-05-24T04:00:39.810343+0000","last_clean":"2023-05-24T04:00:39.810343+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:39.810343+0000","last_undegraded":"2023-05-24T04:00:39.810343+0000","last_fullsized":"2023-05-24T04:00:39.810343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:40:56.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806510+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:39.806510+0000","last_peered":"2023-05-24T04:00:39.806510+0000","last_clean":"2023-05-24T04:00:39.806510+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:39.806510+0000","last_undegraded":"2023-05-24T04:00:39.806510+0000","last_fullsized":"2023-05-24T04:00:39.806510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811625+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:39.811625+0000","last_peered":"2023-05-24T04:00:39.811625+0000","last_clean":"2023-05-24T04:00:39.811625+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:39.811625+0000","last_undegraded":"2023-05-24T04:00:39.811625+0000","last_fullsized":"2023-05-24T04:00:39.811625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:00:33.695719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811728+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:39.811728+0000","last_peered":"2023-05-24T04:00:39.811728+0000","last_clean":"2023-05-24T04:00:39.811728+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:39.811728+0000","last_undegraded":"2023-05-24T04:00:39.811728+0000","last_fullsized":"2023-05-24T04:00:39.811728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808246+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:39.808246+0000","last_peered":"2023-05-24T04:00:39.808246+0000","last_clean":"2023-05-24T04:00:39.808246+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:39.808246+0000","last_undegraded":"2023-05-24T04:00:39.808246+0000","last_fullsized":"2023-05-24T04:00:39.808246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:53:24.077758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099764+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:40.099764+0000","last_peered":"2023-05-24T04:00:40.099764+0000","last_clean":"2023-05-24T04:00:40.099764+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:40.099764+0000","last_undegraded":"2023-05-24T04:00:40.099764+0000","last_fullsized":"2023-05-24T04:00:40.099764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099726+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:40.099726+0000","last_peered":"2023-05-24T04:00:40.099726+0000","last_clean":"2023-05-24T04:00:40.099726+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:40.099726+0000","last_undegraded":"2023-05-24T04:00:40.099726+0000","last_fullsized":"2023-05-24T04:00:40.099726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805582+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:39.805582+0000","last_peered":"2023-05-24T04:00:39.805582+0000","last_clean":"2023-05-24T04:00:39.805582+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:39.805582+0000","last_undegraded":"2023-05-24T04:00:39.805582+0000","last_fullsized":"2023-05-24T04:00:39.805582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:39.556891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806045+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:39.806045+0000","last_peered":"2023-05-24T04:00:39.806045+0000","last_clean":"2023-05-24T04:00:39.806045+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:39.806045+0000","last_undegraded":"2023-05-24T04:00:39.806045+0000","last_fullsized":"2023-05-24T04:00:39.806045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811204+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:39.811204+0000","last_peered":"2023-05-24T04:00:39.811204+0000","last_clean":"2023-05-24T04:00:39.811204+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:39.811204+0000","last_undegraded":"2023-05-24T04:00:39.811204+0000","last_fullsized":"2023-05-24T04:00:39.811204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:17:13.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103332+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:40.103332+0000","last_peered":"2023-05-24T04:00:40.103332+0000","last_clean":"2023-05-24T04:00:40.103332+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:40.103332+0000","last_undegraded":"2023-05-24T04:00:40.103332+0000","last_fullsized":"2023-05-24T04:00:40.103332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:16.171192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811397+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:39.811397+0000","last_peered":"2023-05-24T04:00:39.811397+0000","last_clean":"2023-05-24T04:00:39.811397+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:39.811397+0000","last_undegraded":"2023-05-24T04:00:39.811397+0000","last_fullsized":"2023-05-24T04:00:39.811397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:45.851633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100566+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:40.100566+0000","last_peered":"2023-05-24T04:00:40.100566+0000","last_clean":"2023-05-24T04:00:40.100566+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:40.100566+0000","last_undegraded":"2023-05-24T04:00:40.100566+0000","last_fullsized":"2023-05-24T04:00:40.100566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:38.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099443+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:40.099443+0000","last_peered":"2023-05-24T04:00:40.099443+0000","last_clean":"2023-05-24T04:00:40.099443+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:40.099443+0000","last_undegraded":"2023-05-24T04:00:40.099443+0000","last_fullsized":"2023-05-24T04:00:40.099443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807440+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:39.807440+0000","last_peered":"2023-05-24T04:00:39.807440+0000","last_clean":"2023-05-24T04:00:39.807440+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:39.807440+0000","last_undegraded":"2023-05-24T04:00:39.807440+0000","last_fullsized":"2023-05-24T04:00:39.807440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:55:03.048298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.816564+0000","last_change":"2023-05-24T04:00:39.816564+0000","last_active":"2023-05-24T04:00:39.816564+0000","last_peered":"2023-05-24T04:00:39.816564+0000","last_clean":"2023-05-24T04:00:39.816564+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:00:39.816564+0000","last_undegraded":"2023-05-24T04:00:39.816564+0000","last_fullsized":"2023-05-24T04:00:39.816564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809247+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:39.809247+0000","last_peered":"2023-05-24T04:00:39.809247+0000","last_clean":"2023-05-24T04:00:39.809247+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:39.809247+0000","last_undegraded":"2023-05-24T04:00:39.809247+0000","last_fullsized":"2023-05-24T04:00:39.809247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810954+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:39.810954+0000","last_peered":"2023-05-24T04:00:39.810954+0000","last_clean":"2023-05-24T04:00:39.810954+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:39.810954+0000","last_undegraded":"2023-05-24T04:00:39.810954+0000","last_fullsized":"2023-05-24T04:00:39.810954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:30:14.563105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102982+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:40.102982+0000","last_peered":"2023-05-24T04:00:40.102982+0000","last_clean":"2023-05-24T04:00:40.102982+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:40.102982+0000","last_undegraded":"2023-05-24T04:00:40.102982+0000","last_fullsized":"2023-05-24T04:00:40.102982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:46.157393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807362+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:39.807362+0000","last_peered":"2023-05-24T04:00:39.807362+0000","last_clean":"2023-05-24T04:00:39.807362+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:39.807362+0000","last_undegraded":"2023-05-24T04:00:39.807362+0000","last_fullsized":"2023-05-24T04:00:39.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6241,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.76700000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.98899999999999999}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.1279999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0369999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.2390000000000001}]},{"osd":2,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.101}]},{"osd":3,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.871}]},{"osd":4,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.198},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.91100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.202},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.748}]},{"osd":1,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.105}]},{"osd":3,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.343},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.0569999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.4299999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.145},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.304}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.0469999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.84099999999999997}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.68500000000000005}]},{"osd":3,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.26}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.2130000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.173},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.345}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.749}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95199999999999996}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.78600000000000003}]},{"osd":7,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.96999999999999997}]},{"osd":3,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.103},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.395}]},{"osd":6,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.139}]},{"osd":7,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.339},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.177}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.92800000000000005}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.089}]},{"osd":7,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:01:15.556 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-24T04:01:15.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:01:15.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.709+0000 7ff4f17ab640 1 Processor -- start 2023-05-24T04:01:15.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.709+0000 7ff4f17ab640 1 -- start start 2023-05-24T04:01:15.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4f17ab640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 0x7ff4ec1505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4f17ab640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff4ec06e6d0 0x7ff4ec0bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4f17ab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec0bd630 con 0x7ff4ec0c2690 2023-05-24T04:01:15.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4f17ab640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec0bd070 con 0x7ff4ec06e6d0 2023-05-24T04:01:15.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4f17ab640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0bcb50 con 0x7ff4ec0be9b0 2023-05-24T04:01:15.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eaffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff4ec0c2690 0x7ff4ec06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51610/0 (socket says 172.21.15.40:51610) 2023-05-24T04:01:15.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eaffd640 1 -- 172.21.15.40:0/1921221369 learned_addr learned my addr 172.21.15.40:0/1921221369 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:15.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/1921221369 >> v2:172.21.15.67:3300/0 conn(0x7ff4ec06e6d0 0x7ff4ec0bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4e27fc640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 0x7ff4ec1505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198270322 0 0) 0x7ff4ec0bd630 con 0x7ff4ec0c2690 2023-05-24T04:01:15.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d8003530 con 0x7ff4ec0c2690 2023-05-24T04:01:15.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1265704549 0 0) 0x7ff4d8003530 con 0x7ff4ec0c2690 2023-05-24T04:01:15.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 msgr2=0x7ff4ec1505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:15.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 0x7ff4ec1505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 >> v2:172.21.15.67:3300/0 conn(0x7ff4ec06e6d0 msgr2=0x7ff4ec0bf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:15.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 --2- 172.21.15.40:0/1921221369 >> v2:172.21.15.67:3300/0 conn(0x7ff4ec06e6d0 0x7ff4ec0bf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0bd2c0 con 0x7ff4ec0c2690 2023-05-24T04:01:15.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7ff4dc001680 con 0x7ff4ec0c2690 2023-05-24T04:01:15.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 >> v1:172.21.15.40:6789/0 conn(0x7ff4ec0c2690 legacy=0x7ff4ec06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d8003980 0x7ff4d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 0x7ff4d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8004d10 0x7ff4d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0bd070 con 0x7ff4d8004d10 2023-05-24T04:01:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0bcb50 con 0x7ff4d8003980 2023-05-24T04:01:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d800b990 con 0x7ff4ec0be9b0 2023-05-24T04:01:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8004d10 0x7ff4d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eaffd640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d8003980 0x7ff4d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4e27fc640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 0x7ff4d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 -- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 msgr2=0x7ff4d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:15.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0be9b0 0x7ff4d80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 -- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d8003980 msgr2=0x7ff4d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:15.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d8003980 0x7ff4d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 -- 172.21.15.40:0/1921221369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8003530 con 0x7ff4d8004d10 2023-05-24T04:01:15.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.713+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8004d10 0x7ff4d8005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009fc0 tx=0x7ff4e401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e99eb01fbf4d73 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:15.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40a5ba0 con 0x7ff4d8004d10 2023-05-24T04:01:15.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400f040 con 0x7ff4d8004d10 2023-05-24T04:01:15.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4ea7fc640 1 -- 172.21.15.40:0/1921221369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40ad440 con 0x7ff4d8004d10 2023-05-24T04:01:15.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/1921221369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8004d10 msgr2=0x7ff4d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/1921221369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8004d10 0x7ff4d8005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009fc0 tx=0x7ff4e401cca0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eb7fe640 1 -- 172.21.15.40:0/1921221369 reap_dead start 2023-05-24T04:01:15.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/1921221369 shutdown_connections 2023-05-24T04:01:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/1921221369 >> 172.21.15.40:0/1921221369 conn(0x7ff4ec0726e0 msgr2=0x7ff4ec0655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/1921221369 shutdown_connections 2023-05-24T04:01:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/1921221369 wait complete. 2023-05-24T04:01:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 Processor -- start 2023-05-24T04:01:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- start start 2023-05-24T04:01:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 0x7ff4ec0b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0bb0d0 0x7ff4ec0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4ec0b7f00 0x7ff4ec1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0b95c0 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0b9950 con 0x7ff4ec0b7f00 2023-05-24T04:01:15.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0b8f00 con 0x7ff4ec0bb0d0 2023-05-24T04:01:15.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 0x7ff4ec0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 0x7ff4ec0b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49216/0 (socket says 172.21.15.40:49216) 2023-05-24T04:01:15.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 -- 172.21.15.40:0/519670789 learned_addr learned my addr 172.21.15.40:0/519670789 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:15.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4e27fc640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0bb0d0 0x7ff4ec0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4ec0b7f00 0x7ff4ec1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 -- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0bb0d0 msgr2=0x7ff4ec0b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0bb0d0 0x7ff4ec0b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 -- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4ec0b7f00 msgr2=0x7ff4ec1471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4ec0b7f00 0x7ff4ec1471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 -- 172.21.15.40:0/519670789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0c2bf0 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4e27fc640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0bb0d0 0x7ff4ec0b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:15.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eb7fe640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4ec0b7f00 0x7ff4ec1471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:15.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4eaffd640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 0x7ff4ec0b7480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc011950 tx=0x7ff4dc011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:15.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00fb60 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00fcc0 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec0c2a60 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc015650 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.717+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec1505d0 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.721+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec0b8300 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.721+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4dc0157b0 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.721+0000 7ff4e3fff640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff4cc0662b0 0x7ff4cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:15.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.721+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4dc087450 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.721+0000 7ff4e27fc640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff4cc0662b0 0x7ff4cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:15.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.721+0000 7ff4e27fc640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff4cc0662b0 0x7ff4cc068760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec148bf0 tx=0x7ff4d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:15.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.725+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff4dc058020 con 0x7ff4ec14a2a0 2023-05-24T04:01:15.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.877+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4ec0b9700 con 0x7ff4cc0662b0 2023-05-24T04:01:15.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.885+0000 7ff4e3fff640 1 -- 172.21.15.40:0/519670789 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389905 (secure 0 0 0) 0x7ff4ec0b9700 con 0x7ff4cc0662b0 2023-05-24T04:01:15.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:15.898 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:01:15.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff4cc0662b0 msgr2=0x7ff4cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff4cc0662b0 0x7ff4cc068760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec148bf0 tx=0x7ff4d4008040 comp rx=0 tx=0).stop 2023-05-24T04:01:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 msgr2=0x7ff4ec0b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 0x7ff4ec0b7480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc011950 tx=0x7ff4dc011e10 comp rx=0 tx=0).stop 2023-05-24T04:01:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 shutdown_connections 2023-05-24T04:01:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7ff4cc0662b0 0x7ff4cc068760 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4ec0b7f00 0x7ff4ec1471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4ec0bb0d0 0x7ff4ec0b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 --2- 172.21.15.40:0/519670789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4ec14a2a0 0x7ff4ec0b7480 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 >> 172.21.15.40:0/519670789 conn(0x7ff4ec0726e0 msgr2=0x7ff4ec0655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 shutdown_connections 2023-05-24T04:01:15.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:15.893+0000 7ff4f17ab640 1 -- 172.21.15.40:0/519670789 wait complete. 2023-05-24T04:01:15.916 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-05-24T04:01:14.549126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596609,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005161"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098134+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:40.098134+0000","last_peered":"2023-05-24T04:00:40.098134+0000","last_clean":"2023-05-24T04:00:40.098134+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:40.098134+0000","last_undegraded":"2023-05-24T04:00:40.098134+0000","last_fullsized":"2023-05-24T04:00:40.098134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:25:30.173497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811843+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:39.811843+0000","last_peered":"2023-05-24T04:00:39.811843+0000","last_clean":"2023-05-24T04:00:39.811843+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:39.811843+0000","last_undegraded":"2023-05-24T04:00:39.811843+0000","last_fullsized":"2023-05-24T04:00:39.811843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808631+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808631+0000","last_peered":"2023-05-24T04:00:39.808631+0000","last_clean":"2023-05-24T04:00:39.808631+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808631+0000","last_undegraded":"2023-05-24T04:00:39.808631+0000","last_fullsized":"2023-05-24T04:00:39.808631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:47:07.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807713+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807713+0000","last_peered":"2023-05-24T04:00:39.807713+0000","last_clean":"2023-05-24T04:00:39.807713+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807713+0000","last_undegraded":"2023-05-24T04:00:39.807713+0000","last_fullsized":"2023-05-24T04:00:39.807713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:54:29.409167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101558+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:40.101558+0000","last_peered":"2023-05-24T04:00:40.101558+0000","last_clean":"2023-05-24T04:00:40.101558+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:40.101558+0000","last_undegraded":"2023-05-24T04:00:40.101558+0000","last_fullsized":"2023-05-24T04:00:40.101558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:49:14.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100127+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:40.100127+0000","last_peered":"2023-05-24T04:00:40.100127+0000","last_clean":"2023-05-24T04:00:40.100127+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:40.100127+0000","last_undegraded":"2023-05-24T04:00:40.100127+0000","last_fullsized":"2023-05-24T04:00:40.100127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101621+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101621+0000","last_peered":"2023-05-24T04:00:40.101621+0000","last_clean":"2023-05-24T04:00:40.101621+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101621+0000","last_undegraded":"2023-05-24T04:00:40.101621+0000","last_fullsized":"2023-05-24T04:00:40.101621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102900+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:40.102900+0000","last_peered":"2023-05-24T04:00:40.102900+0000","last_clean":"2023-05-24T04:00:40.102900+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:40.102900+0000","last_undegraded":"2023-05-24T04:00:40.102900+0000","last_fullsized":"2023-05-24T04:00:40.102900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809068+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:39.809068+0000","last_peered":"2023-05-24T04:00:39.809068+0000","last_clean":"2023-05-24T04:00:39.809068+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:39.809068+0000","last_undegraded":"2023-05-24T04:00:39.809068+0000","last_fullsized":"2023-05-24T04:00:39.809068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:12:56.539054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099216+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099216+0000","last_peered":"2023-05-24T04:00:40.099216+0000","last_clean":"2023-05-24T04:00:40.099216+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099216+0000","last_undegraded":"2023-05-24T04:00:40.099216+0000","last_fullsized":"2023-05-24T04:00:40.099216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101865+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:40.101865+0000","last_peered":"2023-05-24T04:00:40.101865+0000","last_clean":"2023-05-24T04:00:40.101865+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:40.101865+0000","last_undegraded":"2023-05-24T04:00:40.101865+0000","last_fullsized":"2023-05-24T04:00:40.101865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:54.557612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809755+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:39.809755+0000","last_peered":"2023-05-24T04:00:39.809755+0000","last_clean":"2023-05-24T04:00:39.809755+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:39.809755+0000","last_undegraded":"2023-05-24T04:00:39.809755+0000","last_fullsized":"2023-05-24T04:00:39.809755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:45.203491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102303+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:40.102303+0000","last_peered":"2023-05-24T04:00:40.102303+0000","last_clean":"2023-05-24T04:00:40.102303+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:40.102303+0000","last_undegraded":"2023-05-24T04:00:40.102303+0000","last_fullsized":"2023-05-24T04:00:40.102303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:04:41.791492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811965+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:39.811965+0000","last_peered":"2023-05-24T04:00:39.811965+0000","last_clean":"2023-05-24T04:00:39.811965+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:39.811965+0000","last_undegraded":"2023-05-24T04:00:39.811965+0000","last_fullsized":"2023-05-24T04:00:39.811965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806100+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:39.806100+0000","last_peered":"2023-05-24T04:00:39.806100+0000","last_clean":"2023-05-24T04:00:39.806100+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:39.806100+0000","last_undegraded":"2023-05-24T04:00:39.806100+0000","last_fullsized":"2023-05-24T04:00:39.806100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:37:15.796537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809729+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:39.809729+0000","last_peered":"2023-05-24T04:00:39.809729+0000","last_clean":"2023-05-24T04:00:39.809729+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:39.809729+0000","last_undegraded":"2023-05-24T04:00:39.809729+0000","last_fullsized":"2023-05-24T04:00:39.809729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:06:22.746009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101645+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:40.101645+0000","last_peered":"2023-05-24T04:00:40.101645+0000","last_clean":"2023-05-24T04:00:40.101645+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:40.101645+0000","last_undegraded":"2023-05-24T04:00:40.101645+0000","last_fullsized":"2023-05-24T04:00:40.101645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:20:52.502756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812080+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:39.812080+0000","last_peered":"2023-05-24T04:00:39.812080+0000","last_clean":"2023-05-24T04:00:39.812080+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:39.812080+0000","last_undegraded":"2023-05-24T04:00:39.812080+0000","last_fullsized":"2023-05-24T04:00:39.812080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:31.402385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811197+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:39.811197+0000","last_peered":"2023-05-24T04:00:39.811197+0000","last_clean":"2023-05-24T04:00:39.811197+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:39.811197+0000","last_undegraded":"2023-05-24T04:00:39.811197+0000","last_fullsized":"2023-05-24T04:00:39.811197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810982+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:39.810982+0000","last_peered":"2023-05-24T04:00:39.810982+0000","last_clean":"2023-05-24T04:00:39.810982+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:39.810982+0000","last_undegraded":"2023-05-24T04:00:39.810982+0000","last_fullsized":"2023-05-24T04:00:39.810982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099052+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:40.099052+0000","last_peered":"2023-05-24T04:00:40.099052+0000","last_clean":"2023-05-24T04:00:40.099052+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:40.099052+0000","last_undegraded":"2023-05-24T04:00:40.099052+0000","last_fullsized":"2023-05-24T04:00:40.099052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:23.810199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812582+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:39.812582+0000","last_peered":"2023-05-24T04:00:39.812582+0000","last_clean":"2023-05-24T04:00:39.812582+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:39.812582+0000","last_undegraded":"2023-05-24T04:00:39.812582+0000","last_fullsized":"2023-05-24T04:00:39.812582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098638+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:40.098638+0000","last_peered":"2023-05-24T04:00:40.098638+0000","last_clean":"2023-05-24T04:00:40.098638+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:40.098638+0000","last_undegraded":"2023-05-24T04:00:40.098638+0000","last_fullsized":"2023-05-24T04:00:40.098638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812113+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:39.812113+0000","last_peered":"2023-05-24T04:00:39.812113+0000","last_clean":"2023-05-24T04:00:39.812113+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:39.812113+0000","last_undegraded":"2023-05-24T04:00:39.812113+0000","last_fullsized":"2023-05-24T04:00:39.812113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808823+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:39.808823+0000","last_peered":"2023-05-24T04:00:39.808823+0000","last_clean":"2023-05-24T04:00:39.808823+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:39.808823+0000","last_undegraded":"2023-05-24T04:00:39.808823+0000","last_fullsized":"2023-05-24T04:00:39.808823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:36.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099608+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:40.099608+0000","last_peered":"2023-05-24T04:00:40.099608+0000","last_clean":"2023-05-24T04:00:40.099608+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:40.099608+0000","last_undegraded":"2023-05-24T04:00:40.099608+0000","last_fullsized":"2023-05-24T04:00:40.099608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:13.713373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103289+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:40.103289+0000","last_peered":"2023-05-24T04:00:40.103289+0000","last_clean":"2023-05-24T04:00:40.103289+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:40.103289+0000","last_undegraded":"2023-05-24T04:00:40.103289+0000","last_fullsized":"2023-05-24T04:00:40.103289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098253+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:40.098253+0000","last_peered":"2023-05-24T04:00:40.098253+0000","last_clean":"2023-05-24T04:00:40.098253+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:40.098253+0000","last_undegraded":"2023-05-24T04:00:40.098253+0000","last_fullsized":"2023-05-24T04:00:40.098253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100587+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:40.100587+0000","last_peered":"2023-05-24T04:00:40.100587+0000","last_clean":"2023-05-24T04:00:40.100587+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:40.100587+0000","last_undegraded":"2023-05-24T04:00:40.100587+0000","last_fullsized":"2023-05-24T04:00:40.100587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100516+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:40.100516+0000","last_peered":"2023-05-24T04:00:40.100516+0000","last_clean":"2023-05-24T04:00:40.100516+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:40.100516+0000","last_undegraded":"2023-05-24T04:00:40.100516+0000","last_fullsized":"2023-05-24T04:00:40.100516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:25:01.484129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099676+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099676+0000","last_peered":"2023-05-24T04:00:40.099676+0000","last_clean":"2023-05-24T04:00:40.099676+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099676+0000","last_undegraded":"2023-05-24T04:00:40.099676+0000","last_fullsized":"2023-05-24T04:00:40.099676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:49.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'16","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:52.682070+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:00:52.682070+0000","last_peered":"2023-05-24T04:00:52.682070+0000","last_clean":"2023-05-24T04:00:52.682070+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:00:52.682070+0000","last_undegraded":"2023-05-24T04:00:52.682070+0000","last_fullsized":"2023-05-24T04:00:52.682070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:13.476915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5443,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:39:14.636334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099694+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:40.099694+0000","last_peered":"2023-05-24T04:00:40.099694+0000","last_clean":"2023-05-24T04:00:40.099694+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:40.099694+0000","last_undegraded":"2023-05-24T04:00:40.099694+0000","last_fullsized":"2023-05-24T04:00:40.099694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:00.182042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808228+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:39.808228+0000","last_peered":"2023-05-24T04:00:39.808228+0000","last_clean":"2023-05-24T04:00:39.808228+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:39.808228+0000","last_undegraded":"2023-05-24T04:00:39.808228+0000","last_fullsized":"2023-05-24T04:00:39.808228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:32.909184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812908+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:39.812908+0000","last_peered":"2023-05-24T04:00:39.812908+0000","last_clean":"2023-05-24T04:00:39.812908+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:39.812908+0000","last_undegraded":"2023-05-24T04:00:39.812908+0000","last_fullsized":"2023-05-24T04:00:39.812908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:45.501543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811949+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:39.811949+0000","last_peered":"2023-05-24T04:00:39.811949+0000","last_clean":"2023-05-24T04:00:39.811949+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:39.811949+0000","last_undegraded":"2023-05-24T04:00:39.811949+0000","last_fullsized":"2023-05-24T04:00:39.811949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.097881+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:40.097881+0000","last_peered":"2023-05-24T04:00:40.097881+0000","last_clean":"2023-05-24T04:00:40.097881+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:40.097881+0000","last_undegraded":"2023-05-24T04:00:40.097881+0000","last_fullsized":"2023-05-24T04:00:40.097881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098933+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:40.098933+0000","last_peered":"2023-05-24T04:00:40.098933+0000","last_clean":"2023-05-24T04:00:40.098933+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:40.098933+0000","last_undegraded":"2023-05-24T04:00:40.098933+0000","last_fullsized":"2023-05-24T04:00:40.098933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104154+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:40.104154+0000","last_peered":"2023-05-24T04:00:40.104154+0000","last_clean":"2023-05-24T04:00:40.104154+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:40.104154+0000","last_undegraded":"2023-05-24T04:00:40.104154+0000","last_fullsized":"2023-05-24T04:00:40.104154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102855+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:40.102855+0000","last_peered":"2023-05-24T04:00:40.102855+0000","last_clean":"2023-05-24T04:00:40.102855+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:40.102855+0000","last_undegraded":"2023-05-24T04:00:40.102855+0000","last_fullsized":"2023-05-24T04:00:40.102855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:21:15.498619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807527+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:39.807527+0000","last_peered":"2023-05-24T04:00:39.807527+0000","last_clean":"2023-05-24T04:00:39.807527+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:39.807527+0000","last_undegraded":"2023-05-24T04:00:39.807527+0000","last_fullsized":"2023-05-24T04:00:39.807527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:50:20.457205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811559+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:39.811559+0000","last_peered":"2023-05-24T04:00:39.811559+0000","last_clean":"2023-05-24T04:00:39.811559+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:39.811559+0000","last_undegraded":"2023-05-24T04:00:39.811559+0000","last_fullsized":"2023-05-24T04:00:39.811559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101081+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:40.101081+0000","last_peered":"2023-05-24T04:00:40.101081+0000","last_clean":"2023-05-24T04:00:40.101081+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:40.101081+0000","last_undegraded":"2023-05-24T04:00:40.101081+0000","last_fullsized":"2023-05-24T04:00:40.101081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:43.311066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102093+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:40.102093+0000","last_peered":"2023-05-24T04:00:40.102093+0000","last_clean":"2023-05-24T04:00:40.102093+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:40.102093+0000","last_undegraded":"2023-05-24T04:00:40.102093+0000","last_fullsized":"2023-05-24T04:00:40.102093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:38.719131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809601+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:39.809601+0000","last_peered":"2023-05-24T04:00:39.809601+0000","last_clean":"2023-05-24T04:00:39.809601+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:39.809601+0000","last_undegraded":"2023-05-24T04:00:39.809601+0000","last_fullsized":"2023-05-24T04:00:39.809601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:59.234197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100812+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:40.100812+0000","last_peered":"2023-05-24T04:00:40.100812+0000","last_clean":"2023-05-24T04:00:40.100812+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:40.100812+0000","last_undegraded":"2023-05-24T04:00:40.100812+0000","last_fullsized":"2023-05-24T04:00:40.100812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:35:54.009858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102670+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:40.102670+0000","last_peered":"2023-05-24T04:00:40.102670+0000","last_clean":"2023-05-24T04:00:40.102670+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:40.102670+0000","last_undegraded":"2023-05-24T04:00:40.102670+0000","last_fullsized":"2023-05-24T04:00:40.102670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:32.061491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103107+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:40.103107+0000","last_peered":"2023-05-24T04:00:40.103107+0000","last_clean":"2023-05-24T04:00:40.103107+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:40.103107+0000","last_undegraded":"2023-05-24T04:00:40.103107+0000","last_fullsized":"2023-05-24T04:00:40.103107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:47.353354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811169+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:39.811169+0000","last_peered":"2023-05-24T04:00:39.811169+0000","last_clean":"2023-05-24T04:00:39.811169+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:39.811169+0000","last_undegraded":"2023-05-24T04:00:39.811169+0000","last_fullsized":"2023-05-24T04:00:39.811169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:42.314974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101790+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:40.101790+0000","last_peered":"2023-05-24T04:00:40.101790+0000","last_clean":"2023-05-24T04:00:40.101790+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:40.101790+0000","last_undegraded":"2023-05-24T04:00:40.101790+0000","last_fullsized":"2023-05-24T04:00:40.101790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:00:21.503763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810092+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:39.810092+0000","last_peered":"2023-05-24T04:00:39.810092+0000","last_clean":"2023-05-24T04:00:39.810092+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:39.810092+0000","last_undegraded":"2023-05-24T04:00:39.810092+0000","last_fullsized":"2023-05-24T04:00:39.810092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:36.913572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100241+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:40.100241+0000","last_peered":"2023-05-24T04:00:40.100241+0000","last_clean":"2023-05-24T04:00:40.100241+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:40.100241+0000","last_undegraded":"2023-05-24T04:00:40.100241+0000","last_fullsized":"2023-05-24T04:00:40.100241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811058+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:39.811058+0000","last_peered":"2023-05-24T04:00:39.811058+0000","last_clean":"2023-05-24T04:00:39.811058+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:39.811058+0000","last_undegraded":"2023-05-24T04:00:39.811058+0000","last_fullsized":"2023-05-24T04:00:39.811058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:45:01.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104757+0000","last_change":"2023-05-24T04:00:40.102360+0000","last_active":"2023-05-24T04:00:40.104757+0000","last_peered":"2023-05-24T04:00:40.104757+0000","last_clean":"2023-05-24T04:00:40.104757+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:00:40.104757+0000","last_undegraded":"2023-05-24T04:00:40.104757+0000","last_fullsized":"2023-05-24T04:00:40.104757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098405+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:40.098405+0000","last_peered":"2023-05-24T04:00:40.098405+0000","last_clean":"2023-05-24T04:00:40.098405+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:40.098405+0000","last_undegraded":"2023-05-24T04:00:40.098405+0000","last_fullsized":"2023-05-24T04:00:40.098405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:22:56.621238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806011+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:39.806011+0000","last_peered":"2023-05-24T04:00:39.806011+0000","last_clean":"2023-05-24T04:00:39.806011+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:39.806011+0000","last_undegraded":"2023-05-24T04:00:39.806011+0000","last_fullsized":"2023-05-24T04:00:39.806011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:17.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806066+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:39.806066+0000","last_peered":"2023-05-24T04:00:39.806066+0000","last_clean":"2023-05-24T04:00:39.806066+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:39.806066+0000","last_undegraded":"2023-05-24T04:00:39.806066+0000","last_fullsized":"2023-05-24T04:00:39.806066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811579+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:39.811579+0000","last_peered":"2023-05-24T04:00:39.811579+0000","last_clean":"2023-05-24T04:00:39.811579+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:39.811579+0000","last_undegraded":"2023-05-24T04:00:39.811579+0000","last_fullsized":"2023-05-24T04:00:39.811579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810390+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:39.810390+0000","last_peered":"2023-05-24T04:00:39.810390+0000","last_clean":"2023-05-24T04:00:39.810390+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:39.810390+0000","last_undegraded":"2023-05-24T04:00:39.810390+0000","last_fullsized":"2023-05-24T04:00:39.810390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:36.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098998+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:40.098998+0000","last_peered":"2023-05-24T04:00:40.098998+0000","last_clean":"2023-05-24T04:00:40.098998+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:40.098998+0000","last_undegraded":"2023-05-24T04:00:40.098998+0000","last_fullsized":"2023-05-24T04:00:40.098998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:33.846674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103363+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:40.103363+0000","last_peered":"2023-05-24T04:00:40.103363+0000","last_clean":"2023-05-24T04:00:40.103363+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:40.103363+0000","last_undegraded":"2023-05-24T04:00:40.103363+0000","last_fullsized":"2023-05-24T04:00:40.103363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811513+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:39.811513+0000","last_peered":"2023-05-24T04:00:39.811513+0000","last_clean":"2023-05-24T04:00:39.811513+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:39.811513+0000","last_undegraded":"2023-05-24T04:00:39.811513+0000","last_fullsized":"2023-05-24T04:00:39.811513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:20.313678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100288+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:40.100288+0000","last_peered":"2023-05-24T04:00:40.100288+0000","last_clean":"2023-05-24T04:00:40.100288+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:40.100288+0000","last_undegraded":"2023-05-24T04:00:40.100288+0000","last_fullsized":"2023-05-24T04:00:40.100288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101907+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:40.101907+0000","last_peered":"2023-05-24T04:00:40.101907+0000","last_clean":"2023-05-24T04:00:40.101907+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:40.101907+0000","last_undegraded":"2023-05-24T04:00:40.101907+0000","last_fullsized":"2023-05-24T04:00:40.101907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:08.298712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099345+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:40.099345+0000","last_peered":"2023-05-24T04:00:40.099345+0000","last_clean":"2023-05-24T04:00:40.099345+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:40.099345+0000","last_undegraded":"2023-05-24T04:00:40.099345+0000","last_fullsized":"2023-05-24T04:00:40.099345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.596528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099215+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:40.099215+0000","last_peered":"2023-05-24T04:00:40.099215+0000","last_clean":"2023-05-24T04:00:40.099215+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:40.099215+0000","last_undegraded":"2023-05-24T04:00:40.099215+0000","last_fullsized":"2023-05-24T04:00:40.099215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103467+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:40.103467+0000","last_peered":"2023-05-24T04:00:40.103467+0000","last_clean":"2023-05-24T04:00:40.103467+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:40.103467+0000","last_undegraded":"2023-05-24T04:00:40.103467+0000","last_fullsized":"2023-05-24T04:00:40.103467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:36.522307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099294+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:40.099294+0000","last_peered":"2023-05-24T04:00:40.099294+0000","last_clean":"2023-05-24T04:00:40.099294+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:40.099294+0000","last_undegraded":"2023-05-24T04:00:40.099294+0000","last_fullsized":"2023-05-24T04:00:40.099294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812016+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:39.812016+0000","last_peered":"2023-05-24T04:00:39.812016+0000","last_clean":"2023-05-24T04:00:39.812016+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:39.812016+0000","last_undegraded":"2023-05-24T04:00:39.812016+0000","last_fullsized":"2023-05-24T04:00:39.812016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:57.390669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811982+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:39.811982+0000","last_peered":"2023-05-24T04:00:39.811982+0000","last_clean":"2023-05-24T04:00:39.811982+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:39.811982+0000","last_undegraded":"2023-05-24T04:00:39.811982+0000","last_fullsized":"2023-05-24T04:00:39.811982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:17:19.685408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808375+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:39.808375+0000","last_peered":"2023-05-24T04:00:39.808375+0000","last_clean":"2023-05-24T04:00:39.808375+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:39.808375+0000","last_undegraded":"2023-05-24T04:00:39.808375+0000","last_fullsized":"2023-05-24T04:00:39.808375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:17.724238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102989+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:40.102989+0000","last_peered":"2023-05-24T04:00:40.102989+0000","last_clean":"2023-05-24T04:00:40.102989+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:40.102989+0000","last_undegraded":"2023-05-24T04:00:40.102989+0000","last_fullsized":"2023-05-24T04:00:40.102989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:50.312748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811159+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:39.811159+0000","last_peered":"2023-05-24T04:00:39.811159+0000","last_clean":"2023-05-24T04:00:39.811159+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:39.811159+0000","last_undegraded":"2023-05-24T04:00:39.811159+0000","last_fullsized":"2023-05-24T04:00:39.811159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:56:00.664781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810571+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:39.810571+0000","last_peered":"2023-05-24T04:00:39.810571+0000","last_clean":"2023-05-24T04:00:39.810571+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:39.810571+0000","last_undegraded":"2023-05-24T04:00:39.810571+0000","last_fullsized":"2023-05-24T04:00:39.810571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:19.952827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100969+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:40.100969+0000","last_peered":"2023-05-24T04:00:40.100969+0000","last_clean":"2023-05-24T04:00:40.100969+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:40.100969+0000","last_undegraded":"2023-05-24T04:00:40.100969+0000","last_fullsized":"2023-05-24T04:00:40.100969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:41:02.080284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810519+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:39.810519+0000","last_peered":"2023-05-24T04:00:39.810519+0000","last_clean":"2023-05-24T04:00:39.810519+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:39.810519+0000","last_undegraded":"2023-05-24T04:00:39.810519+0000","last_fullsized":"2023-05-24T04:00:39.810519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:35:05.654962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100459+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:40.100459+0000","last_peered":"2023-05-24T04:00:40.100459+0000","last_clean":"2023-05-24T04:00:40.100459+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:40.100459+0000","last_undegraded":"2023-05-24T04:00:40.100459+0000","last_fullsized":"2023-05-24T04:00:40.100459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:15.156228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806108+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:39.806108+0000","last_peered":"2023-05-24T04:00:39.806108+0000","last_clean":"2023-05-24T04:00:39.806108+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:39.806108+0000","last_undegraded":"2023-05-24T04:00:39.806108+0000","last_fullsized":"2023-05-24T04:00:39.806108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:50.350647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811381+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:39.811381+0000","last_peered":"2023-05-24T04:00:39.811381+0000","last_clean":"2023-05-24T04:00:39.811381+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:39.811381+0000","last_undegraded":"2023-05-24T04:00:39.811381+0000","last_fullsized":"2023-05-24T04:00:39.811381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:39.191708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101832+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:40.101832+0000","last_peered":"2023-05-24T04:00:40.101832+0000","last_clean":"2023-05-24T04:00:40.101832+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:40.101832+0000","last_undegraded":"2023-05-24T04:00:40.101832+0000","last_fullsized":"2023-05-24T04:00:40.101832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:44.836669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805566+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:39.805566+0000","last_peered":"2023-05-24T04:00:39.805566+0000","last_clean":"2023-05-24T04:00:39.805566+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:39.805566+0000","last_undegraded":"2023-05-24T04:00:39.805566+0000","last_fullsized":"2023-05-24T04:00:39.805566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809938+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:39.809938+0000","last_peered":"2023-05-24T04:00:39.809938+0000","last_clean":"2023-05-24T04:00:39.809938+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:39.809938+0000","last_undegraded":"2023-05-24T04:00:39.809938+0000","last_fullsized":"2023-05-24T04:00:39.809938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100839+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:40.100839+0000","last_peered":"2023-05-24T04:00:40.100839+0000","last_clean":"2023-05-24T04:00:40.100839+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:40.100839+0000","last_undegraded":"2023-05-24T04:00:40.100839+0000","last_fullsized":"2023-05-24T04:00:40.100839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:45.886736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805477+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:39.805477+0000","last_peered":"2023-05-24T04:00:39.805477+0000","last_clean":"2023-05-24T04:00:39.805477+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:39.805477+0000","last_undegraded":"2023-05-24T04:00:39.805477+0000","last_fullsized":"2023-05-24T04:00:39.805477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:38.716971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807987+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:39.807987+0000","last_peered":"2023-05-24T04:00:39.807987+0000","last_clean":"2023-05-24T04:00:39.807987+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:39.807987+0000","last_undegraded":"2023-05-24T04:00:39.807987+0000","last_fullsized":"2023-05-24T04:00:39.807987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:51.406995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100571+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:40.100571+0000","last_peered":"2023-05-24T04:00:40.100571+0000","last_clean":"2023-05-24T04:00:40.100571+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:40.100571+0000","last_undegraded":"2023-05-24T04:00:40.100571+0000","last_fullsized":"2023-05-24T04:00:40.100571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805132+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:39.805132+0000","last_peered":"2023-05-24T04:00:39.805132+0000","last_clean":"2023-05-24T04:00:39.805132+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:39.805132+0000","last_undegraded":"2023-05-24T04:00:39.805132+0000","last_fullsized":"2023-05-24T04:00:39.805132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100792+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:40.100792+0000","last_peered":"2023-05-24T04:00:40.100792+0000","last_clean":"2023-05-24T04:00:40.100792+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:40.100792+0000","last_undegraded":"2023-05-24T04:00:40.100792+0000","last_fullsized":"2023-05-24T04:00:40.100792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101157+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:40.101157+0000","last_peered":"2023-05-24T04:00:40.101157+0000","last_clean":"2023-05-24T04:00:40.101157+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:40.101157+0000","last_undegraded":"2023-05-24T04:00:40.101157+0000","last_fullsized":"2023-05-24T04:00:40.101157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099062+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:40.099062+0000","last_peered":"2023-05-24T04:00:40.099062+0000","last_clean":"2023-05-24T04:00:40.099062+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:40.099062+0000","last_undegraded":"2023-05-24T04:00:40.099062+0000","last_fullsized":"2023-05-24T04:00:40.099062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:56.328860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102734+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102734+0000","last_peered":"2023-05-24T04:00:40.102734+0000","last_clean":"2023-05-24T04:00:40.102734+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102734+0000","last_undegraded":"2023-05-24T04:00:40.102734+0000","last_fullsized":"2023-05-24T04:00:40.102734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:30.684575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807393+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:39.807393+0000","last_peered":"2023-05-24T04:00:39.807393+0000","last_clean":"2023-05-24T04:00:39.807393+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:39.807393+0000","last_undegraded":"2023-05-24T04:00:39.807393+0000","last_fullsized":"2023-05-24T04:00:39.807393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:25.129357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102591+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:40.102591+0000","last_peered":"2023-05-24T04:00:40.102591+0000","last_clean":"2023-05-24T04:00:40.102591+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:40.102591+0000","last_undegraded":"2023-05-24T04:00:40.102591+0000","last_fullsized":"2023-05-24T04:00:40.102591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:16.625550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102270+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102270+0000","last_peered":"2023-05-24T04:00:40.102270+0000","last_clean":"2023-05-24T04:00:40.102270+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102270+0000","last_undegraded":"2023-05-24T04:00:40.102270+0000","last_fullsized":"2023-05-24T04:00:40.102270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:59.527296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100090+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:40.100090+0000","last_peered":"2023-05-24T04:00:40.100090+0000","last_clean":"2023-05-24T04:00:40.100090+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:40.100090+0000","last_undegraded":"2023-05-24T04:00:40.100090+0000","last_fullsized":"2023-05-24T04:00:40.100090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811649+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:39.811649+0000","last_peered":"2023-05-24T04:00:39.811649+0000","last_clean":"2023-05-24T04:00:39.811649+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:39.811649+0000","last_undegraded":"2023-05-24T04:00:39.811649+0000","last_fullsized":"2023-05-24T04:00:39.811649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810652+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:39.810652+0000","last_peered":"2023-05-24T04:00:39.810652+0000","last_clean":"2023-05-24T04:00:39.810652+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:39.810652+0000","last_undegraded":"2023-05-24T04:00:39.810652+0000","last_fullsized":"2023-05-24T04:00:39.810652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:35.507344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102742+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:40.102742+0000","last_peered":"2023-05-24T04:00:40.102742+0000","last_clean":"2023-05-24T04:00:40.102742+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:40.102742+0000","last_undegraded":"2023-05-24T04:00:40.102742+0000","last_fullsized":"2023-05-24T04:00:40.102742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100738+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:40.100738+0000","last_peered":"2023-05-24T04:00:40.100738+0000","last_clean":"2023-05-24T04:00:40.100738+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:40.100738+0000","last_undegraded":"2023-05-24T04:00:40.100738+0000","last_fullsized":"2023-05-24T04:00:40.100738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099965+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:40.099965+0000","last_peered":"2023-05-24T04:00:40.099965+0000","last_clean":"2023-05-24T04:00:40.099965+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:40.099965+0000","last_undegraded":"2023-05-24T04:00:40.099965+0000","last_fullsized":"2023-05-24T04:00:40.099965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101072+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:40.101072+0000","last_peered":"2023-05-24T04:00:40.101072+0000","last_clean":"2023-05-24T04:00:40.101072+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:40.101072+0000","last_undegraded":"2023-05-24T04:00:40.101072+0000","last_fullsized":"2023-05-24T04:00:40.101072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:59.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102049+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102049+0000","last_peered":"2023-05-24T04:00:40.102049+0000","last_clean":"2023-05-24T04:00:40.102049+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102049+0000","last_undegraded":"2023-05-24T04:00:40.102049+0000","last_fullsized":"2023-05-24T04:00:40.102049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:28.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807099+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:39.807099+0000","last_peered":"2023-05-24T04:00:39.807099+0000","last_clean":"2023-05-24T04:00:39.807099+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:39.807099+0000","last_undegraded":"2023-05-24T04:00:39.807099+0000","last_fullsized":"2023-05-24T04:00:39.807099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809456+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:39.809456+0000","last_peered":"2023-05-24T04:00:39.809456+0000","last_clean":"2023-05-24T04:00:39.809456+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:39.809456+0000","last_undegraded":"2023-05-24T04:00:39.809456+0000","last_fullsized":"2023-05-24T04:00:39.809456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:48.519772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100215+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:40.100215+0000","last_peered":"2023-05-24T04:00:40.100215+0000","last_clean":"2023-05-24T04:00:40.100215+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:40.100215+0000","last_undegraded":"2023-05-24T04:00:40.100215+0000","last_fullsized":"2023-05-24T04:00:40.100215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:48.368318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102380+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:40.102380+0000","last_peered":"2023-05-24T04:00:40.102380+0000","last_clean":"2023-05-24T04:00:40.102380+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:40.102380+0000","last_undegraded":"2023-05-24T04:00:40.102380+0000","last_fullsized":"2023-05-24T04:00:40.102380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:08:23.587331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102517+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:40.102517+0000","last_peered":"2023-05-24T04:00:40.102517+0000","last_clean":"2023-05-24T04:00:40.102517+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:40.102517+0000","last_undegraded":"2023-05-24T04:00:40.102517+0000","last_fullsized":"2023-05-24T04:00:40.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103708+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:40.103708+0000","last_peered":"2023-05-24T04:00:40.103708+0000","last_clean":"2023-05-24T04:00:40.103708+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:40.103708+0000","last_undegraded":"2023-05-24T04:00:40.103708+0000","last_fullsized":"2023-05-24T04:00:40.103708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103303+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:40.103303+0000","last_peered":"2023-05-24T04:00:40.103303+0000","last_clean":"2023-05-24T04:00:40.103303+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:40.103303+0000","last_undegraded":"2023-05-24T04:00:40.103303+0000","last_fullsized":"2023-05-24T04:00:40.103303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098609+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:40.098609+0000","last_peered":"2023-05-24T04:00:40.098609+0000","last_clean":"2023-05-24T04:00:40.098609+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:40.098609+0000","last_undegraded":"2023-05-24T04:00:40.098609+0000","last_fullsized":"2023-05-24T04:00:40.098609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:58.307422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099080+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:40.099080+0000","last_peered":"2023-05-24T04:00:40.099080+0000","last_clean":"2023-05-24T04:00:40.099080+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:40.099080+0000","last_undegraded":"2023-05-24T04:00:40.099080+0000","last_fullsized":"2023-05-24T04:00:40.099080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810553+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:39.810553+0000","last_peered":"2023-05-24T04:00:39.810553+0000","last_clean":"2023-05-24T04:00:39.810553+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:39.810553+0000","last_undegraded":"2023-05-24T04:00:39.810553+0000","last_fullsized":"2023-05-24T04:00:39.810553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099745+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:40.099745+0000","last_peered":"2023-05-24T04:00:40.099745+0000","last_clean":"2023-05-24T04:00:40.099745+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:40.099745+0000","last_undegraded":"2023-05-24T04:00:40.099745+0000","last_fullsized":"2023-05-24T04:00:40.099745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810343+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:39.810343+0000","last_peered":"2023-05-24T04:00:39.810343+0000","last_clean":"2023-05-24T04:00:39.810343+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:39.810343+0000","last_undegraded":"2023-05-24T04:00:39.810343+0000","last_fullsized":"2023-05-24T04:00:39.810343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:40:56.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806510+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:39.806510+0000","last_peered":"2023-05-24T04:00:39.806510+0000","last_clean":"2023-05-24T04:00:39.806510+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:39.806510+0000","last_undegraded":"2023-05-24T04:00:39.806510+0000","last_fullsized":"2023-05-24T04:00:39.806510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811625+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:39.811625+0000","last_peered":"2023-05-24T04:00:39.811625+0000","last_clean":"2023-05-24T04:00:39.811625+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:39.811625+0000","last_undegraded":"2023-05-24T04:00:39.811625+0000","last_fullsized":"2023-05-24T04:00:39.811625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:00:33.695719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811728+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:39.811728+0000","last_peered":"2023-05-24T04:00:39.811728+0000","last_clean":"2023-05-24T04:00:39.811728+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:39.811728+0000","last_undegraded":"2023-05-24T04:00:39.811728+0000","last_fullsized":"2023-05-24T04:00:39.811728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808246+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:39.808246+0000","last_peered":"2023-05-24T04:00:39.808246+0000","last_clean":"2023-05-24T04:00:39.808246+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:39.808246+0000","last_undegraded":"2023-05-24T04:00:39.808246+0000","last_fullsized":"2023-05-24T04:00:39.808246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:53:24.077758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099764+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:40.099764+0000","last_peered":"2023-05-24T04:00:40.099764+0000","last_clean":"2023-05-24T04:00:40.099764+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:40.099764+0000","last_undegraded":"2023-05-24T04:00:40.099764+0000","last_fullsized":"2023-05-24T04:00:40.099764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099726+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:40.099726+0000","last_peered":"2023-05-24T04:00:40.099726+0000","last_clean":"2023-05-24T04:00:40.099726+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:40.099726+0000","last_undegraded":"2023-05-24T04:00:40.099726+0000","last_fullsized":"2023-05-24T04:00:40.099726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805582+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:39.805582+0000","last_peered":"2023-05-24T04:00:39.805582+0000","last_clean":"2023-05-24T04:00:39.805582+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:39.805582+0000","last_undegraded":"2023-05-24T04:00:39.805582+0000","last_fullsized":"2023-05-24T04:00:39.805582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:39.556891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806045+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:39.806045+0000","last_peered":"2023-05-24T04:00:39.806045+0000","last_clean":"2023-05-24T04:00:39.806045+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:39.806045+0000","last_undegraded":"2023-05-24T04:00:39.806045+0000","last_fullsized":"2023-05-24T04:00:39.806045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811204+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:39.811204+0000","last_peered":"2023-05-24T04:00:39.811204+0000","last_clean":"2023-05-24T04:00:39.811204+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:39.811204+0000","last_undegraded":"2023-05-24T04:00:39.811204+0000","last_fullsized":"2023-05-24T04:00:39.811204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:17:13.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103332+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:40.103332+0000","last_peered":"2023-05-24T04:00:40.103332+0000","last_clean":"2023-05-24T04:00:40.103332+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:40.103332+0000","last_undegraded":"2023-05-24T04:00:40.103332+0000","last_fullsized":"2023-05-24T04:00:40.103332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:16.171192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811397+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:39.811397+0000","last_peered":"2023-05-24T04:00:39.811397+0000","last_clean":"2023-05-24T04:00:39.811397+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:39.811397+0000","last_undegraded":"2023-05-24T04:00:39.811397+0000","last_fullsized":"2023-05-24T04:00:39.811397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:45.851633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100566+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:40.100566+0000","last_peered":"2023-05-24T04:00:40.100566+0000","last_clean":"2023-05-24T04:00:40.100566+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:40.100566+0000","last_undegraded":"2023-05-24T04:00:40.100566+0000","last_fullsized":"2023-05-24T04:00:40.100566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:38.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099443+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:40.099443+0000","last_peered":"2023-05-24T04:00:40.099443+0000","last_clean":"2023-05-24T04:00:40.099443+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:40.099443+0000","last_undegraded":"2023-05-24T04:00:40.099443+0000","last_fullsized":"2023-05-24T04:00:40.099443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807440+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:39.807440+0000","last_peered":"2023-05-24T04:00:39.807440+0000","last_clean":"2023-05-24T04:00:39.807440+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:39.807440+0000","last_undegraded":"2023-05-24T04:00:39.807440+0000","last_fullsized":"2023-05-24T04:00:39.807440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:55:03.048298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.816564+0000","last_change":"2023-05-24T04:00:39.816564+0000","last_active":"2023-05-24T04:00:39.816564+0000","last_peered":"2023-05-24T04:00:39.816564+0000","last_clean":"2023-05-24T04:00:39.816564+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:00:39.816564+0000","last_undegraded":"2023-05-24T04:00:39.816564+0000","last_fullsized":"2023-05-24T04:00:39.816564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809247+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:39.809247+0000","last_peered":"2023-05-24T04:00:39.809247+0000","last_clean":"2023-05-24T04:00:39.809247+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:39.809247+0000","last_undegraded":"2023-05-24T04:00:39.809247+0000","last_fullsized":"2023-05-24T04:00:39.809247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810954+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:39.810954+0000","last_peered":"2023-05-24T04:00:39.810954+0000","last_clean":"2023-05-24T04:00:39.810954+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:39.810954+0000","last_undegraded":"2023-05-24T04:00:39.810954+0000","last_fullsized":"2023-05-24T04:00:39.810954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:30:14.563105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102982+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:40.102982+0000","last_peered":"2023-05-24T04:00:40.102982+0000","last_clean":"2023-05-24T04:00:40.102982+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:40.102982+0000","last_undegraded":"2023-05-24T04:00:40.102982+0000","last_fullsized":"2023-05-24T04:00:40.102982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:46.157393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807362+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:39.807362+0000","last_peered":"2023-05-24T04:00:39.807362+0000","last_clean":"2023-05-24T04:00:39.807362+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:39.807362+0000","last_undegraded":"2023-05-24T04:00:39.807362+0000","last_fullsized":"2023-05-24T04:00:39.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6241,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.76700000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.98899999999999999}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.1279999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0369999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.2390000000000001}]},{"osd":2,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.101}]},{"osd":3,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.871}]},{"osd":4,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.198},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.91100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.202},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.748}]},{"osd":1,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.105}]},{"osd":3,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.343},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.0569999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.4299999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.145},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.304}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.0469999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.84099999999999997}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.68500000000000005}]},{"osd":3,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.26}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.2130000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.173},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.345}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.749}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95199999999999996}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.78600000000000003}]},{"osd":7,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.96999999999999997}]},{"osd":3,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.103},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.395}]},{"osd":6,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.139}]},{"osd":7,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.339},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.177}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.92800000000000005}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.089}]},{"osd":7,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:01:15.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:01:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.077+0000 7fbcea428640 1 Processor -- start 2023-05-24T04:01:16.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.077+0000 7fbcea428640 1 -- start start 2023-05-24T04:01:16.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcea428640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbce40bbb60 0x7fbce40bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcea428640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce414f9d0 con 0x7fbce40be800 2023-05-24T04:01:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcea428640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce4070fe0 con 0x7fbce414bfd0 2023-05-24T04:01:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcea428640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40bb9e0 con 0x7fbce40bbb60 2023-05-24T04:01:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbce40be800 0x7fbce414b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51614/0 (socket says 172.21.15.40:51614) 2023-05-24T04:01:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce3fff640 1 -- 172.21.15.40:0/342292112 learned_addr learned my addr 172.21.15.40:0/342292112 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:16.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/342292112 >> v2:172.21.15.40:3300/0 conn(0x7fbce40bbb60 0x7fbce40bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:16.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce37fe640 1 -- 172.21.15.40:0/342292112 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345284941 0 0) 0x7fbce414f9d0 con 0x7fbce40be800 2023-05-24T04:01:16.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce37fe640 1 -- 172.21.15.40:0/342292112 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd0003530 con 0x7fbce40be800 2023-05-24T04:01:16.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcdbfff640 1 -- 172.21.15.40:0/342292112 >> v1:172.21.15.67:6789/0 conn(0x7fbce414bfd0 legacy=0x7fbce414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcdbfff640 1 -- 172.21.15.40:0/342292112 >> v1:172.21.15.40:6789/0 conn(0x7fbce40be800 legacy=0x7fbce414b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcdbfff640 1 -- 172.21.15.40:0/342292112 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40bda50 con 0x7fbce40bbb60 2023-05-24T04:01:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/342292112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40bbb60 0x7fbce40bc450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40097c0 tx=0x7fbcd401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98256f2422b435a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce37fe640 1 -- 172.21.15.40:0/342292112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40ab600 con 0x7fbce40bbb60 2023-05-24T04:01:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce37fe640 1 -- 172.21.15.40:0/342292112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40a7050 con 0x7fbce40bbb60 2023-05-24T04:01:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.081+0000 7fbce37fe640 1 -- 172.21.15.40:0/342292112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40ab960 con 0x7fbce40bbb60 2023-05-24T04:01:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/342292112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40bbb60 msgr2=0x7fbce40bc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 --2- 172.21.15.40:0/342292112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40bbb60 0x7fbce40bc450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40097c0 tx=0x7fbcd401c3f0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/342292112 shutdown_connections 2023-05-24T04:01:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 --2- 172.21.15.40:0/342292112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40bbb60 0x7fbce40bc450 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/342292112 >> 172.21.15.40:0/342292112 conn(0x7fbce406aef0 msgr2=0x7fbce406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/342292112 shutdown_connections 2023-05-24T04:01:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/342292112 wait complete. 2023-05-24T04:01:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 Processor -- start 2023-05-24T04:01:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- start start 2023-05-24T04:01:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbce40bbb60 0x7fbce40bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 0x7fbce40ba920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbce414bfd0 0x7fbce41e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40bfb20 con 0x7fbce40be800 2023-05-24T04:01:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41e83f0 con 0x7fbce414bfd0 2023-05-24T04:01:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41e7fc0 con 0x7fbce40bbb60 2023-05-24T04:01:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 0x7fbce40ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 0x7fbce40ba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49224/0 (socket says 172.21.15.40:49224) 2023-05-24T04:01:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 -- 172.21.15.40:0/3901919985 learned_addr learned my addr 172.21.15.40:0/3901919985 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce89c5640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbce414bfd0 0x7fbce41e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce3fff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbce40bbb60 0x7fbce40bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 -- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbce40bbb60 msgr2=0x7fbce40bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbce40bbb60 0x7fbce40bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 -- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbce414bfd0 msgr2=0x7fbce41e7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbce414bfd0 0x7fbce41e7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 -- 172.21.15.40:0/3901919985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd4009420 con 0x7fbce40be800 2023-05-24T04:01:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce89c5640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbce414bfd0 0x7fbce41e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce3fff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbce40bbb60 0x7fbce40bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 0x7fbce40ba920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4019000 tx=0x7fbcd4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4003af0 con 0x7fbce40be800 2023-05-24T04:01:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4003c50 con 0x7fbce40be800 2023-05-24T04:01:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce415a700 con 0x7fbce40be800 2023-05-24T04:01:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40ab400 con 0x7fbce40be800 2023-05-24T04:01:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.085+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce415a570 con 0x7fbce40be800 2023-05-24T04:01:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.089+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce415a890 con 0x7fbce40be800 2023-05-24T04:01:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.089+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbcd40b2040 con 0x7fbce40be800 2023-05-24T04:01:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.089+0000 7fbce17fa640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbcc4066280 0x7fbcc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.089+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbcd411def0 con 0x7fbce40be800 2023-05-24T04:01:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.089+0000 7fbce3fff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbcc4066280 0x7fbcc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.089+0000 7fbce3fff640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbcc4066280 0x7fbcc4068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0011f0 tx=0x7fbccc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:16.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.093+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbcd40eb0d0 con 0x7fbce40be800 2023-05-24T04:01:16.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.253+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbce40674e0 con 0x7fbce40be800 2023-05-24T04:01:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.257+0000 7fbce17fa640 1 -- 172.21.15.40:0/3901919985 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7fbcd40ee6f0 con 0x7fbce40be800 2023-05-24T04:01:16.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:16.277 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:01:16.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.257+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbcc4066280 msgr2=0x7fbcc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.257+0000 7fbcea428640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbcc4066280 0x7fbcc4068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0011f0 tx=0x7fbccc009040 comp rx=0 tx=0).stop 2023-05-24T04:01:16.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.257+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 msgr2=0x7fbce40ba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:16.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.257+0000 7fbcea428640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 0x7fbce40ba920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4019000 tx=0x7fbcd4019190 comp rx=0 tx=0).stop 2023-05-24T04:01:16.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 shutdown_connections 2023-05-24T04:01:16.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fbcc4066280 0x7fbcc4068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbce414bfd0 0x7fbce41e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbce40be800 0x7fbce40ba920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 --2- 172.21.15.40:0/3901919985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbce40bbb60 0x7fbce40bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:16.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 >> 172.21.15.40:0/3901919985 conn(0x7fbce406aef0 msgr2=0x7fbce40bcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:16.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 shutdown_connections 2023-05-24T04:01:16.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:16.261+0000 7fbcea428640 1 -- 172.21.15.40:0/3901919985 wait complete. 2023-05-24T04:01:17.282 INFO:tasks.ceph:Scrubbing osd.0 2023-05-24T04:01:17.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:17.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 Processor -- start 2023-05-24T04:01:17.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 -- start start 2023-05-24T04:01:17.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd14806ea50 0x7fd14814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd148070340 0x7fd14806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd148150210 con 0x7fd14814f7f0 2023-05-24T04:01:17.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1481504f0 con 0x7fd148070340 2023-05-24T04:01:17.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14e379640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14806efd0 con 0x7fd14806ea50 2023-05-24T04:01:17.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14c916640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd148070340 0x7fd14806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14c916640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd148070340 0x7fd14806c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49226/0 (socket says 172.21.15.40:49226) 2023-05-24T04:01:17.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.417+0000 7fd14c916640 1 -- 172.21.15.40:0/1008131494 learned_addr learned my addr 172.21.15.40:0/1008131494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:17.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14c916640 1 -- 172.21.15.40:0/1008131494 >> v2:172.21.15.67:3300/0 conn(0x7fd14806ea50 msgr2=0x7fd14814fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:17.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14c916640 1 --2- 172.21.15.40:0/1008131494 >> v2:172.21.15.67:3300/0 conn(0x7fd14806ea50 0x7fd14814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14c916640 1 -- 172.21.15.40:0/1008131494 >> v1:172.21.15.67:6789/0 conn(0x7fd14814f7f0 legacy=0x7fd14806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:17.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14c916640 1 -- 172.21.15.40:0/1008131494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14806d230 con 0x7fd148070340 2023-05-24T04:01:17.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14c916640 1 --2- 172.21.15.40:0/1008131494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd148070340 0x7fd14806c350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd148071d70 tx=0x7fd14001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c835b9e95db4846 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd146ffd640 1 -- 172.21.15.40:0/1008131494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400ab600 con 0x7fd148070340 2023-05-24T04:01:17.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd146ffd640 1 -- 172.21.15.40:0/1008131494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1400a7050 con 0x7fd148070340 2023-05-24T04:01:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd146ffd640 1 -- 172.21.15.40:0/1008131494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400ab980 con 0x7fd148070340 2023-05-24T04:01:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 -- 172.21.15.40:0/1008131494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd148070340 msgr2=0x7fd14806c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 --2- 172.21.15.40:0/1008131494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd148070340 0x7fd14806c350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd148071d70 tx=0x7fd14001c430 comp rx=0 tx=0).stop 2023-05-24T04:01:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 -- 172.21.15.40:0/1008131494 shutdown_connections 2023-05-24T04:01:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 --2- 172.21.15.40:0/1008131494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd148070340 0x7fd14806c350 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 --2- 172.21.15.40:0/1008131494 >> v2:172.21.15.67:3300/0 conn(0x7fd14806ea50 0x7fd14814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 -- 172.21.15.40:0/1008131494 >> 172.21.15.40:0/1008131494 conn(0x7fd1480c0300 msgr2=0x7fd1480c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 -- 172.21.15.40:0/1008131494 shutdown_connections 2023-05-24T04:01:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.421+0000 7fd14e379640 1 -- 172.21.15.40:0/1008131494 wait complete. 2023-05-24T04:01:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 Processor -- start 2023-05-24T04:01:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- start start 2023-05-24T04:01:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd14806ea50 0x7fd1480a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd148070340 0x7fd1481e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14814f7f0 0x7fd14813a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14813c320 con 0x7fd14814f7f0 2023-05-24T04:01:17.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14813c550 con 0x7fd148070340 2023-05-24T04:01:17.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480a4f80 con 0x7fd14806ea50 2023-05-24T04:01:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14814f7f0 0x7fd14813a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14814f7f0 0x7fd14813a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49234/0 (socket says 172.21.15.40:49234) 2023-05-24T04:01:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 -- 172.21.15.40:0/1156167211 learned_addr learned my addr 172.21.15.40:0/1156167211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd147fff640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd14806ea50 0x7fd1480a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd1477fe640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd148070340 0x7fd1481e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 -- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd14806ea50 msgr2=0x7fd1480a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd14806ea50 0x7fd1480a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 -- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd148070340 msgr2=0x7fd1481e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd148070340 0x7fd1481e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 -- 172.21.15.40:0/1156167211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400094d0 con 0x7fd14814f7f0 2023-05-24T04:01:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd147fff640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd14806ea50 0x7fd1480a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14c916640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14814f7f0 0x7fd14813a530 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd14001a060 tx=0x7fd1400191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400b4840 con 0x7fd14814f7f0 2023-05-24T04:01:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1400b49a0 con 0x7fd14814f7f0 2023-05-24T04:01:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd148159530 con 0x7fd14814f7f0 2023-05-24T04:01:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400b4d30 con 0x7fd14814f7f0 2023-05-24T04:01:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1481593a0 con 0x7fd14814f7f0 2023-05-24T04:01:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1481596c0 con 0x7fd14814f7f0 2023-05-24T04:01:17.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1400b2040 con 0x7fd14814f7f0 2023-05-24T04:01:17.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd144ff9640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd128066280 0x7fd128068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.425+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd14011ece0 con 0x7fd14814f7f0 2023-05-24T04:01:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd147fff640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd128066280 0x7fd128068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd144ff9640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7fd12806ff90 0x7fd128072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 --> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd128072ad0 con 0x7fd12806ff90 2023-05-24T04:01:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd14011f130 con 0x7fd14814f7f0 2023-05-24T04:01:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd1477fe640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7fd12806ff90 0x7fd128072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd147fff640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd128066280 0x7fd128068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd14814d070 tx=0x7fd138008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd1477fe640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7fd12806ff90 0x7fd128072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.429+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== osd.0 v2:172.21.15.40:6806/2887735176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd128072ad0 con 0x7fd12806ff90 2023-05-24T04:01:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 --> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd14804ddd0 con 0x7fd12806ff90 2023-05-24T04:01:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd144ff9640 1 -- 172.21.15.40:0/1156167211 <== osd.0 v2:172.21.15.40:6806/2887735176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd14804ddd0 con 0x7fd12806ff90 2023-05-24T04:01:17.447 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:17.448 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:17.448 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7fd12806ff90 msgr2=0x7fd128072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6806/2887735176,v1:172.21.15.40:6808/2887735176] conn(0x7fd12806ff90 0x7fd128072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd128066280 msgr2=0x7fd128068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd128066280 0x7fd128068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd14814d070 tx=0x7fd138008040 comp rx=0 tx=0).stop 2023-05-24T04:01:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14814f7f0 msgr2=0x7fd14813a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 --2- 172.21.15.40:0/1156167211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14814f7f0 0x7fd14813a530 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd14001a060 tx=0x7fd1400191d0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14c916640 1 -- 172.21.15.40:0/1156167211 reap_dead start 2023-05-24T04:01:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 shutdown_connections 2023-05-24T04:01:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 >> 172.21.15.40:0/1156167211 conn(0x7fd1480c0300 msgr2=0x7fd14814d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 shutdown_connections 2023-05-24T04:01:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.441+0000 7fd14e379640 1 -- 172.21.15.40:0/1156167211 wait complete. 2023-05-24T04:01:17.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-05-24T04:01:17.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.573+0000 7f98c8c76640 1 Processor -- start 2023-05-24T04:01:17.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.573+0000 7f98c8c76640 1 -- start start 2023-05-24T04:01:17.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c8c76640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98c40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c8c76640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c406fe80 con 0x7f98c4071160 2023-05-24T04:01:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c8c76640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c40c2050 con 0x7f98c4069f20 2023-05-24T04:01:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c8c76640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c414e400 con 0x7f98c414e030 2023-05-24T04:01:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c1d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f98c4071160 0x7f98c4151ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51622/0 (socket says 172.21.15.40:51622) 2023-05-24T04:01:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c1d9b640 1 -- 172.21.15.40:0/2387605306 learned_addr learned my addr 172.21.15.40:0/2387605306 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98c40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337974606 0 0) 0x7f98c406fe80 con 0x7f98c4071160 2023-05-24T04:01:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac003530 con 0x7f98c4071160 2023-05-24T04:01:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057662803 0 0) 0x7f98ac003530 con 0x7f98c4071160 2023-05-24T04:01:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 msgr2=0x7f98c40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:17.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98c40699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 >> v1:172.21.15.67:6789/0 conn(0x7f98c4069f20 legacy=0x7f98c4158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4070160 con 0x7f98c4071160 2023-05-24T04:01:17.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f98b8001680 con 0x7f98c4071160 2023-05-24T04:01:17.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 >> v1:172.21.15.40:6789/0 conn(0x7f98c4071160 legacy=0x7f98c4151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0039b0 0x7f98ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98ac0047d0 0x7f98ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c414e400 con 0x7f98ac0039b0 2023-05-24T04:01:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac00ba40 con 0x7f98ac0047d0 2023-05-24T04:01:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac00bbd0 con 0x7f98c414e030 2023-05-24T04:01:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0039b0 0x7f98ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c1d9b640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98ac0047d0 0x7f98ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c2d9d640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 -- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 msgr2=0x7f98ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 -- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98ac0047d0 msgr2=0x7f98ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98ac0047d0 0x7f98ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 -- 172.21.15.40:0/2387605306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac003530 con 0x7f98ac0039b0 2023-05-24T04:01:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c1d9b640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98ac0047d0 0x7f98ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c2d9d640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98c414e030 0x7f98ac005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.577+0000 7f98c259c640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0039b0 0x7f98ac003dc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009fc0 tx=0x7f98b401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70452201d46495fc server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40a5c40 con 0x7f98ac0039b0 2023-05-24T04:01:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b400f040 con 0x7f98ac0039b0 2023-05-24T04:01:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c159a640 1 -- 172.21.15.40:0/2387605306 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40ad440 con 0x7f98ac0039b0 2023-05-24T04:01:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/2387605306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0039b0 msgr2=0x7f98ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 --2- 172.21.15.40:0/2387605306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0039b0 0x7f98ac003dc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009fc0 tx=0x7f98b401cc30 comp rx=0 tx=0).stop 2023-05-24T04:01:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 -- 172.21.15.40:0/2387605306 reap_dead start 2023-05-24T04:01:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/2387605306 shutdown_connections 2023-05-24T04:01:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/2387605306 >> 172.21.15.40:0/2387605306 conn(0x7f98c40c13f0 msgr2=0x7f98c40c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/2387605306 shutdown_connections 2023-05-24T04:01:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/2387605306 wait complete. 2023-05-24T04:01:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 Processor -- start 2023-05-24T04:01:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- start start 2023-05-24T04:01:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98ac0039b0 0x7f98c41485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98c40c07e0 0x7f98c414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c41418b0 0x7f98c41e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4142ea0 con 0x7f98c41418b0 2023-05-24T04:01:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4141d00 con 0x7f98c40c07e0 2023-05-24T04:01:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c414c170 con 0x7f98ac0039b0 2023-05-24T04:01:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c259c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98ac0039b0 0x7f98c41485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c41418b0 0x7f98c41e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98c40c07e0 0x7f98c414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c259c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98ac0039b0 0x7f98c41485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:54188/0 (socket says 172.21.15.40:54188) 2023-05-24T04:01:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c259c640 1 -- 172.21.15.40:0/4158014515 learned_addr learned my addr 172.21.15.40:0/4158014515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 -- 172.21.15.40:0/4158014515 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98ac0039b0 msgr2=0x7f98c41485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98ac0039b0 0x7f98c41485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 -- 172.21.15.40:0/4158014515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98c40c07e0 msgr2=0x7f98c414cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98c40c07e0 0x7f98c414cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 -- 172.21.15.40:0/4158014515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4152380 con 0x7f98c41418b0 2023-05-24T04:01:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c2d9d640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c41418b0 0x7f98c41e7ae0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00bd60 tx=0x7f98bc00d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00b070 con 0x7f98c41418b0 2023-05-24T04:01:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc007030 con 0x7f98c41418b0 2023-05-24T04:01:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c41521f0 con 0x7f98c41418b0 2023-05-24T04:01:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0073e0 con 0x7f98c41418b0 2023-05-24T04:01:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.581+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c4152510 con 0x7f98c41418b0 2023-05-24T04:01:17.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.585+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c414c340 con 0x7f98c41418b0 2023-05-24T04:01:17.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.585+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98bc007540 con 0x7f98c41418b0 2023-05-24T04:01:17.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.585+0000 7f98b2ffd640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f98a4066280 0x7f98a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.585+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f98bc082f00 con 0x7f98c41418b0 2023-05-24T04:01:17.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.585+0000 7f98c259c640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f98a4066280 0x7f98a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.585+0000 7f98c259c640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f98a4066280 0x7f98a4068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98b401ca60 tx=0x7f98b4004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.589+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f98c414c340 con 0x7f98c41418b0 2023-05-24T04:01:17.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f98c4141fb0 con 0x7f98a4066280 2023-05-24T04:01:17.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98b2ffd640 1 -- 172.21.15.40:0/4158014515 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98c4141fb0 con 0x7f98a4066280 2023-05-24T04:01:17.751 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2023-05-24T04:01:17.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f98a4066280 msgr2=0x7f98a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f98a4066280 0x7f98a4068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98b401ca60 tx=0x7f98b4004ac0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c41418b0 msgr2=0x7f98c41e7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c41418b0 0x7f98c41e7ae0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00bd60 tx=0x7f98bc00d4c0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 shutdown_connections 2023-05-24T04:01:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f98a4066280 0x7f98a4068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c41418b0 0x7f98c41e7ae0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98c40c07e0 0x7f98c414cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 --2- 172.21.15.40:0/4158014515 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98ac0039b0 0x7f98c41485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 >> 172.21.15.40:0/4158014515 conn(0x7f98c40c13f0 msgr2=0x7f98c40a6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:17.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 shutdown_connections 2023-05-24T04:01:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.745+0000 7f98c8c76640 1 -- 172.21.15.40:0/4158014515 wait complete. 2023-05-24T04:01:17.770 INFO:tasks.ceph:Scrubbing osd.1 2023-05-24T04:01:17.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 Processor -- start 2023-05-24T04:01:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 -- start start 2023-05-24T04:01:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60d806fa50 0x7f60d80a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d814a750 0x7f60d814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d814b0f0 con 0x7f60d80714c0 2023-05-24T04:01:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d814eb10 con 0x7f60d806fa50 2023-05-24T04:01:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60dd9d2640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d814e870 con 0x7f60d814a750 2023-05-24T04:01:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60d806fa50 0x7f60d80a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60d806fa50 0x7f60d80a34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49258/0 (socket says 172.21.15.40:49258) 2023-05-24T04:01:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 -- 172.21.15.40:0/3421807320 learned_addr learned my addr 172.21.15.40:0/3421807320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d77fe640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d814a750 0x7f60d814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 -- 172.21.15.40:0/3421807320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d814a750 msgr2=0x7f60d814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d814a750 0x7f60d814abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 -- 172.21.15.40:0/3421807320 >> v1:172.21.15.67:6789/0 conn(0x7f60d80714c0 legacy=0x7f60d8071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d67fc640 1 -- 172.21.15.40:0/3421807320 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d814b360 con 0x7f60d806fa50 2023-05-24T04:01:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.889+0000 7f60d77fe640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d814a750 0x7f60d814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60d67fc640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d806fa50 0x7f60d80a34a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009870 tx=0x7f60c001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9732fa9c4afced60 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60d5ffb640 1 -- 172.21.15.40:0/3421807320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80a55e0 con 0x7f60d806fa50 2023-05-24T04:01:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60d5ffb640 1 -- 172.21.15.40:0/3421807320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c00aa430 con 0x7f60d806fa50 2023-05-24T04:01:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60d5ffb640 1 -- 172.21.15.40:0/3421807320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00aa7c0 con 0x7f60d806fa50 2023-05-24T04:01:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 -- 172.21.15.40:0/3421807320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d806fa50 msgr2=0x7f60d80a34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d806fa50 0x7f60d80a34a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009870 tx=0x7f60c001c4b0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 -- 172.21.15.40:0/3421807320 shutdown_connections 2023-05-24T04:01:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d814a750 0x7f60d814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 --2- 172.21.15.40:0/3421807320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d806fa50 0x7f60d80a34a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 -- 172.21.15.40:0/3421807320 >> 172.21.15.40:0/3421807320 conn(0x7f60d80c0300 msgr2=0x7f60d80c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 -- 172.21.15.40:0/3421807320 shutdown_connections 2023-05-24T04:01:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 -- 172.21.15.40:0/3421807320 wait complete. 2023-05-24T04:01:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 Processor -- start 2023-05-24T04:01:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.893+0000 7f60dd9d2640 1 -- start start 2023-05-24T04:01:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d806fa50 0x7f60d8145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60d80714c0 0x7f60d8145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d814a750 0x7f60d80ba010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81ea260 con 0x7f60d814a750 2023-05-24T04:01:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81e92b0 con 0x7f60d80714c0 2023-05-24T04:01:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8145fc0 con 0x7f60d806fa50 2023-05-24T04:01:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d814a750 0x7f60d80ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d814a750 0x7f60d80ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49274/0 (socket says 172.21.15.40:49274) 2023-05-24T04:01:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 -- 172.21.15.40:0/2686732255 learned_addr learned my addr 172.21.15.40:0/2686732255 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d6ffd640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d806fa50 0x7f60d8145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 -- 172.21.15.40:0/2686732255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d806fa50 msgr2=0x7f60d8145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60d806fa50 0x7f60d8145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 -- 172.21.15.40:0/2686732255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60d80714c0 msgr2=0x7f60d8145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d67fc640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60d80714c0 0x7f60d8145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60d80714c0 0x7f60d8145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 -- 172.21.15.40:0/2686732255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c00094d0 con 0x7f60d814a750 2023-05-24T04:01:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d77fe640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d814a750 0x7f60d80ba010 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007ea0 tx=0x7f60d0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0003ba0 con 0x7f60d814a750 2023-05-24T04:01:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d000f040 con 0x7f60d814a750 2023-05-24T04:01:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d814c220 con 0x7f60d814a750 2023-05-24T04:01:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000de70 con 0x7f60d814a750 2023-05-24T04:01:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d814c090 con 0x7f60d814a750 2023-05-24T04:01:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60d8157ae0 con 0x7f60d814a750 2023-05-24T04:01:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60d0004030 con 0x7f60d814a750 2023-05-24T04:01:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b80662b0 0x7f60b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f60d0084990 con 0x7f60d814a750 2023-05-24T04:01:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d6ffd640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b80662b0 0x7f60b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7f60b806ffc0 0x7f60b8072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 --> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60b8072b00 con 0x7f60b806ffc0 2023-05-24T04:01:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d0084de0 con 0x7f60d814a750 2023-05-24T04:01:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d67fc640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7f60b806ffc0 0x7f60b8072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d6ffd640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b80662b0 0x7f60b8068760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000f70 tx=0x7f60c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.897+0000 7f60d67fc640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7f60b806ffc0 0x7f60b8072430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.901+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== osd.1 v2:172.21.15.40:6800/2352123931 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f60b8072b00 con 0x7f60b806ffc0 2023-05-24T04:01:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 --> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60d81e5cc0 con 0x7f60b806ffc0 2023-05-24T04:01:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60cffff640 1 -- 172.21.15.40:0/2686732255 <== osd.1 v2:172.21.15.40:6800/2352123931 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f60d81e5cc0 con 0x7f60b806ffc0 2023-05-24T04:01:17.925 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:17.925 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:17.925 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7f60b806ffc0 msgr2=0x7f60b8072430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6800/2352123931,v1:172.21.15.40:6801/2352123931] conn(0x7f60b806ffc0 0x7f60b8072430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b80662b0 msgr2=0x7f60b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60b80662b0 0x7f60b8068760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000f70 tx=0x7f60c8009040 comp rx=0 tx=0).stop 2023-05-24T04:01:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d814a750 msgr2=0x7f60d80ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 --2- 172.21.15.40:0/2686732255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d814a750 0x7f60d80ba010 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007ea0 tx=0x7f60d0007f90 comp rx=0 tx=0).stop 2023-05-24T04:01:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60d77fe640 1 -- 172.21.15.40:0/2686732255 reap_dead start 2023-05-24T04:01:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 shutdown_connections 2023-05-24T04:01:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 >> 172.21.15.40:0/2686732255 conn(0x7f60d80c0300 msgr2=0x7f60d8149920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 shutdown_connections 2023-05-24T04:01:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:17.913+0000 7f60dd9d2640 1 -- 172.21.15.40:0/2686732255 wait complete. 2023-05-24T04:01:17.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-05-24T04:01:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.049+0000 7f273e05c640 1 Processor -- start 2023-05-24T04:01:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.049+0000 7f273e05c640 1 -- start start 2023-05-24T04:01:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f273e05c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 0x7f273806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f273e05c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2738145df0 0x7f2738146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f273e05c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273806ea20 con 0x7f2738070b20 2023-05-24T04:01:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f273e05c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273806ec70 con 0x7f2738145df0 2023-05-24T04:01:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f273e05c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738150230 con 0x7f273814fa70 2023-05-24T04:01:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f27377fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 0x7f273806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2738145df0 0x7f2738146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2736ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2738070b20 0x7f273806bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:44722/0 (socket says 172.21.15.40:44722) 2023-05-24T04:01:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2736ffd640 1 -- 172.21.15.40:0/3950044666 learned_addr learned my addr 172.21.15.40:0/3950044666 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2738145df0 0x7f2738146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.40:60534/0 (socket says 172.21.15.40:60534) 2023-05-24T04:01:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f27377fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 0x7f273806fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:54202/0 (socket says 172.21.15.40:54202) 2023-05-24T04:01:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 -- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 msgr2=0x7f273806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 --2- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 0x7f273806fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 -- 172.21.15.40:0/3950044666 >> v1:172.21.15.67:6789/0 conn(0x7f2738070b20 legacy=0x7f273806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 -- 172.21.15.40:0/3950044666 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273806c1d0 con 0x7f2738145df0 2023-05-24T04:01:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f27377fe640 1 --2- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 0x7f273806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T04:01:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.053+0000 7f2737fff640 1 --2- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738145df0 0x7f2738146270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27300097c0 tx=0x7f273001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1806d1287149bc server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f27367fc640 1 -- 172.21.15.40:0/3950044666 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27300ad640 con 0x7f2738145df0 2023-05-24T04:01:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f27367fc640 1 -- 172.21.15.40:0/3950044666 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27300ad7a0 con 0x7f2738145df0 2023-05-24T04:01:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f27367fc640 1 -- 172.21.15.40:0/3950044666 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27300adb30 con 0x7f2738145df0 2023-05-24T04:01:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738145df0 msgr2=0x7f2738146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 --2- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738145df0 0x7f2738146270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27300097c0 tx=0x7f273001c480 comp rx=0 tx=0).stop 2023-05-24T04:01:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/3950044666 shutdown_connections 2023-05-24T04:01:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 --2- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738145df0 0x7f2738146270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 --2- 172.21.15.40:0/3950044666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f273814fa70 0x7f273806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/3950044666 >> 172.21.15.40:0/3950044666 conn(0x7f27380c0280 msgr2=0x7f27380c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/3950044666 shutdown_connections 2023-05-24T04:01:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/3950044666 wait complete. 2023-05-24T04:01:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 Processor -- start 2023-05-24T04:01:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- start start 2023-05-24T04:01:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738070b20 0x7f273813f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2738145df0 0x7f2738140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 0x7f27381e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381e6370 con 0x7f273814fa70 2023-05-24T04:01:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381e68f0 con 0x7f2738070b20 2023-05-24T04:01:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27381e6580 con 0x7f2738145df0 2023-05-24T04:01:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 0x7f27381e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 0x7f27381e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49276/0 (socket says 172.21.15.40:49276) 2023-05-24T04:01:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 -- 172.21.15.40:0/1058408442 learned_addr learned my addr 172.21.15.40:0/1058408442 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f27377fe640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738070b20 0x7f273813f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2736ffd640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2738145df0 0x7f2738140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 -- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2738145df0 msgr2=0x7f2738140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2738145df0 0x7f2738140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 -- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738070b20 msgr2=0x7f273813f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738070b20 0x7f273813f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 -- 172.21.15.40:0/1058408442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720009420 con 0x7f273814fa70 2023-05-24T04:01:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f2737fff640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 0x7f27381e7c60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f273001a0b0 tx=0x7f2730019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27300b6610 con 0x7f273814fa70 2023-05-24T04:01:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730009420 con 0x7f273814fa70 2023-05-24T04:01:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27300a6040 con 0x7f273814fa70 2023-05-24T04:01:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27300b6990 con 0x7f273814fa70 2023-05-24T04:01:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.057+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273814fe40 con 0x7f273814fa70 2023-05-24T04:01:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.061+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2738070290 con 0x7f273814fa70 2023-05-24T04:01:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.061+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27300b4040 con 0x7f273814fa70 2023-05-24T04:01:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.061+0000 7f272ffff640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27180662b0 0x7f2718068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.061+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f273011e760 con 0x7f273814fa70 2023-05-24T04:01:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.061+0000 7f27377fe640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27180662b0 0x7f2718068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.061+0000 7f27377fe640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27180662b0 0x7f2718068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2720009c50 tx=0x7f2720009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.065+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f27300eb950 con 0x7f273814fa70 2023-05-24T04:01:18.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.221+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f27381e6740 con 0x7f27180662b0 2023-05-24T04:01:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.221+0000 7f272ffff640 1 -- 172.21.15.40:0/1058408442 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27381e6740 con 0x7f27180662b0 2023-05-24T04:01:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2023-05-24T04:01:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27180662b0 msgr2=0x7f2718068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27180662b0 0x7f2718068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2720009c50 tx=0x7f2720009190 comp rx=0 tx=0).stop 2023-05-24T04:01:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 msgr2=0x7f27381e7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 0x7f27381e7c60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f273001a0b0 tx=0x7f2730019220 comp rx=0 tx=0).stop 2023-05-24T04:01:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 shutdown_connections 2023-05-24T04:01:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f27180662b0 0x7f2718068760 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f273814fa70 0x7f27381e7c60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2738145df0 0x7f2738140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 --2- 172.21.15.40:0/1058408442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2738070b20 0x7f273813f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 >> 172.21.15.40:0/1058408442 conn(0x7f27380c0280 msgr2=0x7f2738144ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 shutdown_connections 2023-05-24T04:01:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.225+0000 7f273e05c640 1 -- 172.21.15.40:0/1058408442 wait complete. 2023-05-24T04:01:18.247 INFO:tasks.ceph:Scrubbing osd.2 2023-05-24T04:01:18.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:18.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd3e2d640 1 Processor -- start 2023-05-24T04:01:18.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd3e2d640 1 -- start start 2023-05-24T04:01:18.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd3e2d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faccc06ea50 0x7faccc14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd3e2d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc150210 con 0x7faccc14f7f0 2023-05-24T04:01:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd3e2d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc1504f0 con 0x7faccc070340 2023-05-24T04:01:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd3e2d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc06efd0 con 0x7faccc06ea50 2023-05-24T04:01:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd1bc9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faccc14f7f0 0x7faccc06bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51632/0 (socket says 172.21.15.40:51632) 2023-05-24T04:01:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd1bc9640 1 -- 172.21.15.40:0/256410490 learned_addr learned my addr 172.21.15.40:0/256410490 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd13c8640 1 --2- 172.21.15.40:0/256410490 >> v2:172.21.15.67:3300/0 conn(0x7faccc06ea50 0x7faccc14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820821829 0 0) 0x7faccc150210 con 0x7faccc14f7f0 2023-05-24T04:01:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb4003530 con 0x7faccc14f7f0 2023-05-24T04:01:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829457398 0 0) 0x7facb4003530 con 0x7faccc14f7f0 2023-05-24T04:01:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 >> v2:172.21.15.67:3300/0 conn(0x7faccc06ea50 msgr2=0x7faccc14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 --2- 172.21.15.40:0/256410490 >> v2:172.21.15.67:3300/0 conn(0x7faccc06ea50 0x7faccc14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 >> v1:172.21.15.67:6789/0 conn(0x7faccc070340 legacy=0x7faccc156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc06d230 con 0x7faccc14f7f0 2023-05-24T04:01:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7facbc001a00 con 0x7faccc14f7f0 2023-05-24T04:01:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 >> v1:172.21.15.40:6789/0 conn(0x7faccc14f7f0 legacy=0x7faccc06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb4003980 0x7facb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7facb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facb4005180 0x7facb400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc06efd0 con 0x7facb40047d0 2023-05-24T04:01:18.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb400c090 con 0x7facb4003980 2023-05-24T04:01:18.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb400c250 con 0x7facb4005180 2023-05-24T04:01:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.373+0000 7facd13c8640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7facb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd1bc9640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb4003980 0x7facb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd23ca640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facb4005180 0x7facb400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd13c8640 1 -- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facb4005180 msgr2=0x7facb400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd13c8640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facb4005180 0x7facb400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd13c8640 1 -- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb4003980 msgr2=0x7facb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd13c8640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb4003980 0x7facb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd13c8640 1 -- 172.21.15.40:0/256410490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4003530 con 0x7facb40047d0 2023-05-24T04:01:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd1bc9640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb4003980 0x7facb4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd23ca640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facb4005180 0x7facb400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd23ca640 1 -- 172.21.15.40:0/256410490 reap_dead start 2023-05-24T04:01:18.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd13c8640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7facb4004c40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facc0009ae0 tx=0x7facc001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3943e1f44af911 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00a6430 con 0x7facb40047d0 2023-05-24T04:01:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc00a6590 con 0x7facb40047d0 2023-05-24T04:01:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd0bc7640 1 -- 172.21.15.40:0/256410490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00a6940 con 0x7facb40047d0 2023-05-24T04:01:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 -- 172.21.15.40:0/256410490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 msgr2=0x7facb4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7facb4004c40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facc0009ae0 tx=0x7facc001ca50 comp rx=0 tx=0).stop 2023-05-24T04:01:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 -- 172.21.15.40:0/256410490 shutdown_connections 2023-05-24T04:01:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 --2- 172.21.15.40:0/256410490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7facb4004c40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 -- 172.21.15.40:0/256410490 >> 172.21.15.40:0/256410490 conn(0x7faccc0c0300 msgr2=0x7faccc0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 -- 172.21.15.40:0/256410490 shutdown_connections 2023-05-24T04:01:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.377+0000 7facd3e2d640 1 -- 172.21.15.40:0/256410490 wait complete. 2023-05-24T04:01:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 Processor -- start 2023-05-24T04:01:18.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- start start 2023-05-24T04:01:18.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7faccc1ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faccc145d20 0x7faccc143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faccc1e5f00 0x7faccc1e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc1eafa0 con 0x7facb40047d0 2023-05-24T04:01:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc1ea750 con 0x7faccc1e5f00 2023-05-24T04:01:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc1ea9e0 con 0x7faccc145d20 2023-05-24T04:01:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7faccc1ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7faccc1ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49292/0 (socket says 172.21.15.40:49292) 2023-05-24T04:01:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 -- 172.21.15.40:0/284777237 learned_addr learned my addr 172.21.15.40:0/284777237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd23ca640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faccc1e5f00 0x7faccc1e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd13c8640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faccc145d20 0x7faccc143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 -- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faccc145d20 msgr2=0x7faccc143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faccc145d20 0x7faccc143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 -- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faccc1e5f00 msgr2=0x7faccc1e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faccc1e5f00 0x7faccc1e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 -- 172.21.15.40:0/284777237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc06c5e0 con 0x7facb40047d0 2023-05-24T04:01:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd13c8640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faccc145d20 0x7faccc143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd1bc9640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7faccc1ea210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7facbc00dfc0 tx=0x7facbc00b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc004d70 con 0x7facb40047d0 2023-05-24T04:01:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc0070d0 con 0x7facb40047d0 2023-05-24T04:01:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc06c450 con 0x7facb40047d0 2023-05-24T04:01:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc007440 con 0x7facb40047d0 2023-05-24T04:01:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc06c770 con 0x7facb40047d0 2023-05-24T04:01:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faccc04ddd0 con 0x7facb40047d0 2023-05-24T04:01:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facbc0075a0 con 0x7facb40047d0 2023-05-24T04:01:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7facb8066280 0x7facb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7facbc084bc0 con 0x7facb40047d0 2023-05-24T04:01:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facd13c8640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7facb8066280 0x7facb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7facb806ff90 0x7facb8072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 --> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facb8072ad0 con 0x7facb806ff90 2023-05-24T04:01:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.381+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7facbc085010 con 0x7facb40047d0 2023-05-24T04:01:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.385+0000 7facd23ca640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7facb806ff90 0x7facb8072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.385+0000 7facd13c8640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7facb8066280 0x7facb8068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7facc00ad000 tx=0x7facc00a9040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.385+0000 7facd23ca640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7facb806ff90 0x7facb8072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.385+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== osd.2 v2:172.21.15.40:6816/307115548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7facb8072ad0 con 0x7facb806ff90 2023-05-24T04:01:18.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 --> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faccc0a2c10 con 0x7facb806ff90 2023-05-24T04:01:18.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facca7fc640 1 -- 172.21.15.40:0/284777237 <== osd.2 v2:172.21.15.40:6816/307115548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faccc0a2c10 con 0x7facb806ff90 2023-05-24T04:01:18.403 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:18.404 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:18.404 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7facb806ff90 msgr2=0x7facb8072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6816/307115548,v1:172.21.15.40:6817/307115548] conn(0x7facb806ff90 0x7facb8072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7facb8066280 msgr2=0x7facb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7facb8066280 0x7facb8068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7facc00ad000 tx=0x7facc00a9040 comp rx=0 tx=0).stop 2023-05-24T04:01:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 msgr2=0x7faccc1ea210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 --2- 172.21.15.40:0/284777237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40047d0 0x7faccc1ea210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7facbc00dfc0 tx=0x7facbc00b560 comp rx=0 tx=0).stop 2023-05-24T04:01:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd23ca640 1 -- 172.21.15.40:0/284777237 reap_dead start 2023-05-24T04:01:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 shutdown_connections 2023-05-24T04:01:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 >> 172.21.15.40:0/284777237 conn(0x7faccc0c0300 msgr2=0x7faccc06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 shutdown_connections 2023-05-24T04:01:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.397+0000 7facd3e2d640 1 -- 172.21.15.40:0/284777237 wait complete. 2023-05-24T04:01:18.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-05-24T04:01:18.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e8003d640 1 Processor -- start 2023-05-24T04:01:18.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e8003d640 1 -- start start 2023-05-24T04:01:18.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e8003d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e7806aaf0 0x7f7e7814d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e8003d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e78151990 con 0x7f7e78070c90 2023-05-24T04:01:18.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e8003d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7806e8d0 con 0x7f7e78152530 2023-05-24T04:01:18.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e8003d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7806ed80 con 0x7f7e7806aaf0 2023-05-24T04:01:18.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7ddd9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7e78070c90 0x7f7e78151e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51638/0 (socket says 172.21.15.40:51638) 2023-05-24T04:01:18.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7ddd9640 1 -- 172.21.15.40:0/3233638143 learned_addr learned my addr 172.21.15.40:0/3233638143 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:18.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7d5d8640 1 --2- 172.21.15.40:0/3233638143 >> v2:172.21.15.67:3300/0 conn(0x7f7e7806aaf0 0x7f7e7814d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707633633 0 0) 0x7f7e78151990 con 0x7f7e78070c90 2023-05-24T04:01:18.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e64003530 con 0x7f7e78070c90 2023-05-24T04:01:18.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2963789855 0 0) 0x7f7e64003530 con 0x7f7e78070c90 2023-05-24T04:01:18.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 >> v2:172.21.15.67:3300/0 conn(0x7f7e7806aaf0 msgr2=0x7f7e7814d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 --2- 172.21.15.40:0/3233638143 >> v2:172.21.15.67:3300/0 conn(0x7f7e7806aaf0 0x7f7e7814d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 >> v1:172.21.15.67:6789/0 conn(0x7f7e78152530 legacy=0x7f7e7814dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7806f020 con 0x7f7e78070c90 2023-05-24T04:01:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f7e70001680 con 0x7f7e78070c90 2023-05-24T04:01:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 >> v1:172.21.15.40:6789/0 conn(0x7f7e78070c90 legacy=0x7f7e78151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e64003980 0x7f7e64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e640047d0 0x7f7e64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e64005180 0x7f7e6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7806ed80 con 0x7f7e64005180 2023-05-24T04:01:18.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6400c000 con 0x7f7e64003980 2023-05-24T04:01:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6400c1c0 con 0x7f7e640047d0 2023-05-24T04:01:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7e5da640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e64005180 0x7f7e6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7ddd9640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e64003980 0x7f7e64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7d5d8640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e640047d0 0x7f7e64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7e5da640 1 -- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e640047d0 msgr2=0x7f7e64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7e5da640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e640047d0 0x7f7e64004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7e5da640 1 -- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e64003980 msgr2=0x7f7e64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7e5da640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e64003980 0x7f7e64003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.533+0000 7f7e7e5da640 1 -- 172.21.15.40:0/3233638143 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64003530 con 0x7f7e64005180 2023-05-24T04:01:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e7e5da640 1 -- 172.21.15.40:0/3233638143 reap_dead start 2023-05-24T04:01:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e7e5da640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e64005180 0x7f7e6400b990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7e68001e70 tx=0x7f7e6801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab007198a84d95e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68003b80 con 0x7f7e64005180 2023-05-24T04:01:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68003d00 con 0x7f7e64005180 2023-05-24T04:01:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e7cdd7640 1 -- 172.21.15.40:0/3233638143 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68005260 con 0x7f7e64005180 2023-05-24T04:01:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 -- 172.21.15.40:0/3233638143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e64005180 msgr2=0x7f7e6400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e64005180 0x7f7e6400b990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7e68001e70 tx=0x7f7e6801c760 comp rx=0 tx=0).stop 2023-05-24T04:01:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 -- 172.21.15.40:0/3233638143 shutdown_connections 2023-05-24T04:01:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 --2- 172.21.15.40:0/3233638143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e64005180 0x7f7e6400b990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 -- 172.21.15.40:0/3233638143 >> 172.21.15.40:0/3233638143 conn(0x7f7e780c2510 msgr2=0x7f7e780c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 -- 172.21.15.40:0/3233638143 shutdown_connections 2023-05-24T04:01:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 -- 172.21.15.40:0/3233638143 wait complete. 2023-05-24T04:01:18.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 Processor -- start 2023-05-24T04:01:18.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.537+0000 7f7e8003d640 1 -- start start 2023-05-24T04:01:18.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e64005180 0x7f7e780a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 0x7f7e7814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e781485c0 0x7f7e78142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780a5560 con 0x7f7e78146d20 2023-05-24T04:01:18.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780a5f30 con 0x7f7e781485c0 2023-05-24T04:01:18.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78147240 con 0x7f7e64005180 2023-05-24T04:01:18.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 0x7f7e7814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 0x7f7e7814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49314/0 (socket says 172.21.15.40:49314) 2023-05-24T04:01:18.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 -- 172.21.15.40:0/1319471242 learned_addr learned my addr 172.21.15.40:0/1319471242 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:18.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7ddd9640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e64005180 0x7f7e780a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 -- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e64005180 msgr2=0x7f7e780a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e64005180 0x7f7e780a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 -- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e781485c0 msgr2=0x7f7e78142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e781485c0 0x7f7e78142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 -- 172.21.15.40:0/1319471242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780711f0 con 0x7f7e78146d20 2023-05-24T04:01:18.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7d5d8640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 0x7f7e7814ed20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e740108c0 tx=0x7f7e74010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e740094b0 con 0x7f7e78146d20 2023-05-24T04:01:18.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400eb00 con 0x7f7e78146d20 2023-05-24T04:01:18.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e78071060 con 0x7f7e78146d20 2023-05-24T04:01:18.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400eeb0 con 0x7f7e78146d20 2023-05-24T04:01:18.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7806b040 con 0x7f7e78146d20 2023-05-24T04:01:18.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e780a5710 con 0x7f7e78146d20 2023-05-24T04:01:18.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e7401c400 con 0x7f7e78146d20 2023-05-24T04:01:18.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e6e7fc640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7e5c0662b0 0x7f7e5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7ddd9640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7e5c0662b0 0x7f7e5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e74084440 con 0x7f7e78146d20 2023-05-24T04:01:18.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.541+0000 7f7e7ddd9640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7e5c0662b0 0x7f7e5c068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e70001ec0 tx=0x7f7e70000f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.545+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7e780a5710 con 0x7f7e78146d20 2023-05-24T04:01:18.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.701+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e7804ddd0 con 0x7f7e5c0662b0 2023-05-24T04:01:18.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.701+0000 7f7e6e7fc640 1 -- 172.21.15.40:0/1319471242 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e7804ddd0 con 0x7f7e5c0662b0 2023-05-24T04:01:18.708 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2023-05-24T04:01:18.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7e5c0662b0 msgr2=0x7f7e5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7e5c0662b0 0x7f7e5c068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e70001ec0 tx=0x7f7e70000f20 comp rx=0 tx=0).stop 2023-05-24T04:01:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 msgr2=0x7f7e7814ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 0x7f7e7814ed20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e740108c0 tx=0x7f7e74010d80 comp rx=0 tx=0).stop 2023-05-24T04:01:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 shutdown_connections 2023-05-24T04:01:18.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7e5c0662b0 0x7f7e5c068760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e781485c0 0x7f7e78142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e78146d20 0x7f7e7814ed20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 --2- 172.21.15.40:0/1319471242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e64005180 0x7f7e780a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 >> 172.21.15.40:0/1319471242 conn(0x7f7e780c2510 msgr2=0x7f7e7806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 shutdown_connections 2023-05-24T04:01:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.705+0000 7f7e8003d640 1 -- 172.21.15.40:0/1319471242 wait complete. 2023-05-24T04:01:18.727 INFO:tasks.ceph:Scrubbing osd.3 2023-05-24T04:01:18.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 Processor -- start 2023-05-24T04:01:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 -- start start 2023-05-24T04:01:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60bc14f7f0 0x7f60bc14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc06bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc150210 con 0x7f60bc070340 2023-05-24T04:01:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc1504f0 con 0x7f60bc14f7f0 2023-05-24T04:01:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.845+0000 7f60c315c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc06efd0 con 0x7f60bc06ea50 2023-05-24T04:01:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc06bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60c0ef8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60bc14f7f0 0x7f60bc14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60c16f9640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f60bc070340 0x7f60bc06c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:44742/0 (socket says 172.21.15.40:44742) 2023-05-24T04:01:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc06bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.40:54262/0 (socket says 172.21.15.40:54262) 2023-05-24T04:01:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60c16f9640 1 -- 172.21.15.40:0/929676830 learned_addr learned my addr 172.21.15.40:0/929676830 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 -- 172.21.15.40:0/929676830 >> v2:172.21.15.67:3300/0 conn(0x7f60bc14f7f0 msgr2=0x7f60bc14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 --2- 172.21.15.40:0/929676830 >> v2:172.21.15.67:3300/0 conn(0x7f60bc14f7f0 0x7f60bc14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bb7fe640 1 -- 172.21.15.40:0/929676830 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464929169 0 0) 0x7f60bc150210 con 0x7f60bc070340 2023-05-24T04:01:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 -- 172.21.15.40:0/929676830 >> v1:172.21.15.67:6789/0 conn(0x7f60bc070340 legacy=0x7f60bc06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 -- 172.21.15.40:0/929676830 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc06d230 con 0x7f60bc06ea50 2023-05-24T04:01:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bbfff640 1 --2- 172.21.15.40:0/929676830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc06bc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097c0 tx=0x7f60b001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97d0be7cb3d36e67 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bb7fe640 1 -- 172.21.15.40:0/929676830 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00ab600 con 0x7f60bc06ea50 2023-05-24T04:01:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bb7fe640 1 -- 172.21.15.40:0/929676830 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b00a7050 con 0x7f60bc06ea50 2023-05-24T04:01:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.849+0000 7f60bb7fe640 1 -- 172.21.15.40:0/929676830 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00ab980 con 0x7f60bc06ea50 2023-05-24T04:01:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/929676830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 msgr2=0x7f60bc06bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 --2- 172.21.15.40:0/929676830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc06bc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097c0 tx=0x7f60b001c3f0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/929676830 shutdown_connections 2023-05-24T04:01:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 --2- 172.21.15.40:0/929676830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc06bc40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 --2- 172.21.15.40:0/929676830 >> v2:172.21.15.67:3300/0 conn(0x7f60bc14f7f0 0x7f60bc14fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/929676830 >> 172.21.15.40:0/929676830 conn(0x7f60bc0c0300 msgr2=0x7f60bc0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/929676830 shutdown_connections 2023-05-24T04:01:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/929676830 wait complete. 2023-05-24T04:01:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 Processor -- start 2023-05-24T04:01:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- start start 2023-05-24T04:01:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60bc070340 0x7f60bc145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60bc14f7f0 0x7f60bc145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc155550 con 0x7f60bc070340 2023-05-24T04:01:18.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc140460 con 0x7f60bc14f7f0 2023-05-24T04:01:18.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc14b120 con 0x7f60bc06ea50 2023-05-24T04:01:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60bc070340 0x7f60bc145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60bc070340 0x7f60bc145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49324/0 (socket says 172.21.15.40:49324) 2023-05-24T04:01:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 -- 172.21.15.40:0/1866075748 learned_addr learned my addr 172.21.15.40:0/1866075748 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c16f9640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60bc14f7f0 0x7f60bc145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c0ef8640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 -- 172.21.15.40:0/1866075748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 msgr2=0x7f60bc14c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60bc06ea50 0x7f60bc14c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 -- 172.21.15.40:0/1866075748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60bc14f7f0 msgr2=0x7f60bc145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60bc14f7f0 0x7f60bc145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 -- 172.21.15.40:0/1866075748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b0009420 con 0x7f60bc070340 2023-05-24T04:01:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60bbfff640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60bc070340 0x7f60bc145920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f60b001a020 tx=0x7f60b0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00b4820 con 0x7f60bc070340 2023-05-24T04:01:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b00b4980 con 0x7f60bc070340 2023-05-24T04:01:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc159530 con 0x7f60bc070340 2023-05-24T04:01:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00b4d30 con 0x7f60bc070340 2023-05-24T04:01:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc1593a0 con 0x7f60bc070340 2023-05-24T04:01:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.853+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60bc1596c0 con 0x7f60bc070340 2023-05-24T04:01:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60b00b2040 con 0x7f60bc070340 2023-05-24T04:01:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60a80662b0 0x7f60a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f60b011ea60 con 0x7f60bc070340 2023-05-24T04:01:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60c0ef8640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60a80662b0 0x7f60a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f60a806ffc0 0x7f60a8072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 --> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60a8072b00 con 0x7f60a806ffc0 2023-05-24T04:01:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60b011edd0 con 0x7f60bc070340 2023-05-24T04:01:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60c16f9640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f60a806ffc0 0x7f60a8072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60c0ef8640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60a80662b0 0x7f60a8068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60bc156670 tx=0x7f60ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60c16f9640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f60a806ffc0 0x7f60a8072430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.857+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== osd.3 v2:172.21.15.40:6824/3065273304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f60a8072b00 con 0x7f60a806ffc0 2023-05-24T04:01:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 --> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60bc14c100 con 0x7f60a806ffc0 2023-05-24T04:01:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60b97fa640 1 -- 172.21.15.40:0/1866075748 <== osd.3 v2:172.21.15.40:6824/3065273304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f60bc14c100 con 0x7f60a806ffc0 2023-05-24T04:01:18.881 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:18.881 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:18.882 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f60a806ffc0 msgr2=0x7f60a8072430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6824/3065273304,v1:172.21.15.40:6825/3065273304] conn(0x7f60a806ffc0 0x7f60a8072430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60a80662b0 msgr2=0x7f60a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f60a80662b0 0x7f60a8068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60bc156670 tx=0x7f60ac008040 comp rx=0 tx=0).stop 2023-05-24T04:01:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60bc070340 msgr2=0x7f60bc145920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 --2- 172.21.15.40:0/1866075748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60bc070340 0x7f60bc145920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f60b001a020 tx=0x7f60b0019190 comp rx=0 tx=0).stop 2023-05-24T04:01:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c16f9640 1 -- 172.21.15.40:0/1866075748 reap_dead start 2023-05-24T04:01:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 shutdown_connections 2023-05-24T04:01:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.869+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 >> 172.21.15.40:0/1866075748 conn(0x7f60bc0c0300 msgr2=0x7f60bc14d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.873+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 shutdown_connections 2023-05-24T04:01:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:18.873+0000 7f60c315c640 1 -- 172.21.15.40:0/1866075748 wait complete. 2023-05-24T04:01:18.893 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-05-24T04:01:19.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.001+0000 7fd97d439640 1 Processor -- start 2023-05-24T04:01:19.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.001+0000 7fd97d439640 1 -- start start 2023-05-24T04:01:19.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9780be9b0 0x7fd9781505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd97806e6d0 0x7fd9780bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9780bd630 con 0x7fd9780c2690 2023-05-24T04:01:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9780bd070 con 0x7fd97806e6d0 2023-05-24T04:01:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9780bcb50 con 0x7fd9780be9b0 2023-05-24T04:01:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd97806e6d0 0x7fd9780bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd97806e6d0 0x7fd9780bf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49338/0 (socket says 172.21.15.40:49338) 2023-05-24T04:01:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 -- 172.21.15.40:0/661695508 learned_addr learned my addr 172.21.15.40:0/661695508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd96e7fc640 1 --2- 172.21.15.40:0/661695508 >> v2:172.21.15.67:3300/0 conn(0x7fd9780be9b0 0x7fd9781505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 -- 172.21.15.40:0/661695508 >> v2:172.21.15.67:3300/0 conn(0x7fd9780be9b0 msgr2=0x7fd9781505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 --2- 172.21.15.40:0/661695508 >> v2:172.21.15.67:3300/0 conn(0x7fd9780be9b0 0x7fd9781505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 -- 172.21.15.40:0/661695508 >> v1:172.21.15.67:6789/0 conn(0x7fd9780c2690 legacy=0x7fd97806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 -- 172.21.15.40:0/661695508 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780bd2c0 con 0x7fd97806e6d0 2023-05-24T04:01:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9777fe640 1 --2- 172.21.15.40:0/661695508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9780bf9e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd9780bf2c0 tx=0x7fd97001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb09f2bc082ee72 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9767fc640 1 -- 172.21.15.40:0/661695508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700a5820 con 0x7fd97806e6d0 2023-05-24T04:01:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9767fc640 1 -- 172.21.15.40:0/661695508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9700a5980 con 0x7fd97806e6d0 2023-05-24T04:01:19.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd9767fc640 1 -- 172.21.15.40:0/661695508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700a5d10 con 0x7fd97806e6d0 2023-05-24T04:01:19.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- 172.21.15.40:0/661695508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 msgr2=0x7fd9780bf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 --2- 172.21.15.40:0/661695508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9780bf9e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd9780bf2c0 tx=0x7fd97001c940 comp rx=0 tx=0).stop 2023-05-24T04:01:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- 172.21.15.40:0/661695508 shutdown_connections 2023-05-24T04:01:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 --2- 172.21.15.40:0/661695508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9780bf9e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 --2- 172.21.15.40:0/661695508 >> v2:172.21.15.67:3300/0 conn(0x7fd9780be9b0 0x7fd9781505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- 172.21.15.40:0/661695508 >> 172.21.15.40:0/661695508 conn(0x7fd9780726e0 msgr2=0x7fd9780655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- 172.21.15.40:0/661695508 shutdown_connections 2023-05-24T04:01:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.005+0000 7fd97d439640 1 -- 172.21.15.40:0/661695508 wait complete. 2023-05-24T04:01:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 Processor -- start 2023-05-24T04:01:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- start start 2023-05-24T04:01:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9781396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9780be9b0 0x7fd97813ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9780c2690 0x7fd978136410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97813db60 con 0x7fd97806e6d0 2023-05-24T04:01:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97813f480 con 0x7fd9780be9b0 2023-05-24T04:01:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd978143030 con 0x7fd9780c2690 2023-05-24T04:01:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9781396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9781396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49342/0 (socket says 172.21.15.40:49342) 2023-05-24T04:01:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 -- 172.21.15.40:0/2112510283 learned_addr learned my addr 172.21.15.40:0/2112510283 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd9777fe640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9780c2690 0x7fd978136410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 -- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9780c2690 msgr2=0x7fd978136410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9780c2690 0x7fd978136410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 -- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9780be9b0 msgr2=0x7fd97813ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9780be9b0 0x7fd97813ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 -- 172.21.15.40:0/2112510283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009b30 con 0x7fd97806e6d0 2023-05-24T04:01:19.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd976ffd640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9781396d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c3c0 tx=0x7fd96800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680052d0 con 0x7fd97806e6d0 2023-05-24T04:01:19.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968005430 con 0x7fd97806e6d0 2023-05-24T04:01:19.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9781598a0 con 0x7fd97806e6d0 2023-05-24T04:01:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968003840 con 0x7fd97806e6d0 2023-05-24T04:01:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd978159710 con 0x7fd97806e6d0 2023-05-24T04:01:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd978159a30 con 0x7fd97806e6d0 2023-05-24T04:01:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9680039a0 con 0x7fd97806e6d0 2023-05-24T04:01:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96ffff640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd958066250 0x7fd958068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd968083570 con 0x7fd97806e6d0 2023-05-24T04:01:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.009+0000 7fd96e7fc640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd958066250 0x7fd958068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.013+0000 7fd96e7fc640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd958066250 0x7fd958068700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd97813e410 tx=0x7fd960008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.013+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd9680506c0 con 0x7fd97806e6d0 2023-05-24T04:01:19.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.161+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd978143d30 con 0x7fd958066250 2023-05-24T04:01:19.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd96ffff640 1 -- 172.21.15.40:0/2112510283 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd96000be00 con 0x7fd958066250 2023-05-24T04:01:19.175 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 3 to deep-scrub 2023-05-24T04:01:19.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd958066250 msgr2=0x7fd958068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd958066250 0x7fd958068700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd97813e410 tx=0x7fd960008040 comp rx=0 tx=0).stop 2023-05-24T04:01:19.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 msgr2=0x7fd9781396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9781396d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c3c0 tx=0x7fd96800c880 comp rx=0 tx=0).stop 2023-05-24T04:01:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 shutdown_connections 2023-05-24T04:01:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd958066250 0x7fd958068700 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9780c2690 0x7fd978136410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9780be9b0 0x7fd97813ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 --2- 172.21.15.40:0/2112510283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97806e6d0 0x7fd9781396d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 >> 172.21.15.40:0/2112510283 conn(0x7fd9780726e0 msgr2=0x7fd97814ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.165+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 shutdown_connections 2023-05-24T04:01:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.169+0000 7fd97d439640 1 -- 172.21.15.40:0/2112510283 wait complete. 2023-05-24T04:01:19.188 INFO:tasks.ceph:Scrubbing osd.4 2023-05-24T04:01:19.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:19.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 Processor -- start 2023-05-24T04:01:19.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 -- start start 2023-05-24T04:01:19.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f421814f7f0 0x7f421814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f421806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4218150210 con 0x7f421806ea50 2023-05-24T04:01:19.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42181504f0 con 0x7f421814f7f0 2023-05-24T04:01:19.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f421dc5f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421806efd0 con 0x7f4218070340 2023-05-24T04:01:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f421814f7f0 0x7f421814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f421814f7f0 0x7f421814fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49348/0 (socket says 172.21.15.40:49348) 2023-05-24T04:01:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 -- 172.21.15.40:0/1116454011 learned_addr learned my addr 172.21.15.40:0/1116454011 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f4217fff640 1 --2- 172.21.15.40:0/1116454011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f421806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 -- 172.21.15.40:0/1116454011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 msgr2=0x7f421806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 --2- 172.21.15.40:0/1116454011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f421806c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 -- 172.21.15.40:0/1116454011 >> v1:172.21.15.67:6789/0 conn(0x7f421806ea50 legacy=0x7f421806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.305+0000 7f42177fe640 1 -- 172.21.15.40:0/1116454011 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421806d230 con 0x7f421814f7f0 2023-05-24T04:01:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f42177fe640 1 --2- 172.21.15.40:0/1116454011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421814f7f0 0x7f421814fbc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4208009e50 tx=0x7f420801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903adb86cf5be983 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f42167fc640 1 -- 172.21.15.40:0/1116454011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080a6440 con 0x7f421814f7f0 2023-05-24T04:01:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f42167fc640 1 -- 172.21.15.40:0/1116454011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42080a65a0 con 0x7f421814f7f0 2023-05-24T04:01:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f42167fc640 1 -- 172.21.15.40:0/1116454011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080a6930 con 0x7f421814f7f0 2023-05-24T04:01:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 -- 172.21.15.40:0/1116454011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421814f7f0 msgr2=0x7f421814fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 --2- 172.21.15.40:0/1116454011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421814f7f0 0x7f421814fbc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4208009e50 tx=0x7f420801c980 comp rx=0 tx=0).stop 2023-05-24T04:01:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 -- 172.21.15.40:0/1116454011 shutdown_connections 2023-05-24T04:01:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 --2- 172.21.15.40:0/1116454011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f421806c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 --2- 172.21.15.40:0/1116454011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421814f7f0 0x7f421814fbc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 -- 172.21.15.40:0/1116454011 >> 172.21.15.40:0/1116454011 conn(0x7f42180c0300 msgr2=0x7f42180c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 -- 172.21.15.40:0/1116454011 shutdown_connections 2023-05-24T04:01:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 -- 172.21.15.40:0/1116454011 wait complete. 2023-05-24T04:01:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 Processor -- start 2023-05-24T04:01:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 -- start start 2023-05-24T04:01:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421806ea50 0x7f42181e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.309+0000 7f421dc5f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f42181492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421814f7f0 0x7f4218142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218148880 con 0x7f421806ea50 2023-05-24T04:01:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181e8a00 con 0x7f421814f7f0 2023-05-24T04:01:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42181e8720 con 0x7f4218070340 2023-05-24T04:01:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421806ea50 0x7f42181e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421806ea50 0x7f42181e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49362/0 (socket says 172.21.15.40:49362) 2023-05-24T04:01:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f4217fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421814f7f0 0x7f4218142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 -- 172.21.15.40:0/4025936963 learned_addr learned my addr 172.21.15.40:0/4025936963 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f4216ffd640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f42181492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 -- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 msgr2=0x7f42181492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4218070340 0x7f42181492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 -- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421814f7f0 msgr2=0x7f4218142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421814f7f0 0x7f4218142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 -- 172.21.15.40:0/4025936963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009b30 con 0x7f421806ea50 2023-05-24T04:01:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f42177fe640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421806ea50 0x7f42181e7d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f420801a5b0 tx=0x7f4208019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080b1420 con 0x7f421806ea50 2023-05-24T04:01:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42080b5070 con 0x7f421806ea50 2023-05-24T04:01:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4218159530 con 0x7f421806ea50 2023-05-24T04:01:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080b17e0 con 0x7f421806ea50 2023-05-24T04:01:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42181593a0 con 0x7f421806ea50 2023-05-24T04:01:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42181596c0 con 0x7f421806ea50 2023-05-24T04:01:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42080b1940 con 0x7f421806ea50 2023-05-24T04:01:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4204066280 0x7f4204068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f420811e040 con 0x7f421806ea50 2023-05-24T04:01:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f4216ffd640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4204066280 0x7f4204068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f420406ff90 0x7f4204072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 --> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4204072ad0 con 0x7f420406ff90 2023-05-24T04:01:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4208120700 con 0x7f421806ea50 2023-05-24T04:01:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f4217fff640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f420406ff90 0x7f4204072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.313+0000 7f4216ffd640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4204066280 0x7f4204068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4218148d80 tx=0x7f420c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.317+0000 7f4217fff640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f420406ff90 0x7f4204072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.317+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== osd.4 v2:172.21.15.67:6800/3240304785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4204072ad0 con 0x7f420406ff90 2023-05-24T04:01:19.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 --> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f421804ddd0 con 0x7f420406ff90 2023-05-24T04:01:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f41fffff640 1 -- 172.21.15.40:0/4025936963 <== osd.4 v2:172.21.15.67:6800/3240304785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f421804ddd0 con 0x7f420406ff90 2023-05-24T04:01:19.336 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:19.337 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:19.337 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f420406ff90 msgr2=0x7f4204072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.67:6800/3240304785,v1:172.21.15.67:6801/3240304785] conn(0x7f420406ff90 0x7f4204072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4204066280 msgr2=0x7f4204068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4204066280 0x7f4204068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4218148d80 tx=0x7f420c009040 comp rx=0 tx=0).stop 2023-05-24T04:01:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421806ea50 msgr2=0x7f42181e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 --2- 172.21.15.40:0/4025936963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421806ea50 0x7f42181e7d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f420801a5b0 tx=0x7f4208019720 comp rx=0 tx=0).stop 2023-05-24T04:01:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f4217fff640 1 -- 172.21.15.40:0/4025936963 reap_dead start 2023-05-24T04:01:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 shutdown_connections 2023-05-24T04:01:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 >> 172.21.15.40:0/4025936963 conn(0x7f42180c0300 msgr2=0x7f421814cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.329+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 shutdown_connections 2023-05-24T04:01:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.333+0000 7f421dc5f640 1 -- 172.21.15.40:0/4025936963 wait complete. 2023-05-24T04:01:19.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-05-24T04:01:19.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.465+0000 7fef5e686640 1 Processor -- start 2023-05-24T04:01:19.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.465+0000 7fef5e686640 1 -- start start 2023-05-24T04:01:19.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef5e686640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 0x7fef58150570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef5e686640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5814f9d0 con 0x7fef580bbb60 2023-05-24T04:01:19.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef5e686640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef58070fe0 con 0x7fef580be800 2023-05-24T04:01:19.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef5e686640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580bb9e0 con 0x7fef5814bfd0 2023-05-24T04:01:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fef580bbb60 0x7fef5814fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51654/0 (socket says 172.21.15.40:51654) 2023-05-24T04:01:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 -- 172.21.15.40:0/3300411313 learned_addr learned my addr 172.21.15.40:0/3300411313 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef5cc23640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 0x7fef58150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732970982 0 0) 0x7fef5814f9d0 con 0x7fef580bbb60 2023-05-24T04:01:19.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003530 con 0x7fef580bbb60 2023-05-24T04:01:19.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772391259 0 0) 0x7fef40003530 con 0x7fef580bbb60 2023-05-24T04:01:19.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 msgr2=0x7fef58150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 0x7fef58150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 >> v1:172.21.15.67:6789/0 conn(0x7fef580be800 legacy=0x7fef5814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580bda50 con 0x7fef580bbb60 2023-05-24T04:01:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7fef4c001680 con 0x7fef580bbb60 2023-05-24T04:01:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 >> v1:172.21.15.40:6789/0 conn(0x7fef580bbb60 legacy=0x7fef5814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400039b0 0x7fef40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400047d0 0x7fef40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 0x7fef400051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580bb9e0 con 0x7fef400047d0 2023-05-24T04:01:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4000ba90 con 0x7fef400039b0 2023-05-24T04:01:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4000bc50 con 0x7fef5814bfd0 2023-05-24T04:01:19.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400047d0 0x7fef40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef5cc23640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 0x7fef400051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef57fff640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400039b0 0x7fef40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 -- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 msgr2=0x7fef400051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5814bfd0 0x7fef400051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 -- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400039b0 msgr2=0x7fef40003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400039b0 0x7fef40003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 -- 172.21.15.40:0/3300411313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40003530 con 0x7fef400047d0 2023-05-24T04:01:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.469+0000 7fef577fe640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400047d0 0x7fef40004c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c210 tx=0x7fef4c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8557cce6f93dc418 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c005ae0 con 0x7fef400047d0 2023-05-24T04:01:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c005c40 con 0x7fef400047d0 2023-05-24T04:01:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef56ffd640 1 -- 172.21.15.40:0/3300411313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0a5810 con 0x7fef400047d0 2023-05-24T04:01:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/3300411313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400047d0 msgr2=0x7fef40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 --2- 172.21.15.40:0/3300411313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400047d0 0x7fef40004c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c210 tx=0x7fef4c01cc20 comp rx=0 tx=0).stop 2023-05-24T04:01:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 -- 172.21.15.40:0/3300411313 reap_dead start 2023-05-24T04:01:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/3300411313 shutdown_connections 2023-05-24T04:01:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/3300411313 >> 172.21.15.40:0/3300411313 conn(0x7fef5806aef0 msgr2=0x7fef5806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/3300411313 shutdown_connections 2023-05-24T04:01:19.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/3300411313 wait complete. 2023-05-24T04:01:19.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 Processor -- start 2023-05-24T04:01:19.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- start start 2023-05-24T04:01:19.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400047d0 0x7fef58148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef580b7df0 0x7fef581454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 0x7fef580baf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580b6e40 con 0x7fef580baaf0 2023-05-24T04:01:19.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef581489a0 con 0x7fef400047d0 2023-05-24T04:01:19.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef58145a30 con 0x7fef580b7df0 2023-05-24T04:01:19.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 0x7fef580baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 0x7fef580baf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49378/0 (socket says 172.21.15.40:49378) 2023-05-24T04:01:19.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 -- 172.21.15.40:0/2055191560 learned_addr learned my addr 172.21.15.40:0/2055191560 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef57fff640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400047d0 0x7fef58148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef577fe640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef580b7df0 0x7fef581454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 -- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef580b7df0 msgr2=0x7fef581454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef580b7df0 0x7fef581454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 -- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400047d0 msgr2=0x7fef58148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400047d0 0x7fef58148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 -- 172.21.15.40:0/2055191560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58158560 con 0x7fef580baaf0 2023-05-24T04:01:19.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5cc23640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 0x7fef580baf60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fef58150ab0 tx=0x7fef50007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000e070 con 0x7fef580baaf0 2023-05-24T04:01:19.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50003c70 con 0x7fef580baaf0 2023-05-24T04:01:19.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50003e20 con 0x7fef580baaf0 2023-05-24T04:01:19.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef580bc860 con 0x7fef580baaf0 2023-05-24T04:01:19.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.473+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef581586f0 con 0x7fef580baaf0 2023-05-24T04:01:19.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.477+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef580674e0 con 0x7fef580baaf0 2023-05-24T04:01:19.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.477+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef50004030 con 0x7fef580baaf0 2023-05-24T04:01:19.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.477+0000 7fef54ff9640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fef44066280 0x7fef44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.477+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fef50084080 con 0x7fef580baaf0 2023-05-24T04:01:19.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.477+0000 7fef57fff640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fef44066280 0x7fef44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.477+0000 7fef57fff640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fef44066280 0x7fef44068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef48005490 tx=0x7fef48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.481+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fef50051130 con 0x7fef580baaf0 2023-05-24T04:01:19.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.629+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fef580bb4a0 con 0x7fef44066280 2023-05-24T04:01:19.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.629+0000 7fef54ff9640 1 -- 172.21.15.40:0/2055191560 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef580bb4a0 con 0x7fef44066280 2023-05-24T04:01:19.637 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 4 to deep-scrub 2023-05-24T04:01:19.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fef44066280 msgr2=0x7fef44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fef44066280 0x7fef44068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef48005490 tx=0x7fef48009040 comp rx=0 tx=0).stop 2023-05-24T04:01:19.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 msgr2=0x7fef580baf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 0x7fef580baf60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fef58150ab0 tx=0x7fef50007e40 comp rx=0 tx=0).stop 2023-05-24T04:01:19.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 shutdown_connections 2023-05-24T04:01:19.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fef44066280 0x7fef44068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef580baaf0 0x7fef580baf60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef580b7df0 0x7fef581454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 --2- 172.21.15.40:0/2055191560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef400047d0 0x7fef58148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 >> 172.21.15.40:0/2055191560 conn(0x7fef5806aef0 msgr2=0x7fef58071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 shutdown_connections 2023-05-24T04:01:19.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.633+0000 7fef5e686640 1 -- 172.21.15.40:0/2055191560 wait complete. 2023-05-24T04:01:19.655 INFO:tasks.ceph:Scrubbing osd.5 2023-05-24T04:01:19.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 Processor -- start 2023-05-24T04:01:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 -- start start 2023-05-24T04:01:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10a414f7f0 0x7f10a414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 0x7f10a406c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a4150210 con 0x7f10a406ea50 2023-05-24T04:01:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a41504f0 con 0x7f10a414f7f0 2023-05-24T04:01:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a8a88640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a406efd0 con 0x7f10a4070340 2023-05-24T04:01:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a1d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10a406ea50 0x7f10a406bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51662/0 (socket says 172.21.15.40:51662) 2023-05-24T04:01:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a1d9b640 1 -- 172.21.15.40:0/3045771648 learned_addr learned my addr 172.21.15.40:0/3045771648 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:19.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a2d9d640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 0x7f10a406c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.777+0000 7f10a259c640 1 --2- 172.21.15.40:0/3045771648 >> v2:172.21.15.67:3300/0 conn(0x7f10a414f7f0 0x7f10a414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989843645 0 0) 0x7f10a4150210 con 0x7f10a406ea50 2023-05-24T04:01:19.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1090003530 con 0x7f10a406ea50 2023-05-24T04:01:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2545712788 0 0) 0x7f1090003530 con 0x7f10a406ea50 2023-05-24T04:01:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 msgr2=0x7f10a406c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 0x7f10a406c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 >> v2:172.21.15.67:3300/0 conn(0x7f10a414f7f0 msgr2=0x7f10a414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 --2- 172.21.15.40:0/3045771648 >> v2:172.21.15.67:3300/0 conn(0x7f10a414f7f0 0x7f10a414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a406d230 con 0x7f10a406ea50 2023-05-24T04:01:19.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f108c001a00 con 0x7f10a406ea50 2023-05-24T04:01:19.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 >> v1:172.21.15.40:6789/0 conn(0x7f10a406ea50 legacy=0x7f10a406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1090003980 0x7f1090003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 0x7f10900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090004d10 0x7f1090005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41504f0 con 0x7f1090003980 2023-05-24T04:01:19.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a406efd0 con 0x7f1090004d10 2023-05-24T04:01:19.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109000b990 con 0x7f10a4070340 2023-05-24T04:01:19.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1090003980 0x7f1090003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a1d9b640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 0x7f10900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a2d9d640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090004d10 0x7f1090005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 -- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 msgr2=0x7f10900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4070340 0x7f10900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 -- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090004d10 msgr2=0x7f1090005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090004d10 0x7f1090005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 -- 172.21.15.40:0/3045771648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090003530 con 0x7f1090003980 2023-05-24T04:01:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a2d9d640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090004d10 0x7f1090005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:19.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a259c640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1090003980 0x7f1090003d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1094009ae0 tx=0x7f109401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f849b0ef7e3fd3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940a6040 con 0x7f1090003980 2023-05-24T04:01:19.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10940aa400 con 0x7f1090003980 2023-05-24T04:01:19.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a159a640 1 -- 172.21.15.40:0/3045771648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940aa7b0 con 0x7f1090003980 2023-05-24T04:01:19.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a8a88640 1 -- 172.21.15.40:0/3045771648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1090003980 msgr2=0x7f1090003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a8a88640 1 --2- 172.21.15.40:0/3045771648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1090003980 0x7f1090003d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1094009ae0 tx=0x7f109401ca90 comp rx=0 tx=0).stop 2023-05-24T04:01:19.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.781+0000 7f10a2d9d640 1 -- 172.21.15.40:0/3045771648 reap_dead start 2023-05-24T04:01:19.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/3045771648 shutdown_connections 2023-05-24T04:01:19.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/3045771648 >> 172.21.15.40:0/3045771648 conn(0x7f10a40c0300 msgr2=0x7f10a40c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/3045771648 shutdown_connections 2023-05-24T04:01:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/3045771648 wait complete. 2023-05-24T04:01:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 Processor -- start 2023-05-24T04:01:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- start start 2023-05-24T04:01:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090003980 0x7f10a4137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4137bd0 0x7f10a4147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4148140 0x7f10a414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41e87d0 con 0x7f10a4137bd0 2023-05-24T04:01:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41e8110 con 0x7f1090003980 2023-05-24T04:01:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41e83f0 con 0x7f10a4148140 2023-05-24T04:01:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4137bd0 0x7f10a4147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4137bd0 0x7f10a4147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49396/0 (socket says 172.21.15.40:49396) 2023-05-24T04:01:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 -- 172.21.15.40:0/1950616706 learned_addr learned my addr 172.21.15.40:0/1950616706 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a2d9d640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4148140 0x7f10a414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a259c640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090003980 0x7f10a4137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 -- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4148140 msgr2=0x7f10a414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10a4148140 0x7f10a414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 -- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090003980 msgr2=0x7f10a4137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1090003980 0x7f10a4137630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 -- 172.21.15.40:0/1950616706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4157520 con 0x7f10a4137bd0 2023-05-24T04:01:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a1d9b640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4137bd0 0x7f10a4147c00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f90 tx=0x7f108c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00edf0 con 0x7f10a4137bd0 2023-05-24T04:01:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c013420 con 0x7f10a4137bd0 2023-05-24T04:01:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a4157390 con 0x7f10a4137bd0 2023-05-24T04:01:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0137d0 con 0x7f10a4137bd0 2023-05-24T04:01:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41576b0 con 0x7f10a4137bd0 2023-05-24T04:01:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.785+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10a40bca30 con 0x7f10a4137bd0 2023-05-24T04:01:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f108c013930 con 0x7f10a4137bd0 2023-05-24T04:01:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f109affd640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1084066280 0x7f1084068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f108c085360 con 0x7f10a4137bd0 2023-05-24T04:01:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f10a259c640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1084066280 0x7f1084068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f109affd640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f108406ff90 0x7f1084072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 --> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1084072ad0 con 0x7f108406ff90 2023-05-24T04:01:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f108c0856d0 con 0x7f10a4137bd0 2023-05-24T04:01:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f10a2d9d640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f108406ff90 0x7f1084072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f10a259c640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1084066280 0x7f1084068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10940ae000 tx=0x7f10940046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.789+0000 7f10a2d9d640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f108406ff90 0x7f1084072400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.793+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== osd.5 v2:172.21.15.67:6824/4067900882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1084072ad0 con 0x7f108406ff90 2023-05-24T04:01:19.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 --> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f10a404ddd0 con 0x7f108406ff90 2023-05-24T04:01:19.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f109affd640 1 -- 172.21.15.40:0/1950616706 <== osd.5 v2:172.21.15.67:6824/4067900882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f10a404ddd0 con 0x7f108406ff90 2023-05-24T04:01:19.811 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:19.811 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:19.812 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f108406ff90 msgr2=0x7f1084072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.67:6824/4067900882,v1:172.21.15.67:6825/4067900882] conn(0x7f108406ff90 0x7f1084072400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1084066280 msgr2=0x7f1084068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1084066280 0x7f1084068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10940ae000 tx=0x7f10940046d0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4137bd0 msgr2=0x7f10a4147c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 --2- 172.21.15.40:0/1950616706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4137bd0 0x7f10a4147c00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f90 tx=0x7f108c00e530 comp rx=0 tx=0).stop 2023-05-24T04:01:19.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a2d9d640 1 -- 172.21.15.40:0/1950616706 reap_dead start 2023-05-24T04:01:19.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 shutdown_connections 2023-05-24T04:01:19.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 >> 172.21.15.40:0/1950616706 conn(0x7f10a40c0300 msgr2=0x7f10a40bf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 shutdown_connections 2023-05-24T04:01:19.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.805+0000 7f10a8a88640 1 -- 172.21.15.40:0/1950616706 wait complete. 2023-05-24T04:01:19.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-05-24T04:01:19.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 Processor -- start 2023-05-24T04:01:19.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 -- start start 2023-05-24T04:01:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c0a3290 0x7f321c071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f321c14bfe0 0x7f321c06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c14b240 con 0x7f321c14aa30 2023-05-24T04:01:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c071d50 con 0x7f321c14bfe0 2023-05-24T04:01:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3222f9c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c06e810 con 0x7f321c0a3290 2023-05-24T04:01:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f321bfff640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c0a3290 0x7f321c071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3221539640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f321c14bfe0 0x7f321c06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3220d38640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f321c14aa30 0x7f321c071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.40:44784/0 (socket says 172.21.15.40:44784) 2023-05-24T04:01:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3220d38640 1 -- 172.21.15.40:0/1271198408 learned_addr learned my addr 172.21.15.40:0/1271198408 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3221539640 1 -- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c0a3290 msgr2=0x7f321c071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3221539640 1 --2- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c0a3290 0x7f321c071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3221539640 1 -- 172.21.15.40:0/1271198408 >> v1:172.21.15.67:6789/0 conn(0x7f321c14aa30 legacy=0x7f321c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.937+0000 7f3221539640 1 -- 172.21.15.40:0/1271198408 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c06ea20 con 0x7f321c14bfe0 2023-05-24T04:01:19.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3221539640 1 --2- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14bfe0 0x7f321c06ef40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3214009d90 tx=0x7f321401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4786287e53817e62 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f321b7fe640 1 -- 172.21.15.40:0/1271198408 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140a5910 con 0x7f321c14bfe0 2023-05-24T04:01:19.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f321b7fe640 1 -- 172.21.15.40:0/1271198408 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32140a5a70 con 0x7f321c14bfe0 2023-05-24T04:01:19.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f321b7fe640 1 -- 172.21.15.40:0/1271198408 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140a5e00 con 0x7f321c14bfe0 2023-05-24T04:01:19.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14bfe0 msgr2=0x7f321c06ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 --2- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14bfe0 0x7f321c06ef40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3214009d90 tx=0x7f321401c830 comp rx=0 tx=0).stop 2023-05-24T04:01:19.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- 172.21.15.40:0/1271198408 shutdown_connections 2023-05-24T04:01:19.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 --2- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14bfe0 0x7f321c06ef40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 --2- 172.21.15.40:0/1271198408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c0a3290 0x7f321c071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- 172.21.15.40:0/1271198408 >> 172.21.15.40:0/1271198408 conn(0x7f321c0c0280 msgr2=0x7f321c0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:19.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- 172.21.15.40:0/1271198408 shutdown_connections 2023-05-24T04:01:19.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- 172.21.15.40:0/1271198408 wait complete. 2023-05-24T04:01:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 Processor -- start 2023-05-24T04:01:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- start start 2023-05-24T04:01:19.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14aa30 0x7f321c1e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c14bfe0 0x7f321c148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 0x7f321c13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c1459e0 con 0x7f321c147b00 2023-05-24T04:01:19.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c14c540 con 0x7f321c14aa30 2023-05-24T04:01:19.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.941+0000 7f3222f9c640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c14c820 con 0x7f321c14bfe0 2023-05-24T04:01:19.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 0x7f321c13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 0x7f321c13a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49408/0 (socket says 172.21.15.40:49408) 2023-05-24T04:01:19.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 -- 172.21.15.40:0/2302486435 learned_addr learned my addr 172.21.15.40:0/2302486435 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:19.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3220d38640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14aa30 0x7f321c1e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f321bfff640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c14bfe0 0x7f321c148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 -- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c14bfe0 msgr2=0x7f321c148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c14bfe0 0x7f321c148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 -- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14aa30 msgr2=0x7f321c1e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14aa30 0x7f321c1e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 -- 172.21.15.40:0/2302486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3214009a70 con 0x7f321c147b00 2023-05-24T04:01:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3220d38640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14aa30 0x7f321c1e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3221539640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 0x7f321c13a3c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f32140b0040 tx=0x7f32140195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140b9860 con 0x7f321c147b00 2023-05-24T04:01:19.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32140b99c0 con 0x7f321c147b00 2023-05-24T04:01:19.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c157b70 con 0x7f321c147b00 2023-05-24T04:01:19.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140b9d70 con 0x7f321c147b00 2023-05-24T04:01:19.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c1579e0 con 0x7f321c147b00 2023-05-24T04:01:19.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c157d00 con 0x7f321c147b00 2023-05-24T04:01:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32140c4460 con 0x7f321c147b00 2023-05-24T04:01:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f32197fa640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32000662b0 0x7f3200068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:19.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f321411f360 con 0x7f321c147b00 2023-05-24T04:01:19.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3220d38640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32000662b0 0x7f3200068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:19.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.945+0000 7f3220d38640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32000662b0 0x7f3200068760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3210007fd0 tx=0x7f3210009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:19.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:19.949+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f32140ec4b0 con 0x7f321c147b00 2023-05-24T04:01:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.101+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f321c157d00 con 0x7f32000662b0 2023-05-24T04:01:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.101+0000 7f32197fa640 1 -- 172.21.15.40:0/2302486435 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f321c157d00 con 0x7f32000662b0 2023-05-24T04:01:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 5 to deep-scrub 2023-05-24T04:01:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32000662b0 msgr2=0x7f3200068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32000662b0 0x7f3200068760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3210007fd0 tx=0x7f3210009040 comp rx=0 tx=0).stop 2023-05-24T04:01:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 msgr2=0x7f321c13a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 0x7f321c13a3c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f32140b0040 tx=0x7f32140195d0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 shutdown_connections 2023-05-24T04:01:20.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f32000662b0 0x7f3200068760 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f321c147b00 0x7f321c13a3c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f321c14bfe0 0x7f321c148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 --2- 172.21.15.40:0/2302486435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f321c14aa30 0x7f321c1e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 >> 172.21.15.40:0/2302486435 conn(0x7f321c0c0280 msgr2=0x7f321c144420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 shutdown_connections 2023-05-24T04:01:20.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.105+0000 7f3222f9c640 1 -- 172.21.15.40:0/2302486435 wait complete. 2023-05-24T04:01:20.126 INFO:tasks.ceph:Scrubbing osd.6 2023-05-24T04:01:20.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:20.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 Processor -- start 2023-05-24T04:01:20.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 -- start start 2023-05-24T04:01:20.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a7c0bf2f0 0x7f6a7c0c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 0x7f6a7c0a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c0c4580 con 0x7f6a7c0c2820 2023-05-24T04:01:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c3810 con 0x7f6a7c0bf2f0 2023-05-24T04:01:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a825c7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c3380 con 0x7f6a7c0c3990 2023-05-24T04:01:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6a7c0c2820 0x7f6a7c152010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51670/0 (socket says 172.21.15.40:51670) 2023-05-24T04:01:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 -- 172.21.15.40:0/3277725051 learned_addr learned my addr 172.21.15.40:0/3277725051 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7bfff640 1 --2- 172.21.15.40:0/3277725051 >> v2:172.21.15.67:3300/0 conn(0x7f6a7c0bf2f0 0x7f6a7c0c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a737fe640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 0x7f6a7c0a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131808823 0 0) 0x7f6a7c0c4580 con 0x7f6a7c0c2820 2023-05-24T04:01:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a68003530 con 0x7f6a7c0c2820 2023-05-24T04:01:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 721751970 0 0) 0x7f6a68003530 con 0x7f6a7c0c2820 2023-05-24T04:01:20.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 msgr2=0x7f6a7c0a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 0x7f6a7c0a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 >> v2:172.21.15.67:3300/0 conn(0x7f6a7c0bf2f0 msgr2=0x7f6a7c0c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 --2- 172.21.15.40:0/3277725051 >> v2:172.21.15.67:3300/0 conn(0x7f6a7c0bf2f0 0x7f6a7c0c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0aa630 con 0x7f6a7c0c2820 2023-05-24T04:01:20.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f6a74001a00 con 0x7f6a7c0c2820 2023-05-24T04:01:20.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 >> v1:172.21.15.40:6789/0 conn(0x7f6a7c0c2820 legacy=0x7f6a7c152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 0x7f6a68003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a68003f00 0x7f6a680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a68004d10 0x7f6a68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c3810 con 0x7f6a68004d10 2023-05-24T04:01:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c3380 con 0x7f6a68003f00 2023-05-24T04:01:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6800ba70 con 0x7f6a7c0c3990 2023-05-24T04:01:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a68004d10 0x7f6a68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a7bfff640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 0x7f6a68003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 -- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 msgr2=0x7f6a68003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0c3990 0x7f6a68003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 -- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a68003f00 msgr2=0x7f6a680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a68003f00 0x7f6a680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.237+0000 7f6a80b64640 1 -- 172.21.15.40:0/3277725051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68003530 con 0x7f6a68004d10 2023-05-24T04:01:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a80b64640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a68004d10 0x7f6a68005180 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6a740013e0 tx=0x7f6a7401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8d1bb635f927aa server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740ad630 con 0x7f6a68004d10 2023-05-24T04:01:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740a8070 con 0x7f6a68004d10 2023-05-24T04:01:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a7b7fe640 1 -- 172.21.15.40:0/3277725051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740ad9d0 con 0x7f6a68004d10 2023-05-24T04:01:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 -- 172.21.15.40:0/3277725051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a68004d10 msgr2=0x7f6a68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 --2- 172.21.15.40:0/3277725051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a68004d10 0x7f6a68005180 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6a740013e0 tx=0x7f6a7401d380 comp rx=0 tx=0).stop 2023-05-24T04:01:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a80b64640 1 -- 172.21.15.40:0/3277725051 reap_dead start 2023-05-24T04:01:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 -- 172.21.15.40:0/3277725051 shutdown_connections 2023-05-24T04:01:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 -- 172.21.15.40:0/3277725051 >> 172.21.15.40:0/3277725051 conn(0x7f6a7c0a6220 msgr2=0x7f6a7c0a6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 -- 172.21.15.40:0/3277725051 shutdown_connections 2023-05-24T04:01:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 -- 172.21.15.40:0/3277725051 wait complete. 2023-05-24T04:01:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 Processor -- start 2023-05-24T04:01:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.241+0000 7f6a825c7640 1 -- start start 2023-05-24T04:01:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0b9560 0x7f6a7c099930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a7c0baa40 0x7f6a7c1e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c0a30a0 0x7f6a7c0a3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1e6bc0 con 0x7f6a7c0baa40 2023-05-24T04:01:20.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0ba170 con 0x7f6a7c0a30a0 2023-05-24T04:01:20.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0ba410 con 0x7f6a7c0b9560 2023-05-24T04:01:20.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a7c0baa40 0x7f6a7c1e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a7c0baa40 0x7f6a7c1e6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49436/0 (socket says 172.21.15.40:49436) 2023-05-24T04:01:20.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 -- 172.21.15.40:0/344290704 learned_addr learned my addr 172.21.15.40:0/344290704 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a7bfff640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0b9560 0x7f6a7c099930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a80b64640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c0a30a0 0x7f6a7c0a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 -- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0b9560 msgr2=0x7f6a7c099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0b9560 0x7f6a7c099930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 -- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c0a30a0 msgr2=0x7f6a7c0a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c0a30a0 0x7f6a7c0a3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 -- 172.21.15.40:0/344290704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0bf850 con 0x7f6a7c0baa40 2023-05-24T04:01:20.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a7bfff640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c0b9560 0x7f6a7c099930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:20.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a80b64640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c0a30a0 0x7f6a7c0a3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:20.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a737fe640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a7c0baa40 0x7f6a7c1e6680 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400e7c0 tx=0x7f6a6400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400ee70 con 0x7f6a7c0baa40 2023-05-24T04:01:20.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400c940 con 0x7f6a7c0baa40 2023-05-24T04:01:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c0bf6c0 con 0x7f6a7c0baa40 2023-05-24T04:01:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400ccf0 con 0x7f6a7c0baa40 2023-05-24T04:01:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c152720 con 0x7f6a7c0baa40 2023-05-24T04:01:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a7c04ddd0 con 0x7f6a7c0baa40 2023-05-24T04:01:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a64013470 con 0x7f6a7c0baa40 2023-05-24T04:01:20.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6a5c066280 0x7f6a5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a64084400 con 0x7f6a7c0baa40 2023-05-24T04:01:20.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a7bfff640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6a5c066280 0x7f6a5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7f6a5c06ff90 0x7f6a5c072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 --> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a5c072ad0 con 0x7f6a5c06ff90 2023-05-24T04:01:20.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a64084850 con 0x7f6a7c0baa40 2023-05-24T04:01:20.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a7bfff640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6a5c066280 0x7f6a5c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009a00 tx=0x7f6a6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.245+0000 7f6a80b64640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7f6a5c06ff90 0x7f6a5c072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.249+0000 7f6a80b64640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7f6a5c06ff90 0x7f6a5c072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.249+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== osd.6 v2:172.21.15.67:6813/1569713889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6a5c072ad0 con 0x7f6a5c06ff90 2023-05-24T04:01:20.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 --> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a7c1e9e90 con 0x7f6a5c06ff90 2023-05-24T04:01:20.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a797fa640 1 -- 172.21.15.40:0/344290704 <== osd.6 v2:172.21.15.67:6813/1569713889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6a7c1e9e90 con 0x7f6a5c06ff90 2023-05-24T04:01:20.267 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:20.268 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:20.268 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:20.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7f6a5c06ff90 msgr2=0x7f6a5c072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.67:6813/1569713889,v1:172.21.15.67:6815/1569713889] conn(0x7f6a5c06ff90 0x7f6a5c072400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6a5c066280 msgr2=0x7f6a5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f6a5c066280 0x7f6a5c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009a00 tx=0x7f6a6c008040 comp rx=0 tx=0).stop 2023-05-24T04:01:20.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a7c0baa40 msgr2=0x7f6a7c1e6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 --2- 172.21.15.40:0/344290704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a7c0baa40 0x7f6a7c1e6680 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400e7c0 tx=0x7f6a6400ec80 comp rx=0 tx=0).stop 2023-05-24T04:01:20.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a80b64640 1 -- 172.21.15.40:0/344290704 reap_dead start 2023-05-24T04:01:20.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 shutdown_connections 2023-05-24T04:01:20.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 >> 172.21.15.40:0/344290704 conn(0x7f6a7c0a6220 msgr2=0x7f6a7c0a4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 shutdown_connections 2023-05-24T04:01:20.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.261+0000 7f6a825c7640 1 -- 172.21.15.40:0/344290704 wait complete. 2023-05-24T04:01:20.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-05-24T04:01:20.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 Processor -- start 2023-05-24T04:01:20.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 -- start start 2023-05-24T04:01:20.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4fc0142c60 0x7f4fc00b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fc00b5f40 0x7f4fc00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc00bd700 con 0x7f4fc00c17e0 2023-05-24T04:01:20.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc014d020 con 0x7f4fc00b5f40 2023-05-24T04:01:20.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc7d60640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc00bd390 con 0x7f4fc0142c60 2023-05-24T04:01:20.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fc00b5f40 0x7f4fc00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fc00b5f40 0x7f4fc00c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49442/0 (socket says 172.21.15.40:49442) 2023-05-24T04:01:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 -- 172.21.15.40:0/2675046549 learned_addr learned my addr 172.21.15.40:0/2675046549 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc5afc640 1 --2- 172.21.15.40:0/2675046549 >> v2:172.21.15.67:3300/0 conn(0x7f4fc0142c60 0x7f4fc00b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 -- 172.21.15.40:0/2675046549 >> v2:172.21.15.67:3300/0 conn(0x7f4fc0142c60 msgr2=0x7f4fc00b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 --2- 172.21.15.40:0/2675046549 >> v2:172.21.15.67:3300/0 conn(0x7f4fc0142c60 0x7f4fc00b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 -- 172.21.15.40:0/2675046549 >> v1:172.21.15.40:6789/0 conn(0x7f4fc00c17e0 legacy=0x7f4fc00bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc4afa640 1 -- 172.21.15.40:0/2675046549 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505316199 0 0) 0x7f4fc00bd700 con 0x7f4fc00c17e0 2023-05-24T04:01:20.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.389+0000 7f4fc52fb640 1 -- 172.21.15.40:0/2675046549 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00b6d70 con 0x7f4fc00b5f40 2023-05-24T04:01:20.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc52fb640 1 --2- 172.21.15.40:0/2675046549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00b5f40 0x7f4fc00c12a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0071810 tx=0x7f4fb001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bbb360bf0ef39c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc4afa640 1 -- 172.21.15.40:0/2675046549 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00aa5f0 con 0x7f4fc00b5f40 2023-05-24T04:01:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc4afa640 1 -- 172.21.15.40:0/2675046549 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb00aa750 con 0x7f4fc00b5f40 2023-05-24T04:01:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc4afa640 1 -- 172.21.15.40:0/2675046549 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00aaae0 con 0x7f4fc00b5f40 2023-05-24T04:01:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- 172.21.15.40:0/2675046549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00b5f40 msgr2=0x7f4fc00c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/2675046549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00b5f40 0x7f4fc00c12a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0071810 tx=0x7f4fb001c470 comp rx=0 tx=0).stop 2023-05-24T04:01:20.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- 172.21.15.40:0/2675046549 shutdown_connections 2023-05-24T04:01:20.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/2675046549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00b5f40 0x7f4fc00c12a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/2675046549 >> v2:172.21.15.67:3300/0 conn(0x7f4fc0142c60 0x7f4fc00b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- 172.21.15.40:0/2675046549 >> 172.21.15.40:0/2675046549 conn(0x7f4fc006a600 msgr2=0x7f4fc00c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- 172.21.15.40:0/2675046549 shutdown_connections 2023-05-24T04:01:20.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- 172.21.15.40:0/2675046549 wait complete. 2023-05-24T04:01:20.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 Processor -- start 2023-05-24T04:01:20.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- start start 2023-05-24T04:01:20.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fc00b5f40 0x7f4fc014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 0x7f4fc00bb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc0142c60 0x7f4fc014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc014ee70 con 0x7f4fc00c17e0 2023-05-24T04:01:20.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00bc0f0 con 0x7f4fc0142c60 2023-05-24T04:01:20.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc7d60640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00bb5c0 con 0x7f4fc00b5f40 2023-05-24T04:01:20.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc52fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 0x7f4fc00bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc5afc640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fc00b5f40 0x7f4fc014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc52fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 0x7f4fc00bb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49444/0 (socket says 172.21.15.40:49444) 2023-05-24T04:01:20.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc52fb640 1 -- 172.21.15.40:0/1564695285 learned_addr learned my addr 172.21.15.40:0/1564695285 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.393+0000 7f4fc62fd640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc0142c60 0x7f4fc014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc52fb640 1 -- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fc00b5f40 msgr2=0x7f4fc014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc52fb640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fc00b5f40 0x7f4fc014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc52fb640 1 -- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc0142c60 msgr2=0x7f4fc014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc52fb640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc0142c60 0x7f4fc014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc52fb640 1 -- 172.21.15.40:0/1564695285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00094d0 con 0x7f4fc00c17e0 2023-05-24T04:01:20.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc62fd640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc0142c60 0x7f4fc014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:20.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc52fb640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 0x7f4fc00bb080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00ac040 tx=0x7f4fb001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00b3800 con 0x7f4fc00c17e0 2023-05-24T04:01:20.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc014d300 con 0x7f4fc00c17e0 2023-05-24T04:01:20.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb00b3960 con 0x7f4fc00c17e0 2023-05-24T04:01:20.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00b3cd0 con 0x7f4fc00c17e0 2023-05-24T04:01:20.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc014cc80 con 0x7f4fc00c17e0 2023-05-24T04:01:20.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc014d490 con 0x7f4fc00c17e0 2023-05-24T04:01:20.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fb00c6440 con 0x7f4fc00c17e0 2023-05-24T04:01:20.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fb67fc640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4fa4066280 0x7f4fa4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fb00a7070 con 0x7f4fc00c17e0 2023-05-24T04:01:20.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc5afc640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4fa4066280 0x7f4fa4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.397+0000 7f4fc5afc640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4fa4066280 0x7f4fa4068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00badb0 tx=0x7f4fb8009880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.401+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4fb00ebd70 con 0x7f4fc00c17e0 2023-05-24T04:01:20.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.549+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fc00674e0 con 0x7f4fa4066280 2023-05-24T04:01:20.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.549+0000 7f4fb67fc640 1 -- 172.21.15.40:0/1564695285 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4fc00674e0 con 0x7f4fa4066280 2023-05-24T04:01:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 6 to deep-scrub 2023-05-24T04:01:20.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4fa4066280 msgr2=0x7f4fa4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4fa4066280 0x7f4fa4068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00badb0 tx=0x7f4fb8009880 comp rx=0 tx=0).stop 2023-05-24T04:01:20.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 msgr2=0x7f4fc00bb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 0x7f4fc00bb080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00ac040 tx=0x7f4fb001acb0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 shutdown_connections 2023-05-24T04:01:20.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4fa4066280 0x7f4fa4068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc0142c60 0x7f4fc014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc00c17e0 0x7f4fc00bb080 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 --2- 172.21.15.40:0/1564695285 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fc00b5f40 0x7f4fc014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 >> 172.21.15.40:0/1564695285 conn(0x7f4fc006a600 msgr2=0x7f4fc00c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 shutdown_connections 2023-05-24T04:01:20.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.553+0000 7f4fc7d60640 1 -- 172.21.15.40:0/1564695285 wait complete. 2023-05-24T04:01:20.574 INFO:tasks.ceph:Scrubbing osd.7 2023-05-24T04:01:20.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-05-24T04:01:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f9ea04640 1 Processor -- start 2023-05-24T04:01:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f9ea04640 1 -- start start 2023-05-24T04:01:20.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f9ea04640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f9814f7f0 0x7f4f9814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f9ea04640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f98150210 con 0x7f4f9806ea50 2023-05-24T04:01:20.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f9ea04640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f981504f0 con 0x7f4f98070340 2023-05-24T04:01:20.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f9ea04640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9806efd0 con 0x7f4f9814f7f0 2023-05-24T04:01:20.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f9814f7f0 0x7f4f9814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f9814f7f0 0x7f4f9814fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49450/0 (socket says 172.21.15.40:49450) 2023-05-24T04:01:20.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f977fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4f9806ea50 0x7f4f9806bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51692/0 (socket says 172.21.15.40:51692) 2023-05-24T04:01:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f97fff640 1 -- 172.21.15.40:0/454674051 learned_addr learned my addr 172.21.15.40:0/454674051 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f97fff640 1 -- 172.21.15.40:0/454674051 >> v1:172.21.15.67:6789/0 conn(0x7f4f98070340 legacy=0x7f4f98156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f97fff640 1 -- 172.21.15.40:0/454674051 >> v1:172.21.15.40:6789/0 conn(0x7f4f9806ea50 legacy=0x7f4f9806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f97fff640 1 -- 172.21.15.40:0/454674051 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9806d230 con 0x7f4f9814f7f0 2023-05-24T04:01:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.685+0000 7f4f96ffd640 1 -- 172.21.15.40:0/454674051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292392013 0 0) 0x7f4f98150210 con 0x7f4f9806ea50 2023-05-24T04:01:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f97fff640 1 --2- 172.21.15.40:0/454674051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f9814f7f0 0x7f4f9814fbc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009e50 tx=0x7f4f8801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad943ecf0914d4b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f96ffd640 1 -- 172.21.15.40:0/454674051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880a5640 con 0x7f4f9814f7f0 2023-05-24T04:01:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f96ffd640 1 -- 172.21.15.40:0/454674051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f880a57a0 con 0x7f4f9814f7f0 2023-05-24T04:01:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f96ffd640 1 -- 172.21.15.40:0/454674051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880a5b30 con 0x7f4f9814f7f0 2023-05-24T04:01:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 -- 172.21.15.40:0/454674051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f9814f7f0 msgr2=0x7f4f9814fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 --2- 172.21.15.40:0/454674051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f9814f7f0 0x7f4f9814fbc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009e50 tx=0x7f4f8801c980 comp rx=0 tx=0).stop 2023-05-24T04:01:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 -- 172.21.15.40:0/454674051 shutdown_connections 2023-05-24T04:01:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 --2- 172.21.15.40:0/454674051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f9814f7f0 0x7f4f9814fbc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 -- 172.21.15.40:0/454674051 >> 172.21.15.40:0/454674051 conn(0x7f4f980c0300 msgr2=0x7f4f980c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 -- 172.21.15.40:0/454674051 shutdown_connections 2023-05-24T04:01:20.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 -- 172.21.15.40:0/454674051 wait complete. 2023-05-24T04:01:20.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 Processor -- start 2023-05-24T04:01:20.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.689+0000 7f4f9ea04640 1 -- start start 2023-05-24T04:01:20.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f9806ea50 0x7f4f98142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f98070340 0x7f4f98143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9814f7f0 0x7f4f981e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f98152790 con 0x7f4f98070340 2023-05-24T04:01:20.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f98151910 con 0x7f4f9814f7f0 2023-05-24T04:01:20.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f98151bf0 con 0x7f4f9806ea50 2023-05-24T04:01:20.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f98070340 0x7f4f98143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f98070340 0x7f4f98143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49456/0 (socket says 172.21.15.40:49456) 2023-05-24T04:01:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 -- 172.21.15.40:0/3310351411 learned_addr learned my addr 172.21.15.40:0/3310351411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f97fff640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f9806ea50 0x7f4f98142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9cfa1640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9814f7f0 0x7f4f981e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 -- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f9806ea50 msgr2=0x7f4f98142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f9806ea50 0x7f4f98142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 -- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9814f7f0 msgr2=0x7f4f981e81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9814f7f0 0x7f4f981e81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 -- 172.21.15.40:0/3310351411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88009b30 con 0x7f4f98070340 2023-05-24T04:01:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f977fe640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f98070340 0x7f4f98143c20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c410 tx=0x7f4f8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0074e0 con 0x7f4f98070340 2023-05-24T04:01:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c007640 con 0x7f4f98070340 2023-05-24T04:01:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c004a30 con 0x7f4f98070340 2023-05-24T04:01:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9815ac50 con 0x7f4f98070340 2023-05-24T04:01:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9815aac0 con 0x7f4f98070340 2023-05-24T04:01:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f9815ade0 con 0x7f4f98070340 2023-05-24T04:01:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f8c004b90 con 0x7f4f98070340 2023-05-24T04:01:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4f84066280 0x7f4f84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f8c084660 con 0x7f4f98070340 2023-05-24T04:01:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f97fff640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4f84066280 0x7f4f84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7f4f8406ff90 0x7f4f84072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 --> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f84072ad0 con 0x7f4f8406ff90 2023-05-24T04:01:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f8c084ab0 con 0x7f4f98070340 2023-05-24T04:01:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f97fff640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4f84066280 0x7f4f84068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f880ae000 tx=0x7f4f880a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.693+0000 7f4f9cfa1640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7f4f8406ff90 0x7f4f84072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.697+0000 7f4f9cfa1640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7f4f8406ff90 0x7f4f84072400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.697+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== osd.7 v2:172.21.15.67:6808/1243939275 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4f84072ad0 con 0x7f4f8406ff90 2023-05-24T04:01:20.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 --> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f981e8a70 con 0x7f4f8406ff90 2023-05-24T04:01:20.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f94ff9640 1 -- 172.21.15.40:0/3310351411 <== osd.7 v2:172.21.15.67:6808/1243939275 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4f981e8a70 con 0x7f4f8406ff90 2023-05-24T04:01:20.715 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-24T04:01:20.716 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T04:01:20.716 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-24T04:01:20.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7f4f8406ff90 msgr2=0x7f4f84072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.67:6808/1243939275,v1:172.21.15.67:6809/1243939275] conn(0x7f4f8406ff90 0x7f4f84072400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4f84066280 msgr2=0x7f4f84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f4f84066280 0x7f4f84068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f880ae000 tx=0x7f4f880a7070 comp rx=0 tx=0).stop 2023-05-24T04:01:20.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f98070340 msgr2=0x7f4f98143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 --2- 172.21.15.40:0/3310351411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f98070340 0x7f4f98143c20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c410 tx=0x7f4f8c00c8d0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9cfa1640 1 -- 172.21.15.40:0/3310351411 reap_dead start 2023-05-24T04:01:20.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 shutdown_connections 2023-05-24T04:01:20.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 >> 172.21.15.40:0/3310351411 conn(0x7f4f980c0300 msgr2=0x7f4f9806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 shutdown_connections 2023-05-24T04:01:20.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.709+0000 7f4f9ea04640 1 -- 172.21.15.40:0/3310351411 wait complete. 2023-05-24T04:01:20.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-05-24T04:01:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 Processor -- start 2023-05-24T04:01:20.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 -- start start 2023-05-24T04:01:20.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d414fa70 0x7fd3d406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3d4070b20 0x7fd3d406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3d406c000 0x7fd3d4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d406ea20 con 0x7fd3d4070b20 2023-05-24T04:01:20.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d406ec70 con 0x7fd3d406c000 2023-05-24T04:01:20.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3dad17640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4150230 con 0x7fd3d414fa70 2023-05-24T04:01:20.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3d4070b20 0x7fd3d406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3d4070b20 0x7fd3d406bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49460/0 (socket says 172.21.15.40:49460) 2023-05-24T04:01:20.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 -- 172.21.15.40:0/622986260 learned_addr learned my addr 172.21.15.40:0/622986260 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d92b4640 1 --2- 172.21.15.40:0/622986260 >> v2:172.21.15.67:3300/0 conn(0x7fd3d406c000 0x7fd3d4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d8ab3640 1 --2- 172.21.15.40:0/622986260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d414fa70 0x7fd3d406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 -- 172.21.15.40:0/622986260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d414fa70 msgr2=0x7fd3d406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 --2- 172.21.15.40:0/622986260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d414fa70 0x7fd3d406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 -- 172.21.15.40:0/622986260 >> v2:172.21.15.67:3300/0 conn(0x7fd3d406c000 msgr2=0x7fd3d4145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:20.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 --2- 172.21.15.40:0/622986260 >> v2:172.21.15.67:3300/0 conn(0x7fd3d406c000 0x7fd3d4145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.837+0000 7fd3d3fff640 1 -- 172.21.15.40:0/622986260 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40c10d0 con 0x7fd3d4070b20 2023-05-24T04:01:20.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3d3fff640 1 --2- 172.21.15.40:0/622986260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d4070b20 0x7fd3d406bac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3d406d680 tx=0x7fd3c001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c323726d8be4b71 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3d37fe640 1 -- 172.21.15.40:0/622986260 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00ab600 con 0x7fd3d4070b20 2023-05-24T04:01:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3d37fe640 1 -- 172.21.15.40:0/622986260 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c00a7050 con 0x7fd3d4070b20 2023-05-24T04:01:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3d37fe640 1 -- 172.21.15.40:0/622986260 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00ab980 con 0x7fd3d4070b20 2023-05-24T04:01:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 -- 172.21.15.40:0/622986260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d4070b20 msgr2=0x7fd3d406bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 --2- 172.21.15.40:0/622986260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d4070b20 0x7fd3d406bac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3d406d680 tx=0x7fd3c001c500 comp rx=0 tx=0).stop 2023-05-24T04:01:20.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 -- 172.21.15.40:0/622986260 shutdown_connections 2023-05-24T04:01:20.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 --2- 172.21.15.40:0/622986260 >> v2:172.21.15.67:3300/0 conn(0x7fd3d406c000 0x7fd3d4145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 --2- 172.21.15.40:0/622986260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d4070b20 0x7fd3d406bac0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 --2- 172.21.15.40:0/622986260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d414fa70 0x7fd3d406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 -- 172.21.15.40:0/622986260 >> 172.21.15.40:0/622986260 conn(0x7fd3d40c0280 msgr2=0x7fd3d40c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 -- 172.21.15.40:0/622986260 shutdown_connections 2023-05-24T04:01:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 -- 172.21.15.40:0/622986260 wait complete. 2023-05-24T04:01:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 Processor -- start 2023-05-24T04:01:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.841+0000 7fd3dad17640 1 -- start start 2023-05-24T04:01:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3d406c000 0x7fd3d414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d4070b20 0x7fd3d41e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 0x7fd3d41e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d414d710 con 0x7fd3d414fa70 2023-05-24T04:01:20.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41ea6c0 con 0x7fd3d406c000 2023-05-24T04:01:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41e73d0 con 0x7fd3d4070b20 2023-05-24T04:01:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 0x7fd3d41e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 0x7fd3d41e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49472/0 (socket says 172.21.15.40:49472) 2023-05-24T04:01:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 -- 172.21.15.40:0/4197843962 learned_addr learned my addr 172.21.15.40:0/4197843962 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d8ab3640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3d406c000 0x7fd3d414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d3fff640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d4070b20 0x7fd3d41e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 -- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d4070b20 msgr2=0x7fd3d41e6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d4070b20 0x7fd3d41e6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 -- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3d406c000 msgr2=0x7fd3d414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3d406c000 0x7fd3d414aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 -- 172.21.15.40:0/4197843962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00094d0 con 0x7fd3d414fa70 2023-05-24T04:01:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d8ab3640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3d406c000 0x7fd3d414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d92b4640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 0x7fd3d41e6e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009dd0 tx=0x7fd3cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00ced0 con 0x7fd3d414fa70 2023-05-24T04:01:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00f040 con 0x7fd3d414fa70 2023-05-24T04:01:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d414ffd0 con 0x7fd3d414fa70 2023-05-24T04:01:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0146c0 con 0x7fd3d414fa70 2023-05-24T04:01:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d414fe40 con 0x7fd3d414fa70 2023-05-24T04:01:20.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d414ca00 con 0x7fd3d414fa70 2023-05-24T04:01:20.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3cc014820 con 0x7fd3d414fa70 2023-05-24T04:01:20.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d17fa640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd3b8066280 0x7fd3b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd3cc084ef0 con 0x7fd3d414fa70 2023-05-24T04:01:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.845+0000 7fd3d8ab3640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd3b8066280 0x7fd3b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.849+0000 7fd3d8ab3640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd3b8066280 0x7fd3b8068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009720 tx=0x7fd3c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:20.849+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd3cc052030 con 0x7fd3d414fa70 2023-05-24T04:01:21.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3d404ddd0 con 0x7fd3b8066280 2023-05-24T04:01:21.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3d17fa640 1 -- 172.21.15.40:0/4197843962 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3d404ddd0 con 0x7fd3b8066280 2023-05-24T04:01:21.012 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 7 to deep-scrub 2023-05-24T04:01:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd3b8066280 msgr2=0x7fd3b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd3b8066280 0x7fd3b8068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009720 tx=0x7fd3c8008040 comp rx=0 tx=0).stop 2023-05-24T04:01:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 msgr2=0x7fd3d41e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 0x7fd3d41e6e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009dd0 tx=0x7fd3cc00c490 comp rx=0 tx=0).stop 2023-05-24T04:01:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 shutdown_connections 2023-05-24T04:01:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd3b8066280 0x7fd3b8068730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d414fa70 0x7fd3d41e6e90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3d4070b20 0x7fd3d41e6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 --2- 172.21.15.40:0/4197843962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3d406c000 0x7fd3d414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 >> 172.21.15.40:0/4197843962 conn(0x7fd3d40c0280 msgr2=0x7fd3d4143ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:21.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 shutdown_connections 2023-05-24T04:01:21.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.005+0000 7fd3dad17640 1 -- 172.21.15.40:0/4197843962 wait complete. 2023-05-24T04:01:21.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:01:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.149+0000 7fdb67232640 1 Processor -- start 2023-05-24T04:01:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.149+0000 7fdb67232640 1 -- start start 2023-05-24T04:01:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.149+0000 7fdb67232640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600c0e50 0x7fdb60156a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.149+0000 7fdb67232640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb600c3d90 0x7fdb600a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.149+0000 7fdb67232640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb60156fd0 con 0x7fdb600bef60 2023-05-24T04:01:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600bf8b0 con 0x7fdb600c3d90 2023-05-24T04:01:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c2b40 con 0x7fdb600c0e50 2023-05-24T04:01:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb600c3d90 0x7fdb600a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb600c3d90 0x7fdb600a2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49476/0 (socket says 172.21.15.40:49476) 2023-05-24T04:01:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 -- 172.21.15.40:0/4275526969 learned_addr learned my addr 172.21.15.40:0/4275526969 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb57fff640 1 --2- 172.21.15.40:0/4275526969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600c0e50 0x7fdb60156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 -- 172.21.15.40:0/4275526969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600c0e50 msgr2=0x7fdb60156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 --2- 172.21.15.40:0/4275526969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600c0e50 0x7fdb60156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 -- 172.21.15.40:0/4275526969 >> v1:172.21.15.67:6789/0 conn(0x7fdb600bef60 legacy=0x7fdb600c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 -- 172.21.15.40:0/4275526969 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600c3360 con 0x7fdb600c3d90 2023-05-24T04:01:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb657cf640 1 --2- 172.21.15.40:0/4275526969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c3d90 0x7fdb600a2e30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e80 tx=0x7fdb5801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6ad1a8ec2bcb41 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb577fe640 1 -- 172.21.15.40:0/4275526969 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580a5820 con 0x7fdb600c3d90 2023-05-24T04:01:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb577fe640 1 -- 172.21.15.40:0/4275526969 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb580a5980 con 0x7fdb600c3d90 2023-05-24T04:01:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb577fe640 1 -- 172.21.15.40:0/4275526969 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580a5d10 con 0x7fdb600c3d90 2023-05-24T04:01:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- 172.21.15.40:0/4275526969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c3d90 msgr2=0x7fdb600a2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 --2- 172.21.15.40:0/4275526969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c3d90 0x7fdb600a2e30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e80 tx=0x7fdb5801c980 comp rx=0 tx=0).stop 2023-05-24T04:01:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- 172.21.15.40:0/4275526969 shutdown_connections 2023-05-24T04:01:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 --2- 172.21.15.40:0/4275526969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c3d90 0x7fdb600a2e30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 --2- 172.21.15.40:0/4275526969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600c0e50 0x7fdb60156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- 172.21.15.40:0/4275526969 >> 172.21.15.40:0/4275526969 conn(0x7fdb60065bb0 msgr2=0x7fdb600a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- 172.21.15.40:0/4275526969 shutdown_connections 2023-05-24T04:01:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.153+0000 7fdb67232640 1 -- 172.21.15.40:0/4275526969 wait complete. 2023-05-24T04:01:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 Processor -- start 2023-05-24T04:01:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- start start 2023-05-24T04:01:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600bef60 0x7fdb60154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 0x7fdb601ee410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb600c3d90 0x7fdb601ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60151a20 con 0x7fdb600c0e50 2023-05-24T04:01:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb601eefa0 con 0x7fdb600c3d90 2023-05-24T04:01:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60149c50 con 0x7fdb600bef60 2023-05-24T04:01:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 0x7fdb601ee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 0x7fdb601ee410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49478/0 (socket says 172.21.15.40:49478) 2023-05-24T04:01:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 -- 172.21.15.40:0/1402608113 learned_addr learned my addr 172.21.15.40:0/1402608113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb657cf640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb600c3d90 0x7fdb601ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb64fce640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600bef60 0x7fdb60154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 -- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600bef60 msgr2=0x7fdb60154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600bef60 0x7fdb60154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 -- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb600c3d90 msgr2=0x7fdb601ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb600c3d90 0x7fdb601ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 -- 172.21.15.40:0/1402608113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58009b30 con 0x7fdb600c0e50 2023-05-24T04:01:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb657cf640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb600c3d90 0x7fdb601ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb57fff640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 0x7fdb601ee410 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c7f0 tx=0x7fdb5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50004220 con 0x7fdb600c0e50 2023-05-24T04:01:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50004380 con 0x7fdb600c0e50 2023-05-24T04:01:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50003840 con 0x7fdb600c0e50 2023-05-24T04:01:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600a3910 con 0x7fdb600c0e50 2023-05-24T04:01:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600a3780 con 0x7fdb600c0e50 2023-05-24T04:01:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb600c38f0 con 0x7fdb600c0e50 2023-05-24T04:01:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.157+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb500039a0 con 0x7fdb600c0e50 2023-05-24T04:01:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.161+0000 7fdb557fa640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fdb4c0662b0 0x7fdb4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.161+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb50083d90 con 0x7fdb600c0e50 2023-05-24T04:01:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.161+0000 7fdb64fce640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fdb4c0662b0 0x7fdb4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.161+0000 7fdb64fce640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fdb4c0662b0 0x7fdb4c068760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00a750 tx=0x7fdb5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.165+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdb500b46f0 con 0x7fdb600c0e50 2023-05-24T04:01:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.305+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb600a6a50 con 0x7fdb4c0662b0 2023-05-24T04:01:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.325+0000 7fdb557fa640 1 -- 172.21.15.40:0/1402608113 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389858 (secure 0 0 0) 0x7fdb600a6a50 con 0x7fdb4c0662b0 2023-05-24T04:01:21.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:01:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fdb4c0662b0 msgr2=0x7fdb4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fdb4c0662b0 0x7fdb4c068760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00a750 tx=0x7fdb5c008040 comp rx=0 tx=0).stop 2023-05-24T04:01:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 msgr2=0x7fdb601ee410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 0x7fdb601ee410 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c7f0 tx=0x7fdb5000ccb0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 shutdown_connections 2023-05-24T04:01:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fdb4c0662b0 0x7fdb4c068760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb600c3d90 0x7fdb601ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb600c0e50 0x7fdb601ee410 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 --2- 172.21.15.40:0/1402608113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb600bef60 0x7fdb60154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 >> 172.21.15.40:0/1402608113 conn(0x7fdb60065bb0 msgr2=0x7fdb6014cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 shutdown_connections 2023-05-24T04:01:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:21.329+0000 7fdb67232640 1 -- 172.21.15.40:0/1402608113 wait complete. 2023-05-24T04:01:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-05-24T04:01:20.550857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596750,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004477"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098134+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:40.098134+0000","last_peered":"2023-05-24T04:00:40.098134+0000","last_clean":"2023-05-24T04:00:40.098134+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:40.098134+0000","last_undegraded":"2023-05-24T04:00:40.098134+0000","last_fullsized":"2023-05-24T04:00:40.098134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:25:30.173497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811843+0000","last_change":"2023-05-24T03:59:57.541756+0000","last_active":"2023-05-24T04:00:39.811843+0000","last_peered":"2023-05-24T04:00:39.811843+0000","last_clean":"2023-05-24T04:00:39.811843+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:00:39.811843+0000","last_undegraded":"2023-05-24T04:00:39.811843+0000","last_fullsized":"2023-05-24T04:00:39.811843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808631+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808631+0000","last_peered":"2023-05-24T04:00:39.808631+0000","last_clean":"2023-05-24T04:00:39.808631+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808631+0000","last_undegraded":"2023-05-24T04:00:39.808631+0000","last_fullsized":"2023-05-24T04:00:39.808631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:47:07.540556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807713+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807713+0000","last_peered":"2023-05-24T04:00:39.807713+0000","last_clean":"2023-05-24T04:00:39.807713+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807713+0000","last_undegraded":"2023-05-24T04:00:39.807713+0000","last_fullsized":"2023-05-24T04:00:39.807713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:54:29.409167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101558+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:40.101558+0000","last_peered":"2023-05-24T04:00:40.101558+0000","last_clean":"2023-05-24T04:00:40.101558+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:40.101558+0000","last_undegraded":"2023-05-24T04:00:40.101558+0000","last_fullsized":"2023-05-24T04:00:40.101558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:49:14.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100127+0000","last_change":"2023-05-24T03:59:57.912945+0000","last_active":"2023-05-24T04:00:40.100127+0000","last_peered":"2023-05-24T04:00:40.100127+0000","last_clean":"2023-05-24T04:00:40.100127+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:00:40.100127+0000","last_undegraded":"2023-05-24T04:00:40.100127+0000","last_fullsized":"2023-05-24T04:00:40.100127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101621+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101621+0000","last_peered":"2023-05-24T04:00:40.101621+0000","last_clean":"2023-05-24T04:00:40.101621+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101621+0000","last_undegraded":"2023-05-24T04:00:40.101621+0000","last_fullsized":"2023-05-24T04:00:40.101621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102900+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:40.102900+0000","last_peered":"2023-05-24T04:00:40.102900+0000","last_clean":"2023-05-24T04:00:40.102900+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:40.102900+0000","last_undegraded":"2023-05-24T04:00:40.102900+0000","last_fullsized":"2023-05-24T04:00:40.102900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809068+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:39.809068+0000","last_peered":"2023-05-24T04:00:39.809068+0000","last_clean":"2023-05-24T04:00:39.809068+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:39.809068+0000","last_undegraded":"2023-05-24T04:00:39.809068+0000","last_fullsized":"2023-05-24T04:00:39.809068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:12:56.539054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099216+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099216+0000","last_peered":"2023-05-24T04:00:40.099216+0000","last_clean":"2023-05-24T04:00:40.099216+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099216+0000","last_undegraded":"2023-05-24T04:00:40.099216+0000","last_fullsized":"2023-05-24T04:00:40.099216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101865+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:40.101865+0000","last_peered":"2023-05-24T04:00:40.101865+0000","last_clean":"2023-05-24T04:00:40.101865+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:40.101865+0000","last_undegraded":"2023-05-24T04:00:40.101865+0000","last_fullsized":"2023-05-24T04:00:40.101865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:54.557612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809755+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:39.809755+0000","last_peered":"2023-05-24T04:00:39.809755+0000","last_clean":"2023-05-24T04:00:39.809755+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:39.809755+0000","last_undegraded":"2023-05-24T04:00:39.809755+0000","last_fullsized":"2023-05-24T04:00:39.809755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:45.203491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102303+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:40.102303+0000","last_peered":"2023-05-24T04:00:40.102303+0000","last_clean":"2023-05-24T04:00:40.102303+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:40.102303+0000","last_undegraded":"2023-05-24T04:00:40.102303+0000","last_fullsized":"2023-05-24T04:00:40.102303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:04:41.791492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811965+0000","last_change":"2023-05-24T03:59:57.561697+0000","last_active":"2023-05-24T04:00:39.811965+0000","last_peered":"2023-05-24T04:00:39.811965+0000","last_clean":"2023-05-24T04:00:39.811965+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:00:39.811965+0000","last_undegraded":"2023-05-24T04:00:39.811965+0000","last_fullsized":"2023-05-24T04:00:39.811965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806100+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:39.806100+0000","last_peered":"2023-05-24T04:00:39.806100+0000","last_clean":"2023-05-24T04:00:39.806100+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:39.806100+0000","last_undegraded":"2023-05-24T04:00:39.806100+0000","last_fullsized":"2023-05-24T04:00:39.806100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:07.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:37:15.796537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809729+0000","last_change":"2023-05-24T03:59:57.543939+0000","last_active":"2023-05-24T04:00:39.809729+0000","last_peered":"2023-05-24T04:00:39.809729+0000","last_clean":"2023-05-24T04:00:39.809729+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:00:39.809729+0000","last_undegraded":"2023-05-24T04:00:39.809729+0000","last_fullsized":"2023-05-24T04:00:39.809729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:06:22.746009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101645+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:40.101645+0000","last_peered":"2023-05-24T04:00:40.101645+0000","last_clean":"2023-05-24T04:00:40.101645+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:40.101645+0000","last_undegraded":"2023-05-24T04:00:40.101645+0000","last_fullsized":"2023-05-24T04:00:40.101645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:20:52.502756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812080+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:39.812080+0000","last_peered":"2023-05-24T04:00:39.812080+0000","last_clean":"2023-05-24T04:00:39.812080+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:39.812080+0000","last_undegraded":"2023-05-24T04:00:39.812080+0000","last_fullsized":"2023-05-24T04:00:39.812080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:42.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.534718+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:31.402385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811197+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:39.811197+0000","last_peered":"2023-05-24T04:00:39.811197+0000","last_clean":"2023-05-24T04:00:39.811197+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:39.811197+0000","last_undegraded":"2023-05-24T04:00:39.811197+0000","last_fullsized":"2023-05-24T04:00:39.811197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810982+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:39.810982+0000","last_peered":"2023-05-24T04:00:39.810982+0000","last_clean":"2023-05-24T04:00:39.810982+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:39.810982+0000","last_undegraded":"2023-05-24T04:00:39.810982+0000","last_fullsized":"2023-05-24T04:00:39.810982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099052+0000","last_change":"2023-05-24T03:59:57.537757+0000","last_active":"2023-05-24T04:00:40.099052+0000","last_peered":"2023-05-24T04:00:40.099052+0000","last_clean":"2023-05-24T04:00:40.099052+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:00:40.099052+0000","last_undegraded":"2023-05-24T04:00:40.099052+0000","last_fullsized":"2023-05-24T04:00:40.099052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:23.810199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812582+0000","last_change":"2023-05-24T03:59:57.931642+0000","last_active":"2023-05-24T04:00:39.812582+0000","last_peered":"2023-05-24T04:00:39.812582+0000","last_clean":"2023-05-24T04:00:39.812582+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:00:39.812582+0000","last_undegraded":"2023-05-24T04:00:39.812582+0000","last_fullsized":"2023-05-24T04:00:39.812582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:44:14.672724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098638+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:40.098638+0000","last_peered":"2023-05-24T04:00:40.098638+0000","last_clean":"2023-05-24T04:00:40.098638+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:40.098638+0000","last_undegraded":"2023-05-24T04:00:40.098638+0000","last_fullsized":"2023-05-24T04:00:40.098638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812113+0000","last_change":"2023-05-24T03:59:57.542013+0000","last_active":"2023-05-24T04:00:39.812113+0000","last_peered":"2023-05-24T04:00:39.812113+0000","last_clean":"2023-05-24T04:00:39.812113+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:00:39.812113+0000","last_undegraded":"2023-05-24T04:00:39.812113+0000","last_fullsized":"2023-05-24T04:00:39.812113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808823+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:39.808823+0000","last_peered":"2023-05-24T04:00:39.808823+0000","last_clean":"2023-05-24T04:00:39.808823+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:39.808823+0000","last_undegraded":"2023-05-24T04:00:39.808823+0000","last_fullsized":"2023-05-24T04:00:39.808823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:38:36.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099608+0000","last_change":"2023-05-24T03:59:57.919527+0000","last_active":"2023-05-24T04:00:40.099608+0000","last_peered":"2023-05-24T04:00:40.099608+0000","last_clean":"2023-05-24T04:00:40.099608+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:00:40.099608+0000","last_undegraded":"2023-05-24T04:00:40.099608+0000","last_fullsized":"2023-05-24T04:00:40.099608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:13.713373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103289+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:40.103289+0000","last_peered":"2023-05-24T04:00:40.103289+0000","last_clean":"2023-05-24T04:00:40.103289+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:40.103289+0000","last_undegraded":"2023-05-24T04:00:40.103289+0000","last_fullsized":"2023-05-24T04:00:40.103289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098253+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:40.098253+0000","last_peered":"2023-05-24T04:00:40.098253+0000","last_clean":"2023-05-24T04:00:40.098253+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:40.098253+0000","last_undegraded":"2023-05-24T04:00:40.098253+0000","last_fullsized":"2023-05-24T04:00:40.098253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:04.542093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100587+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:40.100587+0000","last_peered":"2023-05-24T04:00:40.100587+0000","last_clean":"2023-05-24T04:00:40.100587+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:40.100587+0000","last_undegraded":"2023-05-24T04:00:40.100587+0000","last_fullsized":"2023-05-24T04:00:40.100587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:45.142429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100516+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:40.100516+0000","last_peered":"2023-05-24T04:00:40.100516+0000","last_clean":"2023-05-24T04:00:40.100516+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:40.100516+0000","last_undegraded":"2023-05-24T04:00:40.100516+0000","last_fullsized":"2023-05-24T04:00:40.100516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:25:01.484129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099676+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099676+0000","last_peered":"2023-05-24T04:00:40.099676+0000","last_clean":"2023-05-24T04:00:40.099676+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099676+0000","last_undegraded":"2023-05-24T04:00:40.099676+0000","last_fullsized":"2023-05-24T04:00:40.099676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:49.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'18","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:13.886631+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:01:13.886631+0000","last_peered":"2023-05-24T04:01:13.886631+0000","last_clean":"2023-05-24T04:01:13.886631+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:01:13.886631+0000","last_undegraded":"2023-05-24T04:01:13.886631+0000","last_fullsized":"2023-05-24T04:01:13.886631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:13.476915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810164+0000","last_change":"2023-05-24T03:59:57.924622+0000","last_active":"2023-05-24T04:00:39.810164+0000","last_peered":"2023-05-24T04:00:39.810164+0000","last_clean":"2023-05-24T04:00:39.810164+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:00:39.810164+0000","last_undegraded":"2023-05-24T04:00:39.810164+0000","last_fullsized":"2023-05-24T04:00:39.810164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:39:14.636334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099694+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:40.099694+0000","last_peered":"2023-05-24T04:00:40.099694+0000","last_clean":"2023-05-24T04:00:40.099694+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:40.099694+0000","last_undegraded":"2023-05-24T04:00:40.099694+0000","last_fullsized":"2023-05-24T04:00:40.099694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:00.182042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808228+0000","last_change":"2023-05-24T03:59:57.929825+0000","last_active":"2023-05-24T04:00:39.808228+0000","last_peered":"2023-05-24T04:00:39.808228+0000","last_clean":"2023-05-24T04:00:39.808228+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:00:39.808228+0000","last_undegraded":"2023-05-24T04:00:39.808228+0000","last_fullsized":"2023-05-24T04:00:39.808228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:32.909184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812908+0000","last_change":"2023-05-24T03:59:53.475055+0000","last_active":"2023-05-24T04:00:39.812908+0000","last_peered":"2023-05-24T04:00:39.812908+0000","last_clean":"2023-05-24T04:00:39.812908+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:00:39.812908+0000","last_undegraded":"2023-05-24T04:00:39.812908+0000","last_fullsized":"2023-05-24T04:00:39.812908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:38:45.501543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811949+0000","last_change":"2023-05-24T03:59:57.533712+0000","last_active":"2023-05-24T04:00:39.811949+0000","last_peered":"2023-05-24T04:00:39.811949+0000","last_clean":"2023-05-24T04:00:39.811949+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:00:39.811949+0000","last_undegraded":"2023-05-24T04:00:39.811949+0000","last_fullsized":"2023-05-24T04:00:39.811949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.097881+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:40.097881+0000","last_peered":"2023-05-24T04:00:40.097881+0000","last_clean":"2023-05-24T04:00:40.097881+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:40.097881+0000","last_undegraded":"2023-05-24T04:00:40.097881+0000","last_fullsized":"2023-05-24T04:00:40.097881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:49.262681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098933+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:40.098933+0000","last_peered":"2023-05-24T04:00:40.098933+0000","last_clean":"2023-05-24T04:00:40.098933+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:40.098933+0000","last_undegraded":"2023-05-24T04:00:40.098933+0000","last_fullsized":"2023-05-24T04:00:40.098933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104154+0000","last_change":"2023-05-24T03:59:53.473879+0000","last_active":"2023-05-24T04:00:40.104154+0000","last_peered":"2023-05-24T04:00:40.104154+0000","last_clean":"2023-05-24T04:00:40.104154+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:00:40.104154+0000","last_undegraded":"2023-05-24T04:00:40.104154+0000","last_fullsized":"2023-05-24T04:00:40.104154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102855+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:40.102855+0000","last_peered":"2023-05-24T04:00:40.102855+0000","last_clean":"2023-05-24T04:00:40.102855+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:40.102855+0000","last_undegraded":"2023-05-24T04:00:40.102855+0000","last_fullsized":"2023-05-24T04:00:40.102855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:21:15.498619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807527+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:39.807527+0000","last_peered":"2023-05-24T04:00:39.807527+0000","last_clean":"2023-05-24T04:00:39.807527+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:39.807527+0000","last_undegraded":"2023-05-24T04:00:39.807527+0000","last_fullsized":"2023-05-24T04:00:39.807527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:50:20.457205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811559+0000","last_change":"2023-05-24T03:59:57.929732+0000","last_active":"2023-05-24T04:00:39.811559+0000","last_peered":"2023-05-24T04:00:39.811559+0000","last_clean":"2023-05-24T04:00:39.811559+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:00:39.811559+0000","last_undegraded":"2023-05-24T04:00:39.811559+0000","last_fullsized":"2023-05-24T04:00:39.811559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:13.355964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101081+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:40.101081+0000","last_peered":"2023-05-24T04:00:40.101081+0000","last_clean":"2023-05-24T04:00:40.101081+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:40.101081+0000","last_undegraded":"2023-05-24T04:00:40.101081+0000","last_fullsized":"2023-05-24T04:00:40.101081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:43.311066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102093+0000","last_change":"2023-05-24T03:59:57.531907+0000","last_active":"2023-05-24T04:00:40.102093+0000","last_peered":"2023-05-24T04:00:40.102093+0000","last_clean":"2023-05-24T04:00:40.102093+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:00:40.102093+0000","last_undegraded":"2023-05-24T04:00:40.102093+0000","last_fullsized":"2023-05-24T04:00:40.102093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:38.719131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809601+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:39.809601+0000","last_peered":"2023-05-24T04:00:39.809601+0000","last_clean":"2023-05-24T04:00:39.809601+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:39.809601+0000","last_undegraded":"2023-05-24T04:00:39.809601+0000","last_fullsized":"2023-05-24T04:00:39.809601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:10:59.234197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100812+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:40.100812+0000","last_peered":"2023-05-24T04:00:40.100812+0000","last_clean":"2023-05-24T04:00:40.100812+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:40.100812+0000","last_undegraded":"2023-05-24T04:00:40.100812+0000","last_fullsized":"2023-05-24T04:00:40.100812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:35:54.009858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102670+0000","last_change":"2023-05-24T03:59:53.622087+0000","last_active":"2023-05-24T04:00:40.102670+0000","last_peered":"2023-05-24T04:00:40.102670+0000","last_clean":"2023-05-24T04:00:40.102670+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:00:40.102670+0000","last_undegraded":"2023-05-24T04:00:40.102670+0000","last_fullsized":"2023-05-24T04:00:40.102670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:32.061491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103107+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:40.103107+0000","last_peered":"2023-05-24T04:00:40.103107+0000","last_clean":"2023-05-24T04:00:40.103107+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:40.103107+0000","last_undegraded":"2023-05-24T04:00:40.103107+0000","last_fullsized":"2023-05-24T04:00:40.103107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:47.353354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811169+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:39.811169+0000","last_peered":"2023-05-24T04:00:39.811169+0000","last_clean":"2023-05-24T04:00:39.811169+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:39.811169+0000","last_undegraded":"2023-05-24T04:00:39.811169+0000","last_fullsized":"2023-05-24T04:00:39.811169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:42.314974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101790+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:40.101790+0000","last_peered":"2023-05-24T04:00:40.101790+0000","last_clean":"2023-05-24T04:00:40.101790+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:40.101790+0000","last_undegraded":"2023-05-24T04:00:40.101790+0000","last_fullsized":"2023-05-24T04:00:40.101790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:00:21.503763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810092+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:39.810092+0000","last_peered":"2023-05-24T04:00:39.810092+0000","last_clean":"2023-05-24T04:00:39.810092+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:39.810092+0000","last_undegraded":"2023-05-24T04:00:39.810092+0000","last_fullsized":"2023-05-24T04:00:39.810092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:36.913572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100241+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:40.100241+0000","last_peered":"2023-05-24T04:00:40.100241+0000","last_clean":"2023-05-24T04:00:40.100241+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:40.100241+0000","last_undegraded":"2023-05-24T04:00:40.100241+0000","last_fullsized":"2023-05-24T04:00:40.100241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:53.250170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811058+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:39.811058+0000","last_peered":"2023-05-24T04:00:39.811058+0000","last_clean":"2023-05-24T04:00:39.811058+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:39.811058+0000","last_undegraded":"2023-05-24T04:00:39.811058+0000","last_fullsized":"2023-05-24T04:00:39.811058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:45:01.718470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.104757+0000","last_change":"2023-05-24T04:00:40.102360+0000","last_active":"2023-05-24T04:00:40.104757+0000","last_peered":"2023-05-24T04:00:40.104757+0000","last_clean":"2023-05-24T04:00:40.104757+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:00:40.104757+0000","last_undegraded":"2023-05-24T04:00:40.104757+0000","last_fullsized":"2023-05-24T04:00:40.104757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098405+0000","last_change":"2023-05-24T03:59:57.531318+0000","last_active":"2023-05-24T04:00:40.098405+0000","last_peered":"2023-05-24T04:00:40.098405+0000","last_clean":"2023-05-24T04:00:40.098405+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:00:40.098405+0000","last_undegraded":"2023-05-24T04:00:40.098405+0000","last_fullsized":"2023-05-24T04:00:40.098405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:22:56.621238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806011+0000","last_change":"2023-05-24T03:59:53.897955+0000","last_active":"2023-05-24T04:00:39.806011+0000","last_peered":"2023-05-24T04:00:39.806011+0000","last_clean":"2023-05-24T04:00:39.806011+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:00:39.806011+0000","last_undegraded":"2023-05-24T04:00:39.806011+0000","last_fullsized":"2023-05-24T04:00:39.806011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:17.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806066+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:39.806066+0000","last_peered":"2023-05-24T04:00:39.806066+0000","last_clean":"2023-05-24T04:00:39.806066+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:39.806066+0000","last_undegraded":"2023-05-24T04:00:39.806066+0000","last_fullsized":"2023-05-24T04:00:39.806066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:19:27.531659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811579+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:39.811579+0000","last_peered":"2023-05-24T04:00:39.811579+0000","last_clean":"2023-05-24T04:00:39.811579+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:39.811579+0000","last_undegraded":"2023-05-24T04:00:39.811579+0000","last_fullsized":"2023-05-24T04:00:39.811579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810390+0000","last_change":"2023-05-24T03:59:57.565047+0000","last_active":"2023-05-24T04:00:39.810390+0000","last_peered":"2023-05-24T04:00:39.810390+0000","last_clean":"2023-05-24T04:00:39.810390+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:00:39.810390+0000","last_undegraded":"2023-05-24T04:00:39.810390+0000","last_fullsized":"2023-05-24T04:00:39.810390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:36.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098998+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:40.098998+0000","last_peered":"2023-05-24T04:00:40.098998+0000","last_clean":"2023-05-24T04:00:40.098998+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:40.098998+0000","last_undegraded":"2023-05-24T04:00:40.098998+0000","last_fullsized":"2023-05-24T04:00:40.098998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:33.846674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103363+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:40.103363+0000","last_peered":"2023-05-24T04:00:40.103363+0000","last_clean":"2023-05-24T04:00:40.103363+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:40.103363+0000","last_undegraded":"2023-05-24T04:00:40.103363+0000","last_fullsized":"2023-05-24T04:00:40.103363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811513+0000","last_change":"2023-05-24T03:59:57.933998+0000","last_active":"2023-05-24T04:00:39.811513+0000","last_peered":"2023-05-24T04:00:39.811513+0000","last_clean":"2023-05-24T04:00:39.811513+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:00:39.811513+0000","last_undegraded":"2023-05-24T04:00:39.811513+0000","last_fullsized":"2023-05-24T04:00:39.811513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:02:20.313678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100288+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:40.100288+0000","last_peered":"2023-05-24T04:00:40.100288+0000","last_clean":"2023-05-24T04:00:40.100288+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:40.100288+0000","last_undegraded":"2023-05-24T04:00:40.100288+0000","last_fullsized":"2023-05-24T04:00:40.100288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101907+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:40.101907+0000","last_peered":"2023-05-24T04:00:40.101907+0000","last_clean":"2023-05-24T04:00:40.101907+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:40.101907+0000","last_undegraded":"2023-05-24T04:00:40.101907+0000","last_fullsized":"2023-05-24T04:00:40.101907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:08.298712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099345+0000","last_change":"2023-05-24T03:59:47.867670+0000","last_active":"2023-05-24T04:00:40.099345+0000","last_peered":"2023-05-24T04:00:40.099345+0000","last_clean":"2023-05-24T04:00:40.099345+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:00:40.099345+0000","last_undegraded":"2023-05-24T04:00:40.099345+0000","last_fullsized":"2023-05-24T04:00:40.099345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:46.733500+0000","last_clean_scrub_stamp":"2023-05-24T03:59:46.733500+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.596528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099215+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:40.099215+0000","last_peered":"2023-05-24T04:00:40.099215+0000","last_clean":"2023-05-24T04:00:40.099215+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:40.099215+0000","last_undegraded":"2023-05-24T04:00:40.099215+0000","last_fullsized":"2023-05-24T04:00:40.099215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:42.602756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103467+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:40.103467+0000","last_peered":"2023-05-24T04:00:40.103467+0000","last_clean":"2023-05-24T04:00:40.103467+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:40.103467+0000","last_undegraded":"2023-05-24T04:00:40.103467+0000","last_fullsized":"2023-05-24T04:00:40.103467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:36.522307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099294+0000","last_change":"2023-05-24T03:59:57.539209+0000","last_active":"2023-05-24T04:00:40.099294+0000","last_peered":"2023-05-24T04:00:40.099294+0000","last_clean":"2023-05-24T04:00:40.099294+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:00:40.099294+0000","last_undegraded":"2023-05-24T04:00:40.099294+0000","last_fullsized":"2023-05-24T04:00:40.099294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812016+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:39.812016+0000","last_peered":"2023-05-24T04:00:39.812016+0000","last_clean":"2023-05-24T04:00:39.812016+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:39.812016+0000","last_undegraded":"2023-05-24T04:00:39.812016+0000","last_fullsized":"2023-05-24T04:00:39.812016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:57.390669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811982+0000","last_change":"2023-05-24T03:59:57.925230+0000","last_active":"2023-05-24T04:00:39.811982+0000","last_peered":"2023-05-24T04:00:39.811982+0000","last_clean":"2023-05-24T04:00:39.811982+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:00:39.811982+0000","last_undegraded":"2023-05-24T04:00:39.811982+0000","last_fullsized":"2023-05-24T04:00:39.811982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:17:19.685408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808375+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:39.808375+0000","last_peered":"2023-05-24T04:00:39.808375+0000","last_clean":"2023-05-24T04:00:39.808375+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:39.808375+0000","last_undegraded":"2023-05-24T04:00:39.808375+0000","last_fullsized":"2023-05-24T04:00:39.808375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:17.724238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102989+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:40.102989+0000","last_peered":"2023-05-24T04:00:40.102989+0000","last_clean":"2023-05-24T04:00:40.102989+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:40.102989+0000","last_undegraded":"2023-05-24T04:00:40.102989+0000","last_fullsized":"2023-05-24T04:00:40.102989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:50.312748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811159+0000","last_change":"2023-05-24T03:59:57.928232+0000","last_active":"2023-05-24T04:00:39.811159+0000","last_peered":"2023-05-24T04:00:39.811159+0000","last_clean":"2023-05-24T04:00:39.811159+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:00:39.811159+0000","last_undegraded":"2023-05-24T04:00:39.811159+0000","last_fullsized":"2023-05-24T04:00:39.811159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:56:00.664781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810571+0000","last_change":"2023-05-24T03:59:57.560312+0000","last_active":"2023-05-24T04:00:39.810571+0000","last_peered":"2023-05-24T04:00:39.810571+0000","last_clean":"2023-05-24T04:00:39.810571+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:00:39.810571+0000","last_undegraded":"2023-05-24T04:00:39.810571+0000","last_fullsized":"2023-05-24T04:00:39.810571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:14:19.952827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100969+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:40.100969+0000","last_peered":"2023-05-24T04:00:40.100969+0000","last_clean":"2023-05-24T04:00:40.100969+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:40.100969+0000","last_undegraded":"2023-05-24T04:00:40.100969+0000","last_fullsized":"2023-05-24T04:00:40.100969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:41:02.080284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810519+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:39.810519+0000","last_peered":"2023-05-24T04:00:39.810519+0000","last_clean":"2023-05-24T04:00:39.810519+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:39.810519+0000","last_undegraded":"2023-05-24T04:00:39.810519+0000","last_fullsized":"2023-05-24T04:00:39.810519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:35:05.654962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100459+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:40.100459+0000","last_peered":"2023-05-24T04:00:40.100459+0000","last_clean":"2023-05-24T04:00:40.100459+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:40.100459+0000","last_undegraded":"2023-05-24T04:00:40.100459+0000","last_fullsized":"2023-05-24T04:00:40.100459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:15.156228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806108+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:39.806108+0000","last_peered":"2023-05-24T04:00:39.806108+0000","last_clean":"2023-05-24T04:00:39.806108+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:39.806108+0000","last_undegraded":"2023-05-24T04:00:39.806108+0000","last_fullsized":"2023-05-24T04:00:39.806108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:16:50.350647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811381+0000","last_change":"2023-05-24T03:59:57.934363+0000","last_active":"2023-05-24T04:00:39.811381+0000","last_peered":"2023-05-24T04:00:39.811381+0000","last_clean":"2023-05-24T04:00:39.811381+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:00:39.811381+0000","last_undegraded":"2023-05-24T04:00:39.811381+0000","last_fullsized":"2023-05-24T04:00:39.811381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:39.191708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101832+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:40.101832+0000","last_peered":"2023-05-24T04:00:40.101832+0000","last_clean":"2023-05-24T04:00:40.101832+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:40.101832+0000","last_undegraded":"2023-05-24T04:00:40.101832+0000","last_fullsized":"2023-05-24T04:00:40.101832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:44.836669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805566+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:39.805566+0000","last_peered":"2023-05-24T04:00:39.805566+0000","last_clean":"2023-05-24T04:00:39.805566+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:39.805566+0000","last_undegraded":"2023-05-24T04:00:39.805566+0000","last_fullsized":"2023-05-24T04:00:39.805566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:12.564375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809938+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:39.809938+0000","last_peered":"2023-05-24T04:00:39.809938+0000","last_clean":"2023-05-24T04:00:39.809938+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:39.809938+0000","last_undegraded":"2023-05-24T04:00:39.809938+0000","last_fullsized":"2023-05-24T04:00:39.809938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:54:15.493746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100839+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:40.100839+0000","last_peered":"2023-05-24T04:00:40.100839+0000","last_clean":"2023-05-24T04:00:40.100839+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:40.100839+0000","last_undegraded":"2023-05-24T04:00:40.100839+0000","last_fullsized":"2023-05-24T04:00:40.100839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:45.886736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805477+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:39.805477+0000","last_peered":"2023-05-24T04:00:39.805477+0000","last_clean":"2023-05-24T04:00:39.805477+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:39.805477+0000","last_undegraded":"2023-05-24T04:00:39.805477+0000","last_fullsized":"2023-05-24T04:00:39.805477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:44:38.716971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807987+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:39.807987+0000","last_peered":"2023-05-24T04:00:39.807987+0000","last_clean":"2023-05-24T04:00:39.807987+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:39.807987+0000","last_undegraded":"2023-05-24T04:00:39.807987+0000","last_fullsized":"2023-05-24T04:00:39.807987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:51.406995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100571+0000","last_change":"2023-05-24T03:59:57.566523+0000","last_active":"2023-05-24T04:00:40.100571+0000","last_peered":"2023-05-24T04:00:40.100571+0000","last_clean":"2023-05-24T04:00:40.100571+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:00:40.100571+0000","last_undegraded":"2023-05-24T04:00:40.100571+0000","last_fullsized":"2023-05-24T04:00:40.100571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:19:12.698410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805132+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:39.805132+0000","last_peered":"2023-05-24T04:00:39.805132+0000","last_clean":"2023-05-24T04:00:39.805132+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:39.805132+0000","last_undegraded":"2023-05-24T04:00:39.805132+0000","last_fullsized":"2023-05-24T04:00:39.805132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:25.035753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100792+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:40.100792+0000","last_peered":"2023-05-24T04:00:40.100792+0000","last_clean":"2023-05-24T04:00:40.100792+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:40.100792+0000","last_undegraded":"2023-05-24T04:00:40.100792+0000","last_fullsized":"2023-05-24T04:00:40.100792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:52.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101157+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:40.101157+0000","last_peered":"2023-05-24T04:00:40.101157+0000","last_clean":"2023-05-24T04:00:40.101157+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:40.101157+0000","last_undegraded":"2023-05-24T04:00:40.101157+0000","last_fullsized":"2023-05-24T04:00:40.101157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:51:23.659950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099062+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:40.099062+0000","last_peered":"2023-05-24T04:00:40.099062+0000","last_clean":"2023-05-24T04:00:40.099062+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:40.099062+0000","last_undegraded":"2023-05-24T04:00:40.099062+0000","last_fullsized":"2023-05-24T04:00:40.099062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:50:56.328860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102734+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102734+0000","last_peered":"2023-05-24T04:00:40.102734+0000","last_clean":"2023-05-24T04:00:40.102734+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102734+0000","last_undegraded":"2023-05-24T04:00:40.102734+0000","last_fullsized":"2023-05-24T04:00:40.102734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:30.684575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807393+0000","last_change":"2023-05-24T03:59:57.531040+0000","last_active":"2023-05-24T04:00:39.807393+0000","last_peered":"2023-05-24T04:00:39.807393+0000","last_clean":"2023-05-24T04:00:39.807393+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:00:39.807393+0000","last_undegraded":"2023-05-24T04:00:39.807393+0000","last_fullsized":"2023-05-24T04:00:39.807393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:54:25.129357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102591+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:40.102591+0000","last_peered":"2023-05-24T04:00:40.102591+0000","last_clean":"2023-05-24T04:00:40.102591+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:40.102591+0000","last_undegraded":"2023-05-24T04:00:40.102591+0000","last_fullsized":"2023-05-24T04:00:40.102591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:16.625550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102270+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102270+0000","last_peered":"2023-05-24T04:00:40.102270+0000","last_clean":"2023-05-24T04:00:40.102270+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102270+0000","last_undegraded":"2023-05-24T04:00:40.102270+0000","last_fullsized":"2023-05-24T04:00:40.102270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:59.527296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100090+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:40.100090+0000","last_peered":"2023-05-24T04:00:40.100090+0000","last_clean":"2023-05-24T04:00:40.100090+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:40.100090+0000","last_undegraded":"2023-05-24T04:00:40.100090+0000","last_fullsized":"2023-05-24T04:00:40.100090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:22:26.258563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811649+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:39.811649+0000","last_peered":"2023-05-24T04:00:39.811649+0000","last_clean":"2023-05-24T04:00:39.811649+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:39.811649+0000","last_undegraded":"2023-05-24T04:00:39.811649+0000","last_fullsized":"2023-05-24T04:00:39.811649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810652+0000","last_change":"2023-05-24T03:59:57.547999+0000","last_active":"2023-05-24T04:00:39.810652+0000","last_peered":"2023-05-24T04:00:39.810652+0000","last_clean":"2023-05-24T04:00:39.810652+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:00:39.810652+0000","last_undegraded":"2023-05-24T04:00:39.810652+0000","last_fullsized":"2023-05-24T04:00:39.810652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:35.507344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102742+0000","last_change":"2023-05-24T03:59:57.940898+0000","last_active":"2023-05-24T04:00:40.102742+0000","last_peered":"2023-05-24T04:00:40.102742+0000","last_clean":"2023-05-24T04:00:40.102742+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:00:40.102742+0000","last_undegraded":"2023-05-24T04:00:40.102742+0000","last_fullsized":"2023-05-24T04:00:40.102742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100738+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:40.100738+0000","last_peered":"2023-05-24T04:00:40.100738+0000","last_clean":"2023-05-24T04:00:40.100738+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:40.100738+0000","last_undegraded":"2023-05-24T04:00:40.100738+0000","last_fullsized":"2023-05-24T04:00:40.100738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:51.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099965+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:40.099965+0000","last_peered":"2023-05-24T04:00:40.099965+0000","last_clean":"2023-05-24T04:00:40.099965+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:40.099965+0000","last_undegraded":"2023-05-24T04:00:40.099965+0000","last_fullsized":"2023-05-24T04:00:40.099965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:28.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101072+0000","last_change":"2023-05-24T03:59:57.937618+0000","last_active":"2023-05-24T04:00:40.101072+0000","last_peered":"2023-05-24T04:00:40.101072+0000","last_clean":"2023-05-24T04:00:40.101072+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:00:40.101072+0000","last_undegraded":"2023-05-24T04:00:40.101072+0000","last_fullsized":"2023-05-24T04:00:40.101072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:01:59.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102049+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102049+0000","last_peered":"2023-05-24T04:00:40.102049+0000","last_clean":"2023-05-24T04:00:40.102049+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102049+0000","last_undegraded":"2023-05-24T04:00:40.102049+0000","last_fullsized":"2023-05-24T04:00:40.102049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:28.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807099+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:39.807099+0000","last_peered":"2023-05-24T04:00:39.807099+0000","last_clean":"2023-05-24T04:00:39.807099+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:39.807099+0000","last_undegraded":"2023-05-24T04:00:39.807099+0000","last_fullsized":"2023-05-24T04:00:39.807099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:33:02.059045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099273+0000","last_change":"2023-05-24T03:59:57.937633+0000","last_active":"2023-05-24T04:00:40.099273+0000","last_peered":"2023-05-24T04:00:40.099273+0000","last_clean":"2023-05-24T04:00:40.099273+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:00:40.099273+0000","last_undegraded":"2023-05-24T04:00:40.099273+0000","last_fullsized":"2023-05-24T04:00:40.099273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:19:29.954233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809456+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:39.809456+0000","last_peered":"2023-05-24T04:00:39.809456+0000","last_clean":"2023-05-24T04:00:39.809456+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:39.809456+0000","last_undegraded":"2023-05-24T04:00:39.809456+0000","last_fullsized":"2023-05-24T04:00:39.809456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:48.519772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100215+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:40.100215+0000","last_peered":"2023-05-24T04:00:40.100215+0000","last_clean":"2023-05-24T04:00:40.100215+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:40.100215+0000","last_undegraded":"2023-05-24T04:00:40.100215+0000","last_fullsized":"2023-05-24T04:00:40.100215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:48.368318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102380+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:40.102380+0000","last_peered":"2023-05-24T04:00:40.102380+0000","last_clean":"2023-05-24T04:00:40.102380+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:40.102380+0000","last_undegraded":"2023-05-24T04:00:40.102380+0000","last_fullsized":"2023-05-24T04:00:40.102380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:08:23.587331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102517+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:40.102517+0000","last_peered":"2023-05-24T04:00:40.102517+0000","last_clean":"2023-05-24T04:00:40.102517+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:40.102517+0000","last_undegraded":"2023-05-24T04:00:40.102517+0000","last_fullsized":"2023-05-24T04:00:40.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103708+0000","last_change":"2023-05-24T03:59:57.935531+0000","last_active":"2023-05-24T04:00:40.103708+0000","last_peered":"2023-05-24T04:00:40.103708+0000","last_clean":"2023-05-24T04:00:40.103708+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:00:40.103708+0000","last_undegraded":"2023-05-24T04:00:40.103708+0000","last_fullsized":"2023-05-24T04:00:40.103708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103303+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:40.103303+0000","last_peered":"2023-05-24T04:00:40.103303+0000","last_clean":"2023-05-24T04:00:40.103303+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:40.103303+0000","last_undegraded":"2023-05-24T04:00:40.103303+0000","last_fullsized":"2023-05-24T04:00:40.103303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098609+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:40.098609+0000","last_peered":"2023-05-24T04:00:40.098609+0000","last_clean":"2023-05-24T04:00:40.098609+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:40.098609+0000","last_undegraded":"2023-05-24T04:00:40.098609+0000","last_fullsized":"2023-05-24T04:00:40.098609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:44:58.307422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099080+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:40.099080+0000","last_peered":"2023-05-24T04:00:40.099080+0000","last_clean":"2023-05-24T04:00:40.099080+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:40.099080+0000","last_undegraded":"2023-05-24T04:00:40.099080+0000","last_fullsized":"2023-05-24T04:00:40.099080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810553+0000","last_change":"2023-05-24T03:59:57.936938+0000","last_active":"2023-05-24T04:00:39.810553+0000","last_peered":"2023-05-24T04:00:39.810553+0000","last_clean":"2023-05-24T04:00:39.810553+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:00:39.810553+0000","last_undegraded":"2023-05-24T04:00:39.810553+0000","last_fullsized":"2023-05-24T04:00:39.810553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:01:43.464739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099745+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:40.099745+0000","last_peered":"2023-05-24T04:00:40.099745+0000","last_clean":"2023-05-24T04:00:40.099745+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:40.099745+0000","last_undegraded":"2023-05-24T04:00:40.099745+0000","last_fullsized":"2023-05-24T04:00:40.099745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:07:24.825163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810343+0000","last_change":"2023-05-24T03:59:57.934244+0000","last_active":"2023-05-24T04:00:39.810343+0000","last_peered":"2023-05-24T04:00:39.810343+0000","last_clean":"2023-05-24T04:00:39.810343+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:00:39.810343+0000","last_undegraded":"2023-05-24T04:00:39.810343+0000","last_fullsized":"2023-05-24T04:00:39.810343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:40:56.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806510+0000","last_change":"2023-05-24T03:59:57.917069+0000","last_active":"2023-05-24T04:00:39.806510+0000","last_peered":"2023-05-24T04:00:39.806510+0000","last_clean":"2023-05-24T04:00:39.806510+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:00:39.806510+0000","last_undegraded":"2023-05-24T04:00:39.806510+0000","last_fullsized":"2023-05-24T04:00:39.806510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:25.267401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811625+0000","last_change":"2023-05-24T03:59:57.923789+0000","last_active":"2023-05-24T04:00:39.811625+0000","last_peered":"2023-05-24T04:00:39.811625+0000","last_clean":"2023-05-24T04:00:39.811625+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:00:39.811625+0000","last_undegraded":"2023-05-24T04:00:39.811625+0000","last_fullsized":"2023-05-24T04:00:39.811625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:00:33.695719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811728+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:39.811728+0000","last_peered":"2023-05-24T04:00:39.811728+0000","last_clean":"2023-05-24T04:00:39.811728+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:39.811728+0000","last_undegraded":"2023-05-24T04:00:39.811728+0000","last_fullsized":"2023-05-24T04:00:39.811728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808246+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:39.808246+0000","last_peered":"2023-05-24T04:00:39.808246+0000","last_clean":"2023-05-24T04:00:39.808246+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:39.808246+0000","last_undegraded":"2023-05-24T04:00:39.808246+0000","last_fullsized":"2023-05-24T04:00:39.808246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:53:24.077758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099764+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:40.099764+0000","last_peered":"2023-05-24T04:00:40.099764+0000","last_clean":"2023-05-24T04:00:40.099764+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:40.099764+0000","last_undegraded":"2023-05-24T04:00:40.099764+0000","last_fullsized":"2023-05-24T04:00:40.099764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:44:32.124308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099726+0000","last_change":"2023-05-24T03:59:57.929690+0000","last_active":"2023-05-24T04:00:40.099726+0000","last_peered":"2023-05-24T04:00:40.099726+0000","last_clean":"2023-05-24T04:00:40.099726+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:00:40.099726+0000","last_undegraded":"2023-05-24T04:00:40.099726+0000","last_fullsized":"2023-05-24T04:00:40.099726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:01.131044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805582+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:39.805582+0000","last_peered":"2023-05-24T04:00:39.805582+0000","last_clean":"2023-05-24T04:00:39.805582+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:39.805582+0000","last_undegraded":"2023-05-24T04:00:39.805582+0000","last_fullsized":"2023-05-24T04:00:39.805582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:39.556891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806045+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:39.806045+0000","last_peered":"2023-05-24T04:00:39.806045+0000","last_clean":"2023-05-24T04:00:39.806045+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:39.806045+0000","last_undegraded":"2023-05-24T04:00:39.806045+0000","last_fullsized":"2023-05-24T04:00:39.806045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:08.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811204+0000","last_change":"2023-05-24T03:59:57.939399+0000","last_active":"2023-05-24T04:00:39.811204+0000","last_peered":"2023-05-24T04:00:39.811204+0000","last_clean":"2023-05-24T04:00:39.811204+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:00:39.811204+0000","last_undegraded":"2023-05-24T04:00:39.811204+0000","last_fullsized":"2023-05-24T04:00:39.811204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:17:13.115171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103332+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:40.103332+0000","last_peered":"2023-05-24T04:00:40.103332+0000","last_clean":"2023-05-24T04:00:40.103332+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:40.103332+0000","last_undegraded":"2023-05-24T04:00:40.103332+0000","last_fullsized":"2023-05-24T04:00:40.103332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:47:16.171192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811397+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:39.811397+0000","last_peered":"2023-05-24T04:00:39.811397+0000","last_clean":"2023-05-24T04:00:39.811397+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:39.811397+0000","last_undegraded":"2023-05-24T04:00:39.811397+0000","last_fullsized":"2023-05-24T04:00:39.811397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:45.851633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100566+0000","last_change":"2023-05-24T03:59:57.930025+0000","last_active":"2023-05-24T04:00:40.100566+0000","last_peered":"2023-05-24T04:00:40.100566+0000","last_clean":"2023-05-24T04:00:40.100566+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:00:40.100566+0000","last_undegraded":"2023-05-24T04:00:40.100566+0000","last_fullsized":"2023-05-24T04:00:40.100566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:38.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099443+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:40.099443+0000","last_peered":"2023-05-24T04:00:40.099443+0000","last_clean":"2023-05-24T04:00:40.099443+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:40.099443+0000","last_undegraded":"2023-05-24T04:00:40.099443+0000","last_fullsized":"2023-05-24T04:00:40.099443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:55.572575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807440+0000","last_change":"2023-05-24T03:59:57.923052+0000","last_active":"2023-05-24T04:00:39.807440+0000","last_peered":"2023-05-24T04:00:39.807440+0000","last_clean":"2023-05-24T04:00:39.807440+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:00:39.807440+0000","last_undegraded":"2023-05-24T04:00:39.807440+0000","last_fullsized":"2023-05-24T04:00:39.807440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:55:03.048298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.816564+0000","last_change":"2023-05-24T04:00:39.816564+0000","last_active":"2023-05-24T04:00:39.816564+0000","last_peered":"2023-05-24T04:00:39.816564+0000","last_clean":"2023-05-24T04:00:39.816564+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:00:39.816564+0000","last_undegraded":"2023-05-24T04:00:39.816564+0000","last_fullsized":"2023-05-24T04:00:39.816564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:21:46.901700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809247+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:39.809247+0000","last_peered":"2023-05-24T04:00:39.809247+0000","last_clean":"2023-05-24T04:00:39.809247+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:39.809247+0000","last_undegraded":"2023-05-24T04:00:39.809247+0000","last_fullsized":"2023-05-24T04:00:39.809247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:33:29.518758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810954+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:39.810954+0000","last_peered":"2023-05-24T04:00:39.810954+0000","last_clean":"2023-05-24T04:00:39.810954+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:39.810954+0000","last_undegraded":"2023-05-24T04:00:39.810954+0000","last_fullsized":"2023-05-24T04:00:39.810954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:30:14.563105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102982+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:40.102982+0000","last_peered":"2023-05-24T04:00:40.102982+0000","last_clean":"2023-05-24T04:00:40.102982+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:40.102982+0000","last_undegraded":"2023-05-24T04:00:40.102982+0000","last_fullsized":"2023-05-24T04:00:40.102982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:46.157393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807362+0000","last_change":"2023-05-24T03:59:57.911514+0000","last_active":"2023-05-24T04:00:39.807362+0000","last_peered":"2023-05-24T04:00:39.807362+0000","last_clean":"2023-05-24T04:00:39.807362+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:00:39.807362+0000","last_undegraded":"2023-05-24T04:00:39.807362+0000","last_fullsized":"2023-05-24T04:00:39.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:04:23.534539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6382,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.86199999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.054}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.071}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98399999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.028}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.167}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.502},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1000000000000001}]},{"osd":2,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.022}]},{"osd":3,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.68600000000000005}]},{"osd":4,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.212},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0569999999999999}]},{"osd":5,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.369},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.202},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.748}]},{"osd":1,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.105}]},{"osd":3,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.343},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.0569999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.4299999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.145},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.304}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.999}]},{"osd":3,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1870000000000001}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.038}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.206}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.155},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.284}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.35899999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.432},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.375},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.78000000000000003}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.83999999999999997}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.91100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.78600000000000003}]},{"osd":7,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.83499999999999996}]},{"osd":2,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.68200000000000005}]},{"osd":3,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.2110000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.04},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.117}]},{"osd":7,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.286},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88700000000000001}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.272},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.95899999999999996}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.83999999999999997}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.079}]},{"osd":7,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:01:21.365 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.365 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.366 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.366 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.366 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.367 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.367 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.367 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.368 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.368 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.368 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.369 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.369 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.369 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.370 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.370 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.370 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.371 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.371 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.371 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.371 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.372 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.372 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.372 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.373 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.373 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.373 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.373 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.374 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.374 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.375 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.375 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.375 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.376 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.376 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.376 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.377 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.377 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.377 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.377 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.378 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.378 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.379 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.379 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.379 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.379 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.380 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.380 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.380 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.381 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.381 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.381 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.382 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.382 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.382 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.382 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.383 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.383 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.384 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.384 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.384 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.385 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.385 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.386 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.386 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.387 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.388 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.388 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-05-24T03:59:46.733500+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=46, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.389 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.389 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.390 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.391 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.391 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.392 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.393 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.393 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.394 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.394 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.395 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.395 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.396 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.396 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.397 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.397 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.398 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.398 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.398 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.399 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.399 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.399 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.399 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.400 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.400 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.400 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.401 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.401 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.401 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.402 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.402 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.402 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.402 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.403 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.403 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.403 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.404 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.404 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.404 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.405 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.405 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.405 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.405 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.406 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.406 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.406 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.407 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.407 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.407 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.408 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.408 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.408 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.408 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.409 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.409 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.409 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.410 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.410 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.410 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.411 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.411 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.411 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.411 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.412 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.412 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.412 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.413 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.413 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.413 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:21.414 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T04:01:22.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:22.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:22.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:22.615 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:22.617 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:41.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:01:41.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 Processor -- start 2023-05-24T04:01:41.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 -- start start 2023-05-24T04:01:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7b81523c0 0x7fd7b806bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7b8156c10 0x7fd7b80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b80a56b0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80a4ae0 con 0x7fd7b8156c10 2023-05-24T04:01:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bf53a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b8153ad0 con 0x7fd7b81523c0 2023-05-24T04:01:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bcad5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7b8156c10 0x7fd7b80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bdad7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd7b80a37c0 0x7fd7b81533c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37802/0 (socket says 172.21.15.40:37802) 2023-05-24T04:01:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bcad5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7b8156c10 0x7fd7b80a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39636/0 (socket says 172.21.15.40:39636) 2023-05-24T04:01:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bdad7640 1 -- 172.21.15.40:0/836718248 learned_addr learned my addr 172.21.15.40:0/836718248 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:01:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bd2d6640 1 --2- 172.21.15.40:0/836718248 >> v2:172.21.15.67:3300/0 conn(0x7fd7b81523c0 0x7fd7b806bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bcad5640 1 -- 172.21.15.40:0/836718248 >> v2:172.21.15.67:3300/0 conn(0x7fd7b81523c0 msgr2=0x7fd7b806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:01:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bcad5640 1 --2- 172.21.15.40:0/836718248 >> v2:172.21.15.67:3300/0 conn(0x7fd7b81523c0 0x7fd7b806bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bcad5640 1 -- 172.21.15.40:0/836718248 >> v1:172.21.15.40:6789/0 conn(0x7fd7b80a37c0 legacy=0x7fd7b81533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:41.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7affff640 1 -- 172.21.15.40:0/836718248 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790027814 0 0) 0x7fd7b80a56b0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bcad5640 1 -- 172.21.15.40:0/836718248 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b8152790 con 0x7fd7b8156c10 2023-05-24T04:01:41.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.541+0000 7fd7bd2d6640 1 --2- 172.21.15.40:0/836718248 >> v2:172.21.15.67:3300/0 conn(0x7fd7b81523c0 0x7fd7b806bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:01:41.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bcad5640 1 --2- 172.21.15.40:0/836718248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b8156c10 0x7fd7b80a5170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80665a0 tx=0x7fd7b401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290e60e9b9c02d68 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:41.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7affff640 1 -- 172.21.15.40:0/836718248 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40ab600 con 0x7fd7b8156c10 2023-05-24T04:01:41.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7affff640 1 -- 172.21.15.40:0/836718248 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b40a7050 con 0x7fd7b8156c10 2023-05-24T04:01:41.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7affff640 1 -- 172.21.15.40:0/836718248 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40ab980 con 0x7fd7b8156c10 2023-05-24T04:01:41.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- 172.21.15.40:0/836718248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b8156c10 msgr2=0x7fd7b80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:41.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/836718248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b8156c10 0x7fd7b80a5170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80665a0 tx=0x7fd7b401c3a0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- 172.21.15.40:0/836718248 shutdown_connections 2023-05-24T04:01:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/836718248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b8156c10 0x7fd7b80a5170 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/836718248 >> v2:172.21.15.67:3300/0 conn(0x7fd7b81523c0 0x7fd7b806bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- 172.21.15.40:0/836718248 >> 172.21.15.40:0/836718248 conn(0x7fd7b80c0280 msgr2=0x7fd7b80c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- 172.21.15.40:0/836718248 shutdown_connections 2023-05-24T04:01:41.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- 172.21.15.40:0/836718248 wait complete. 2023-05-24T04:01:41.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 Processor -- start 2023-05-24T04:01:41.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- start start 2023-05-24T04:01:41.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 0x7fd7b806fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:41.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b81523c0 0x7fd7b81edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:41.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b8156c10 0x7fd7b81ee130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:41.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b814f3e0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b814f090 con 0x7fd7b81523c0 2023-05-24T04:01:41.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bf53a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8070130 con 0x7fd7b8156c10 2023-05-24T04:01:41.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 0x7fd7b806fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:41.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 0x7fd7b806fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39652/0 (socket says 172.21.15.40:39652) 2023-05-24T04:01:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 -- 172.21.15.40:0/44171508 learned_addr learned my addr 172.21.15.40:0/44171508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:01:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bcad5640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b81523c0 0x7fd7b81edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bdad7640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b8156c10 0x7fd7b81ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 -- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b8156c10 msgr2=0x7fd7b81ee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b8156c10 0x7fd7b81ee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 -- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b81523c0 msgr2=0x7fd7b81edbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.545+0000 7fd7bd2d6640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b81523c0 0x7fd7b81edbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bd2d6640 1 -- 172.21.15.40:0/44171508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009420 con 0x7fd7b80a37c0 2023-05-24T04:01:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bcad5640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b81523c0 0x7fd7b81edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:01:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bd2d6640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 0x7fd7b806fbf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800c7f0 tx=0x7fd7a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800cea0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a8007a30 con 0x7fd7b80a37c0 2023-05-24T04:01:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b815f3e0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8007de0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b815f250 con 0x7fd7b80a37c0 2023-05-24T04:01:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b815f570 con 0x7fd7b80a37c0 2023-05-24T04:01:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7a80113f0 con 0x7fd7b80a37c0 2023-05-24T04:01:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7adffb640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd79c066280 0x7fd79c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:01:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bcad5640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd79c066280 0x7fd79c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:01:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7a8084130 con 0x7fd7b80a37c0 2023-05-24T04:01:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.549+0000 7fd7bcad5640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd79c066280 0x7fd79c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40ad000 tx=0x7fd7b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:01:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.553+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd7a8051310 con 0x7fd7b80a37c0 2023-05-24T04:01:41.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.705+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7b81ea6c0 con 0x7fd79c066280 2023-05-24T04:01:41.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.721+0000 7fd7adffb640 1 -- 172.21.15.40:0/44171508 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+387285 (secure 0 0 0) 0x7fd7b81ea6c0 con 0x7fd79c066280 2023-05-24T04:01:41.733 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:01:41.737 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:01:41.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd79c066280 msgr2=0x7fd79c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:41.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd79c066280 0x7fd79c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40ad000 tx=0x7fd7b4008040 comp rx=0 tx=0).stop 2023-05-24T04:01:41.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 msgr2=0x7fd7b806fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:01:41.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 0x7fd7b806fbf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800c7f0 tx=0x7fd7a800ccb0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 shutdown_connections 2023-05-24T04:01:41.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fd79c066280 0x7fd79c068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b8156c10 0x7fd7b81ee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b81523c0 0x7fd7b81edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 --2- 172.21.15.40:0/44171508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b80a37c0 0x7fd7b806fbf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:01:41.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 >> 172.21.15.40:0/44171508 conn(0x7fd7b80c0280 msgr2=0x7fd7b814dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:01:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 shutdown_connections 2023-05-24T04:01:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:01:41.725+0000 7fd7bf53a640 1 -- 172.21.15.40:0/44171508 wait complete. 2023-05-24T04:01:41.749 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-05-24T04:01:40.559299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596750,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005499"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098252+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:40.098252+0000","last_peered":"2023-05-24T04:00:40.098252+0000","last_clean":"2023-05-24T04:00:40.098252+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:40.098252+0000","last_undegraded":"2023-05-24T04:00:40.098252+0000","last_fullsized":"2023-05-24T04:00:40.098252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.473614+0000","last_change":"2023-05-24T04:01:29.473721+0000","last_active":"2023-05-24T04:01:29.473614+0000","last_peered":"2023-05-24T04:01:29.473614+0000","last_clean":"2023-05-24T04:01:29.473614+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:01:29.473614+0000","last_undegraded":"2023-05-24T04:01:29.473614+0000","last_fullsized":"2023-05-24T04:01:29.473614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.473421+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:39.840985+0000","scrub_duration":0.0082611170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808728+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808728+0000","last_peered":"2023-05-24T04:00:39.808728+0000","last_clean":"2023-05-24T04:00:39.808728+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808728+0000","last_undegraded":"2023-05-24T04:00:39.808728+0000","last_fullsized":"2023-05-24T04:00:39.808728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807833+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807833+0000","last_peered":"2023-05-24T04:00:39.807833+0000","last_clean":"2023-05-24T04:00:39.807833+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807833+0000","last_undegraded":"2023-05-24T04:00:39.807833+0000","last_fullsized":"2023-05-24T04:00:39.807833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101664+0000","last_change":"2023-05-24T03:59:57.538254+0000","last_active":"2023-05-24T04:00:40.101664+0000","last_peered":"2023-05-24T04:00:40.101664+0000","last_clean":"2023-05-24T04:00:40.101664+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:00:40.101664+0000","last_undegraded":"2023-05-24T04:00:40.101664+0000","last_fullsized":"2023-05-24T04:00:40.101664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.568929+0000","last_change":"2023-05-24T04:01:24.569026+0000","last_active":"2023-05-24T04:01:24.568929+0000","last_peered":"2023-05-24T04:01:24.568929+0000","last_clean":"2023-05-24T04:01:24.568929+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:01:24.568929+0000","last_undegraded":"2023-05-24T04:01:24.568929+0000","last_fullsized":"2023-05-24T04:01:24.568929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.568716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:27.628807+0000","scrub_duration":0.0033214799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101720+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101720+0000","last_peered":"2023-05-24T04:00:40.101720+0000","last_clean":"2023-05-24T04:00:40.101720+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101720+0000","last_undegraded":"2023-05-24T04:00:40.101720+0000","last_fullsized":"2023-05-24T04:00:40.101720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103005+0000","last_change":"2023-05-24T03:59:57.569141+0000","last_active":"2023-05-24T04:00:40.103005+0000","last_peered":"2023-05-24T04:00:40.103005+0000","last_clean":"2023-05-24T04:00:40.103005+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:00:40.103005+0000","last_undegraded":"2023-05-24T04:00:40.103005+0000","last_fullsized":"2023-05-24T04:00:40.103005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809161+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:39.809161+0000","last_peered":"2023-05-24T04:00:39.809161+0000","last_clean":"2023-05-24T04:00:39.809161+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:39.809161+0000","last_undegraded":"2023-05-24T04:00:39.809161+0000","last_fullsized":"2023-05-24T04:00:39.809161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099334+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099334+0000","last_peered":"2023-05-24T04:00:40.099334+0000","last_clean":"2023-05-24T04:00:40.099334+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099334+0000","last_undegraded":"2023-05-24T04:00:40.099334+0000","last_fullsized":"2023-05-24T04:00:40.099334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102017+0000","last_change":"2023-05-24T03:59:57.566215+0000","last_active":"2023-05-24T04:00:40.102017+0000","last_peered":"2023-05-24T04:00:40.102017+0000","last_clean":"2023-05-24T04:00:40.102017+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:00:40.102017+0000","last_undegraded":"2023-05-24T04:00:40.102017+0000","last_fullsized":"2023-05-24T04:00:40.102017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809852+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:39.809852+0000","last_peered":"2023-05-24T04:00:39.809852+0000","last_clean":"2023-05-24T04:00:39.809852+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:39.809852+0000","last_undegraded":"2023-05-24T04:00:39.809852+0000","last_fullsized":"2023-05-24T04:00:39.809852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102412+0000","last_change":"2023-05-24T04:00:01.979074+0000","last_active":"2023-05-24T04:00:40.102412+0000","last_peered":"2023-05-24T04:00:40.102412+0000","last_clean":"2023-05-24T04:00:40.102412+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:00:40.102412+0000","last_undegraded":"2023-05-24T04:00:40.102412+0000","last_fullsized":"2023-05-24T04:00:40.102412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.542381+0000","last_change":"2023-05-24T04:01:22.542492+0000","last_active":"2023-05-24T04:01:22.542381+0000","last_peered":"2023-05-24T04:01:22.542381+0000","last_clean":"2023-05-24T04:01:22.542381+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:01:22.542381+0000","last_undegraded":"2023-05-24T04:01:22.542381+0000","last_fullsized":"2023-05-24T04:01:22.542381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.542168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:13.410065+0000","scrub_duration":0.003819444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806198+0000","last_change":"2023-05-24T03:59:57.938909+0000","last_active":"2023-05-24T04:00:39.806198+0000","last_peered":"2023-05-24T04:00:39.806198+0000","last_clean":"2023-05-24T04:00:39.806198+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:00:39.806198+0000","last_undegraded":"2023-05-24T04:00:39.806198+0000","last_fullsized":"2023-05-24T04:00:39.806198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810269+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810269+0000","last_peered":"2023-05-24T04:00:39.810269+0000","last_clean":"2023-05-24T04:00:39.810269+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810269+0000","last_undegraded":"2023-05-24T04:00:39.810269+0000","last_fullsized":"2023-05-24T04:00:39.810269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.210580+0000","last_change":"2023-05-24T04:01:36.210680+0000","last_active":"2023-05-24T04:01:36.210580+0000","last_peered":"2023-05-24T04:01:36.210580+0000","last_clean":"2023-05-24T04:01:36.210580+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:01:36.210580+0000","last_undegraded":"2023-05-24T04:01:36.210580+0000","last_fullsized":"2023-05-24T04:01:36.210580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.210367+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:19.478523+0000","scrub_duration":0.003865659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101745+0000","last_change":"2023-05-24T03:59:57.936005+0000","last_active":"2023-05-24T04:00:40.101745+0000","last_peered":"2023-05-24T04:00:40.101745+0000","last_clean":"2023-05-24T04:00:40.101745+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:00:40.101745+0000","last_undegraded":"2023-05-24T04:00:40.101745+0000","last_fullsized":"2023-05-24T04:00:40.101745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812174+0000","last_change":"2023-05-24T04:00:01.987354+0000","last_active":"2023-05-24T04:00:39.812174+0000","last_peered":"2023-05-24T04:00:39.812174+0000","last_clean":"2023-05-24T04:00:39.812174+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:00:39.812174+0000","last_undegraded":"2023-05-24T04:00:39.812174+0000","last_fullsized":"2023-05-24T04:00:39.812174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.702301+0000","last_change":"2023-05-24T04:01:29.702398+0000","last_active":"2023-05-24T04:01:29.702301+0000","last_peered":"2023-05-24T04:01:29.702301+0000","last_clean":"2023-05-24T04:01:29.702301+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:01:29.702301+0000","last_undegraded":"2023-05-24T04:01:29.702301+0000","last_fullsized":"2023-05-24T04:01:29.702301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.702108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:20.570006+0000","scrub_duration":0.0033797469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811312+0000","last_change":"2023-05-24T03:59:57.922820+0000","last_active":"2023-05-24T04:00:39.811312+0000","last_peered":"2023-05-24T04:00:39.811312+0000","last_clean":"2023-05-24T04:00:39.811312+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:00:39.811312+0000","last_undegraded":"2023-05-24T04:00:39.811312+0000","last_fullsized":"2023-05-24T04:00:39.811312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811323+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:39.811323+0000","last_peered":"2023-05-24T04:00:39.811323+0000","last_clean":"2023-05-24T04:00:39.811323+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:39.811323+0000","last_undegraded":"2023-05-24T04:00:39.811323+0000","last_fullsized":"2023-05-24T04:00:39.811323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:33.580827+0000","last_change":"2023-05-24T04:01:33.580913+0000","last_active":"2023-05-24T04:01:33.580827+0000","last_peered":"2023-05-24T04:01:33.580827+0000","last_clean":"2023-05-24T04:01:33.580827+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:01:33.580827+0000","last_undegraded":"2023-05-24T04:01:33.580827+0000","last_fullsized":"2023-05-24T04:01:33.580827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_clean_scrub_stamp":"2023-05-24T04:01:33.580634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:32.719267+0000","scrub_duration":0.0034014739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.701421+0000","last_change":"2023-05-24T04:01:32.701508+0000","last_active":"2023-05-24T04:01:32.701421+0000","last_peered":"2023-05-24T04:01:32.701421+0000","last_clean":"2023-05-24T04:01:32.701421+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:01:32.701421+0000","last_undegraded":"2023-05-24T04:01:32.701421+0000","last_fullsized":"2023-05-24T04:01:32.701421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.701223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:00:56.829588+0000","scrub_duration":0.0032971739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098790+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:40.098790+0000","last_peered":"2023-05-24T04:00:40.098790+0000","last_clean":"2023-05-24T04:00:40.098790+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:40.098790+0000","last_undegraded":"2023-05-24T04:00:40.098790+0000","last_fullsized":"2023-05-24T04:00:40.098790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:31.399044+0000","last_change":"2023-05-24T04:01:31.399136+0000","last_active":"2023-05-24T04:01:31.399044+0000","last_peered":"2023-05-24T04:01:31.399044+0000","last_clean":"2023-05-24T04:01:31.399044+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:01:31.399044+0000","last_undegraded":"2023-05-24T04:01:31.399044+0000","last_fullsized":"2023-05-24T04:01:31.399044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_clean_scrub_stamp":"2023-05-24T04:01:31.398830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:05.007835+0000","scrub_duration":0.0036452780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808945+0000","last_change":"2023-05-24T04:00:01.987956+0000","last_active":"2023-05-24T04:00:39.808945+0000","last_peered":"2023-05-24T04:00:39.808945+0000","last_clean":"2023-05-24T04:00:39.808945+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:00:39.808945+0000","last_undegraded":"2023-05-24T04:00:39.808945+0000","last_fullsized":"2023-05-24T04:00:39.808945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.623427+0000","last_change":"2023-05-24T04:01:20.623465+0000","last_active":"2023-05-24T04:01:20.623427+0000","last_peered":"2023-05-24T04:01:20.623427+0000","last_clean":"2023-05-24T04:01:20.623427+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:01:20.623427+0000","last_undegraded":"2023-05-24T04:01:20.623427+0000","last_fullsized":"2023-05-24T04:01:20.623427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.623341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:43.367125+0000","scrub_duration":0.0026911190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103349+0000","last_change":"2023-05-24T03:59:57.550517+0000","last_active":"2023-05-24T04:00:40.103349+0000","last_peered":"2023-05-24T04:00:40.103349+0000","last_clean":"2023-05-24T04:00:40.103349+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:00:40.103349+0000","last_undegraded":"2023-05-24T04:00:40.103349+0000","last_fullsized":"2023-05-24T04:00:40.103349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098375+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:40.098375+0000","last_peered":"2023-05-24T04:00:40.098375+0000","last_clean":"2023-05-24T04:00:40.098375+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:40.098375+0000","last_undegraded":"2023-05-24T04:00:40.098375+0000","last_fullsized":"2023-05-24T04:00:40.098375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100690+0000","last_change":"2023-05-24T03:59:57.548585+0000","last_active":"2023-05-24T04:00:40.100690+0000","last_peered":"2023-05-24T04:00:40.100690+0000","last_clean":"2023-05-24T04:00:40.100690+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:00:40.100690+0000","last_undegraded":"2023-05-24T04:00:40.100690+0000","last_fullsized":"2023-05-24T04:00:40.100690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100608+0000","last_change":"2023-05-24T03:59:57.933698+0000","last_active":"2023-05-24T04:00:40.100608+0000","last_peered":"2023-05-24T04:00:40.100608+0000","last_clean":"2023-05-24T04:00:40.100608+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:00:40.100608+0000","last_undegraded":"2023-05-24T04:00:40.100608+0000","last_fullsized":"2023-05-24T04:00:40.100608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099786+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099786+0000","last_peered":"2023-05-24T04:00:40.099786+0000","last_clean":"2023-05-24T04:00:40.099786+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099786+0000","last_undegraded":"2023-05-24T04:00:40.099786+0000","last_fullsized":"2023-05-24T04:00:40.099786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:13.887773+0000","last_change":"2023-05-24T03:59:57.558626+0000","last_active":"2023-05-24T04:01:13.887773+0000","last_peered":"2023-05-24T04:01:13.887773+0000","last_clean":"2023-05-24T04:01:13.887773+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:01:13.887773+0000","last_undegraded":"2023-05-24T04:01:13.887773+0000","last_fullsized":"2023-05-24T04:01:13.887773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.193685+0000","last_change":"2023-05-24T04:01:23.193776+0000","last_active":"2023-05-24T04:01:23.193685+0000","last_peered":"2023-05-24T04:01:23.193685+0000","last_clean":"2023-05-24T04:01:23.193685+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:01:23.193685+0000","last_undegraded":"2023-05-24T04:01:23.193685+0000","last_fullsized":"2023-05-24T04:01:23.193685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.193479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:14.734145+0000","scrub_duration":0.0035797390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099802+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:40.099802+0000","last_peered":"2023-05-24T04:00:40.099802+0000","last_clean":"2023-05-24T04:00:40.099802+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:40.099802+0000","last_undegraded":"2023-05-24T04:00:40.099802+0000","last_fullsized":"2023-05-24T04:00:40.099802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.190969+0000","last_change":"2023-05-24T04:01:25.191060+0000","last_active":"2023-05-24T04:01:25.190969+0000","last_peered":"2023-05-24T04:01:25.190969+0000","last_clean":"2023-05-24T04:01:25.190969+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:01:25.190969+0000","last_undegraded":"2023-05-24T04:01:25.190969+0000","last_fullsized":"2023-05-24T04:01:25.190969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.190751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:03.676839+0000","scrub_duration":0.0032725419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.589652+0000","last_change":"2023-05-24T04:01:22.589749+0000","last_active":"2023-05-24T04:01:22.589652+0000","last_peered":"2023-05-24T04:01:22.589652+0000","last_clean":"2023-05-24T04:01:22.589652+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:01:22.589652+0000","last_undegraded":"2023-05-24T04:01:22.589652+0000","last_fullsized":"2023-05-24T04:01:22.589652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.589468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:45:57.220840+0000","scrub_duration":0.0034413989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.443104+0000","last_change":"2023-05-24T04:01:35.443206+0000","last_active":"2023-05-24T04:01:35.443104+0000","last_peered":"2023-05-24T04:01:35.443104+0000","last_clean":"2023-05-24T04:01:35.443104+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:01:35.443104+0000","last_undegraded":"2023-05-24T04:01:35.443104+0000","last_fullsized":"2023-05-24T04:01:35.443104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.442898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:31.248990+0000","scrub_duration":0.0067569300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098002+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:40.098002+0000","last_peered":"2023-05-24T04:00:40.098002+0000","last_clean":"2023-05-24T04:00:40.098002+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:40.098002+0000","last_undegraded":"2023-05-24T04:00:40.098002+0000","last_fullsized":"2023-05-24T04:00:40.098002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099042+0000","last_change":"2023-05-24T03:59:57.931499+0000","last_active":"2023-05-24T04:00:40.099042+0000","last_peered":"2023-05-24T04:00:40.099042+0000","last_clean":"2023-05-24T04:00:40.099042+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:00:40.099042+0000","last_undegraded":"2023-05-24T04:00:40.099042+0000","last_fullsized":"2023-05-24T04:00:40.099042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.651626+0000","last_change":"2023-05-24T04:01:20.651747+0000","last_active":"2023-05-24T04:01:20.651626+0000","last_peered":"2023-05-24T04:01:20.651626+0000","last_clean":"2023-05-24T04:01:20.651626+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:01:20.651626+0000","last_undegraded":"2023-05-24T04:01:20.651626+0000","last_fullsized":"2023-05-24T04:01:20.651626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.651438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:36:56.874342+0000","scrub_duration":0.0035848859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102955+0000","last_change":"2023-05-24T03:59:57.549622+0000","last_active":"2023-05-24T04:00:40.102955+0000","last_peered":"2023-05-24T04:00:40.102955+0000","last_clean":"2023-05-24T04:00:40.102955+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:00:40.102955+0000","last_undegraded":"2023-05-24T04:00:40.102955+0000","last_fullsized":"2023-05-24T04:00:40.102955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807639+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:39.807639+0000","last_peered":"2023-05-24T04:00:39.807639+0000","last_clean":"2023-05-24T04:00:39.807639+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:39.807639+0000","last_undegraded":"2023-05-24T04:00:39.807639+0000","last_fullsized":"2023-05-24T04:00:39.807639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.480227+0000","last_change":"2023-05-24T04:01:19.480291+0000","last_active":"2023-05-24T04:01:19.480227+0000","last_peered":"2023-05-24T04:01:19.480227+0000","last_clean":"2023-05-24T04:01:19.480227+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:01:19.480227+0000","last_undegraded":"2023-05-24T04:01:19.480227+0000","last_fullsized":"2023-05-24T04:01:19.480227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.480118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:23.591362+0000","scrub_duration":0.0025500269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101170+0000","last_change":"2023-05-24T03:59:53.622430+0000","last_active":"2023-05-24T04:00:40.101170+0000","last_peered":"2023-05-24T04:00:40.101170+0000","last_clean":"2023-05-24T04:00:40.101170+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:00:40.101170+0000","last_undegraded":"2023-05-24T04:00:40.101170+0000","last_fullsized":"2023-05-24T04:00:40.101170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.699129+0000","last_change":"2023-05-24T04:01:30.699228+0000","last_active":"2023-05-24T04:01:30.699129+0000","last_peered":"2023-05-24T04:01:30.699129+0000","last_clean":"2023-05-24T04:01:30.699129+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:01:30.699129+0000","last_undegraded":"2023-05-24T04:01:30.699129+0000","last_fullsized":"2023-05-24T04:01:30.699129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.698924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:53.442708+0000","scrub_duration":0.0031884679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809712+0000","last_change":"2023-05-24T04:00:01.962884+0000","last_active":"2023-05-24T04:00:39.809712+0000","last_peered":"2023-05-24T04:00:39.809712+0000","last_clean":"2023-05-24T04:00:39.809712+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:00:39.809712+0000","last_undegraded":"2023-05-24T04:00:39.809712+0000","last_fullsized":"2023-05-24T04:00:39.809712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100899+0000","last_change":"2023-05-24T03:59:57.943964+0000","last_active":"2023-05-24T04:00:40.100899+0000","last_peered":"2023-05-24T04:00:40.100899+0000","last_clean":"2023-05-24T04:00:40.100899+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:00:40.100899+0000","last_undegraded":"2023-05-24T04:00:40.100899+0000","last_fullsized":"2023-05-24T04:00:40.100899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.679598+0000","last_change":"2023-05-24T04:01:25.679692+0000","last_active":"2023-05-24T04:01:25.679598+0000","last_peered":"2023-05-24T04:01:25.679598+0000","last_clean":"2023-05-24T04:01:25.679598+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:01:25.679598+0000","last_undegraded":"2023-05-24T04:01:25.679598+0000","last_fullsized":"2023-05-24T04:01:25.679598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.679377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:03.205799+0000","scrub_duration":0.0036885849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103200+0000","last_change":"2023-05-24T03:59:57.549920+0000","last_active":"2023-05-24T04:00:40.103200+0000","last_peered":"2023-05-24T04:00:40.103200+0000","last_clean":"2023-05-24T04:00:40.103200+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:00:40.103200+0000","last_undegraded":"2023-05-24T04:00:40.103200+0000","last_fullsized":"2023-05-24T04:00:40.103200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811309+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:39.811309+0000","last_peered":"2023-05-24T04:00:39.811309+0000","last_clean":"2023-05-24T04:00:39.811309+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:39.811309+0000","last_undegraded":"2023-05-24T04:00:39.811309+0000","last_fullsized":"2023-05-24T04:00:39.811309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101885+0000","last_change":"2023-05-24T03:59:57.933164+0000","last_active":"2023-05-24T04:00:40.101885+0000","last_peered":"2023-05-24T04:00:40.101885+0000","last_clean":"2023-05-24T04:00:40.101885+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:00:40.101885+0000","last_undegraded":"2023-05-24T04:00:40.101885+0000","last_fullsized":"2023-05-24T04:00:40.101885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810170+0000","last_change":"2023-05-24T03:59:57.544299+0000","last_active":"2023-05-24T04:00:39.810170+0000","last_peered":"2023-05-24T04:00:39.810170+0000","last_clean":"2023-05-24T04:00:39.810170+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:00:39.810170+0000","last_undegraded":"2023-05-24T04:00:39.810170+0000","last_fullsized":"2023-05-24T04:00:39.810170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100342+0000","last_change":"2023-05-24T03:59:53.476965+0000","last_active":"2023-05-24T04:00:40.100342+0000","last_peered":"2023-05-24T04:00:40.100342+0000","last_clean":"2023-05-24T04:00:40.100342+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:00:40.100342+0000","last_undegraded":"2023-05-24T04:00:40.100342+0000","last_fullsized":"2023-05-24T04:00:40.100342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811186+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:39.811186+0000","last_peered":"2023-05-24T04:00:39.811186+0000","last_clean":"2023-05-24T04:00:39.811186+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:39.811186+0000","last_undegraded":"2023-05-24T04:00:39.811186+0000","last_fullsized":"2023-05-24T04:00:39.811186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:41.562237+0000","last_change":"2023-05-24T04:00:40.102360+0000","last_active":"2023-05-24T04:00:41.562237+0000","last_peered":"2023-05-24T04:00:41.562237+0000","last_clean":"2023-05-24T04:00:41.562237+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:00:41.562237+0000","last_undegraded":"2023-05-24T04:00:41.562237+0000","last_fullsized":"2023-05-24T04:00:41.562237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.712724+0000","last_change":"2023-05-24T04:01:26.712817+0000","last_active":"2023-05-24T04:01:26.712724+0000","last_peered":"2023-05-24T04:01:26.712724+0000","last_clean":"2023-05-24T04:01:26.712724+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:01:26.712724+0000","last_undegraded":"2023-05-24T04:01:26.712724+0000","last_fullsized":"2023-05-24T04:01:26.712724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.712506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:30.823750+0000","scrub_duration":0.0075320789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.403790+0000","last_change":"2023-05-24T04:01:23.403937+0000","last_active":"2023-05-24T04:01:23.403790+0000","last_peered":"2023-05-24T04:01:23.403790+0000","last_clean":"2023-05-24T04:01:23.403790+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:01:23.403790+0000","last_undegraded":"2023-05-24T04:01:23.403790+0000","last_fullsized":"2023-05-24T04:01:23.403790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.403578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:34:05.102350+0000","scrub_duration":0.003686197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806163+0000","last_change":"2023-05-24T04:00:01.996005+0000","last_active":"2023-05-24T04:00:39.806163+0000","last_peered":"2023-05-24T04:00:39.806163+0000","last_clean":"2023-05-24T04:00:39.806163+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:00:39.806163+0000","last_undegraded":"2023-05-24T04:00:39.806163+0000","last_fullsized":"2023-05-24T04:00:39.806163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811686+0000","last_change":"2023-05-24T03:59:57.936878+0000","last_active":"2023-05-24T04:00:39.811686+0000","last_peered":"2023-05-24T04:00:39.811686+0000","last_clean":"2023-05-24T04:00:39.811686+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:00:39.811686+0000","last_undegraded":"2023-05-24T04:00:39.811686+0000","last_fullsized":"2023-05-24T04:00:39.811686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.426620+0000","last_change":"2023-05-24T04:01:28.426714+0000","last_active":"2023-05-24T04:01:28.426620+0000","last_peered":"2023-05-24T04:01:28.426620+0000","last_clean":"2023-05-24T04:01:28.426620+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:01:28.426620+0000","last_undegraded":"2023-05-24T04:01:28.426620+0000","last_fullsized":"2023-05-24T04:01:28.426620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:31.486492+0000","scrub_duration":0.0036793720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099093+0000","last_change":"2023-05-24T03:59:53.477131+0000","last_active":"2023-05-24T04:00:40.099093+0000","last_peered":"2023-05-24T04:00:40.099093+0000","last_clean":"2023-05-24T04:00:40.099093+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:00:40.099093+0000","last_undegraded":"2023-05-24T04:00:40.099093+0000","last_fullsized":"2023-05-24T04:00:40.099093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103455+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:40.103455+0000","last_peered":"2023-05-24T04:00:40.103455+0000","last_clean":"2023-05-24T04:00:40.103455+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:40.103455+0000","last_undegraded":"2023-05-24T04:00:40.103455+0000","last_fullsized":"2023-05-24T04:00:40.103455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.619238+0000","last_change":"2023-05-24T04:01:30.619338+0000","last_active":"2023-05-24T04:01:30.619238+0000","last_peered":"2023-05-24T04:01:30.619238+0000","last_clean":"2023-05-24T04:01:30.619238+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:01:30.619238+0000","last_undegraded":"2023-05-24T04:01:30.619238+0000","last_fullsized":"2023-05-24T04:01:30.619238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.619015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:36:30.639136+0000","scrub_duration":0.0034554199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100376+0000","last_change":"2023-05-24T03:59:57.543947+0000","last_active":"2023-05-24T04:00:40.100376+0000","last_peered":"2023-05-24T04:00:40.100376+0000","last_clean":"2023-05-24T04:00:40.100376+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:00:40.100376+0000","last_undegraded":"2023-05-24T04:00:40.100376+0000","last_fullsized":"2023-05-24T04:00:40.100376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101962+0000","last_change":"2023-05-24T03:59:53.474495+0000","last_active":"2023-05-24T04:00:40.101962+0000","last_peered":"2023-05-24T04:00:40.101962+0000","last_clean":"2023-05-24T04:00:40.101962+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:00:40.101962+0000","last_undegraded":"2023-05-24T04:00:40.101962+0000","last_fullsized":"2023-05-24T04:00:40.101962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:52.435685+0000","last_clean_scrub_stamp":"2023-05-24T03:59:52.435685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.727218+0000","last_change":"2023-05-24T04:01:32.727356+0000","last_active":"2023-05-24T04:01:32.727218+0000","last_peered":"2023-05-24T04:01:32.727218+0000","last_clean":"2023-05-24T04:01:32.727218+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:01:32.727218+0000","last_undegraded":"2023-05-24T04:01:32.727218+0000","last_fullsized":"2023-05-24T04:01:32.727218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.727017+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:35.787107+0000","scrub_duration":0.013968662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099324+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:40.099324+0000","last_peered":"2023-05-24T04:00:40.099324+0000","last_clean":"2023-05-24T04:00:40.099324+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:40.099324+0000","last_undegraded":"2023-05-24T04:00:40.099324+0000","last_fullsized":"2023-05-24T04:00:40.099324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103570+0000","last_change":"2023-05-24T03:59:57.939742+0000","last_active":"2023-05-24T04:00:40.103570+0000","last_peered":"2023-05-24T04:00:40.103570+0000","last_clean":"2023-05-24T04:00:40.103570+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:00:40.103570+0000","last_undegraded":"2023-05-24T04:00:40.103570+0000","last_fullsized":"2023-05-24T04:00:40.103570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.583003+0000","last_change":"2023-05-24T04:01:32.583136+0000","last_active":"2023-05-24T04:01:32.583003+0000","last_peered":"2023-05-24T04:01:32.583003+0000","last_clean":"2023-05-24T04:01:32.583003+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:01:32.583003+0000","last_undegraded":"2023-05-24T04:01:32.583003+0000","last_fullsized":"2023-05-24T04:01:32.583003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.582758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:28.388850+0000","scrub_duration":0.0033355210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812075+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:39.812075+0000","last_peered":"2023-05-24T04:00:39.812075+0000","last_clean":"2023-05-24T04:00:39.812075+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:39.812075+0000","last_undegraded":"2023-05-24T04:00:39.812075+0000","last_fullsized":"2023-05-24T04:00:39.812075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:21.224023+0000","last_change":"2023-05-24T04:01:21.224114+0000","last_active":"2023-05-24T04:01:21.224023+0000","last_peered":"2023-05-24T04:01:21.224023+0000","last_clean":"2023-05-24T04:01:21.224023+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:01:21.224023+0000","last_undegraded":"2023-05-24T04:01:21.224023+0000","last_fullsized":"2023-05-24T04:01:21.224023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_clean_scrub_stamp":"2023-05-24T04:01:21.223826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:20.577539+0000","scrub_duration":0.003384424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808470+0000","last_change":"2023-05-24T03:59:57.553678+0000","last_active":"2023-05-24T04:00:39.808470+0000","last_peered":"2023-05-24T04:00:39.808470+0000","last_clean":"2023-05-24T04:00:39.808470+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:00:39.808470+0000","last_undegraded":"2023-05-24T04:00:39.808470+0000","last_fullsized":"2023-05-24T04:00:39.808470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103110+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:40.103110+0000","last_peered":"2023-05-24T04:00:40.103110+0000","last_clean":"2023-05-24T04:00:40.103110+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:40.103110+0000","last_undegraded":"2023-05-24T04:00:40.103110+0000","last_fullsized":"2023-05-24T04:00:40.103110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.182538+0000","last_change":"2023-05-24T04:01:22.182646+0000","last_active":"2023-05-24T04:01:22.182538+0000","last_peered":"2023-05-24T04:01:22.182538+0000","last_clean":"2023-05-24T04:01:22.182538+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:01:22.182538+0000","last_undegraded":"2023-05-24T04:01:22.182538+0000","last_fullsized":"2023-05-24T04:01:22.182538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.182299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:31.903576+0000","scrub_duration":0.0036481510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.639339+0000","last_change":"2023-05-24T04:01:28.639425+0000","last_active":"2023-05-24T04:01:28.639339+0000","last_peered":"2023-05-24T04:01:28.639339+0000","last_clean":"2023-05-24T04:01:28.639339+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:01:28.639339+0000","last_undegraded":"2023-05-24T04:01:28.639339+0000","last_fullsized":"2023-05-24T04:01:28.639339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.639145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:22:23.648965+0000","scrub_duration":0.0032025460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101076+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:40.101076+0000","last_peered":"2023-05-24T04:00:40.101076+0000","last_clean":"2023-05-24T04:00:40.101076+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:40.101076+0000","last_undegraded":"2023-05-24T04:00:40.101076+0000","last_fullsized":"2023-05-24T04:00:40.101076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810617+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:39.810617+0000","last_peered":"2023-05-24T04:00:39.810617+0000","last_clean":"2023-05-24T04:00:39.810617+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:39.810617+0000","last_undegraded":"2023-05-24T04:00:39.810617+0000","last_fullsized":"2023-05-24T04:00:39.810617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100564+0000","last_change":"2023-05-24T03:59:57.544678+0000","last_active":"2023-05-24T04:00:40.100564+0000","last_peered":"2023-05-24T04:00:40.100564+0000","last_clean":"2023-05-24T04:00:40.100564+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:00:40.100564+0000","last_undegraded":"2023-05-24T04:00:40.100564+0000","last_fullsized":"2023-05-24T04:00:40.100564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806201+0000","last_change":"2023-05-24T04:00:01.994684+0000","last_active":"2023-05-24T04:00:39.806201+0000","last_peered":"2023-05-24T04:00:39.806201+0000","last_clean":"2023-05-24T04:00:39.806201+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:00:39.806201+0000","last_undegraded":"2023-05-24T04:00:39.806201+0000","last_fullsized":"2023-05-24T04:00:39.806201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:18.500583+0000","last_change":"2023-05-24T04:01:18.500643+0000","last_active":"2023-05-24T04:01:18.500583+0000","last_peered":"2023-05-24T04:01:18.500583+0000","last_clean":"2023-05-24T04:01:18.500583+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:01:18.500583+0000","last_undegraded":"2023-05-24T04:01:18.500583+0000","last_fullsized":"2023-05-24T04:01:18.500583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_clean_scrub_stamp":"2023-05-24T04:01:18.500449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:56.026871+0000","scrub_duration":0.002394424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101909+0000","last_change":"2023-05-24T03:59:57.548673+0000","last_active":"2023-05-24T04:00:40.101909+0000","last_peered":"2023-05-24T04:00:40.101909+0000","last_clean":"2023-05-24T04:00:40.101909+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:00:40.101909+0000","last_undegraded":"2023-05-24T04:00:40.101909+0000","last_fullsized":"2023-05-24T04:00:40.101909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805761+0000","last_change":"2023-05-24T04:00:01.972714+0000","last_active":"2023-05-24T04:00:39.805761+0000","last_peered":"2023-05-24T04:00:39.805761+0000","last_clean":"2023-05-24T04:00:39.805761+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:00:39.805761+0000","last_undegraded":"2023-05-24T04:00:39.805761+0000","last_fullsized":"2023-05-24T04:00:39.805761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810026+0000","last_change":"2023-05-24T03:59:57.941650+0000","last_active":"2023-05-24T04:00:39.810026+0000","last_peered":"2023-05-24T04:00:39.810026+0000","last_clean":"2023-05-24T04:00:39.810026+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:00:39.810026+0000","last_undegraded":"2023-05-24T04:00:39.810026+0000","last_fullsized":"2023-05-24T04:00:39.810026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100889+0000","last_change":"2023-05-24T03:59:57.552505+0000","last_active":"2023-05-24T04:00:40.100889+0000","last_peered":"2023-05-24T04:00:40.100889+0000","last_clean":"2023-05-24T04:00:40.100889+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:00:40.100889+0000","last_undegraded":"2023-05-24T04:00:40.100889+0000","last_fullsized":"2023-05-24T04:00:40.100889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805586+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:39.805586+0000","last_peered":"2023-05-24T04:00:39.805586+0000","last_clean":"2023-05-24T04:00:39.805586+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:39.805586+0000","last_undegraded":"2023-05-24T04:00:39.805586+0000","last_fullsized":"2023-05-24T04:00:39.805586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808148+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:39.808148+0000","last_peered":"2023-05-24T04:00:39.808148+0000","last_clean":"2023-05-24T04:00:39.808148+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:39.808148+0000","last_undegraded":"2023-05-24T04:00:39.808148+0000","last_fullsized":"2023-05-24T04:00:39.808148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.682550+0000","last_change":"2023-05-24T04:01:28.682735+0000","last_active":"2023-05-24T04:01:28.682550+0000","last_peered":"2023-05-24T04:01:28.682550+0000","last_clean":"2023-05-24T04:01:28.682550+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:01:28.682550+0000","last_undegraded":"2023-05-24T04:01:28.682550+0000","last_fullsized":"2023-05-24T04:01:28.682550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.682312+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:51.426096+0000","scrub_duration":0.0083039610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805257+0000","last_change":"2023-05-24T04:00:01.964684+0000","last_active":"2023-05-24T04:00:39.805257+0000","last_peered":"2023-05-24T04:00:39.805257+0000","last_clean":"2023-05-24T04:00:39.805257+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:00:39.805257+0000","last_undegraded":"2023-05-24T04:00:39.805257+0000","last_fullsized":"2023-05-24T04:00:39.805257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100843+0000","last_change":"2023-05-24T03:59:57.923323+0000","last_active":"2023-05-24T04:00:40.100843+0000","last_peered":"2023-05-24T04:00:40.100843+0000","last_clean":"2023-05-24T04:00:40.100843+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:00:40.100843+0000","last_undegraded":"2023-05-24T04:00:40.100843+0000","last_fullsized":"2023-05-24T04:00:40.100843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101260+0000","last_change":"2023-05-24T03:59:57.571176+0000","last_active":"2023-05-24T04:00:40.101260+0000","last_peered":"2023-05-24T04:00:40.101260+0000","last_clean":"2023-05-24T04:00:40.101260+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:00:40.101260+0000","last_undegraded":"2023-05-24T04:00:40.101260+0000","last_fullsized":"2023-05-24T04:00:40.101260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099183+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:40.099183+0000","last_peered":"2023-05-24T04:00:40.099183+0000","last_clean":"2023-05-24T04:00:40.099183+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:40.099183+0000","last_undegraded":"2023-05-24T04:00:40.099183+0000","last_fullsized":"2023-05-24T04:00:40.099183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102879+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102879+0000","last_peered":"2023-05-24T04:00:40.102879+0000","last_clean":"2023-05-24T04:00:40.102879+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102879+0000","last_undegraded":"2023-05-24T04:00:40.102879+0000","last_fullsized":"2023-05-24T04:00:40.102879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.593437+0000","last_change":"2023-05-24T04:01:26.593566+0000","last_active":"2023-05-24T04:01:26.593437+0000","last_peered":"2023-05-24T04:01:26.593437+0000","last_clean":"2023-05-24T04:01:26.593437+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:01:26.593437+0000","last_undegraded":"2023-05-24T04:01:26.593437+0000","last_fullsized":"2023-05-24T04:01:26.593437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.593234+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:45.271490+0000","scrub_duration":0.010776361999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102682+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:40.102682+0000","last_peered":"2023-05-24T04:00:40.102682+0000","last_clean":"2023-05-24T04:00:40.102682+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:40.102682+0000","last_undegraded":"2023-05-24T04:00:40.102682+0000","last_fullsized":"2023-05-24T04:00:40.102682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102376+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102376+0000","last_peered":"2023-05-24T04:00:40.102376+0000","last_clean":"2023-05-24T04:00:40.102376+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102376+0000","last_undegraded":"2023-05-24T04:00:40.102376+0000","last_fullsized":"2023-05-24T04:00:40.102376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100197+0000","last_change":"2023-05-24T03:59:57.567864+0000","last_active":"2023-05-24T04:00:40.100197+0000","last_peered":"2023-05-24T04:00:40.100197+0000","last_clean":"2023-05-24T04:00:40.100197+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:00:40.100197+0000","last_undegraded":"2023-05-24T04:00:40.100197+0000","last_fullsized":"2023-05-24T04:00:40.100197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811756+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:39.811756+0000","last_peered":"2023-05-24T04:00:39.811756+0000","last_clean":"2023-05-24T04:00:39.811756+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:39.811756+0000","last_undegraded":"2023-05-24T04:00:39.811756+0000","last_fullsized":"2023-05-24T04:00:39.811756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.471333+0000","last_change":"2023-05-24T04:01:24.471496+0000","last_active":"2023-05-24T04:01:24.471333+0000","last_peered":"2023-05-24T04:01:24.471333+0000","last_clean":"2023-05-24T04:01:24.471333+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:01:24.471333+0000","last_undegraded":"2023-05-24T04:01:24.471333+0000","last_fullsized":"2023-05-24T04:01:24.471333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.471086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:02.166879+0000","scrub_duration":0.003897663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.441669+0000","last_change":"2023-05-24T04:01:30.441761+0000","last_active":"2023-05-24T04:01:30.441669+0000","last_peered":"2023-05-24T04:01:30.441669+0000","last_clean":"2023-05-24T04:01:30.441669+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:01:30.441669+0000","last_undegraded":"2023-05-24T04:01:30.441669+0000","last_fullsized":"2023-05-24T04:01:30.441669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.441462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:33.501553+0000","scrub_duration":0.0033727969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100850+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:40.100850+0000","last_peered":"2023-05-24T04:00:40.100850+0000","last_clean":"2023-05-24T04:00:40.100850+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:40.100850+0000","last_undegraded":"2023-05-24T04:00:40.100850+0000","last_fullsized":"2023-05-24T04:00:40.100850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100069+0000","last_change":"2023-05-24T03:59:57.568243+0000","last_active":"2023-05-24T04:00:40.100069+0000","last_peered":"2023-05-24T04:00:40.100069+0000","last_clean":"2023-05-24T04:00:40.100069+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:00:40.100069+0000","last_undegraded":"2023-05-24T04:00:40.100069+0000","last_fullsized":"2023-05-24T04:00:40.100069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:56.477972+0000","last_clean_scrub_stamp":"2023-05-24T03:59:56.477972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.660388+0000","last_change":"2023-05-24T04:01:19.660455+0000","last_active":"2023-05-24T04:01:19.660388+0000","last_peered":"2023-05-24T04:01:19.660388+0000","last_clean":"2023-05-24T04:01:19.660388+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:01:19.660388+0000","last_undegraded":"2023-05-24T04:01:19.660388+0000","last_fullsized":"2023-05-24T04:01:19.660388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.660252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:10.528149+0000","scrub_duration":0.0021841819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102172+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102172+0000","last_peered":"2023-05-24T04:00:40.102172+0000","last_clean":"2023-05-24T04:00:40.102172+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102172+0000","last_undegraded":"2023-05-24T04:00:40.102172+0000","last_fullsized":"2023-05-24T04:00:40.102172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807212+0000","last_change":"2023-05-24T03:59:57.919346+0000","last_active":"2023-05-24T04:00:39.807212+0000","last_peered":"2023-05-24T04:00:39.807212+0000","last_clean":"2023-05-24T04:00:39.807212+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:00:39.807212+0000","last_undegraded":"2023-05-24T04:00:39.807212+0000","last_fullsized":"2023-05-24T04:00:39.807212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.608379+0000","last_change":"2023-05-24T04:01:28.608543+0000","last_active":"2023-05-24T04:01:28.608379+0000","last_peered":"2023-05-24T04:01:28.608379+0000","last_clean":"2023-05-24T04:01:28.608379+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:01:28.608379+0000","last_undegraded":"2023-05-24T04:01:28.608379+0000","last_fullsized":"2023-05-24T04:01:28.608379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.608121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:02.217126+0000","scrub_duration":0.003151638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809563+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:39.809563+0000","last_peered":"2023-05-24T04:00:39.809563+0000","last_clean":"2023-05-24T04:00:39.809563+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:39.809563+0000","last_undegraded":"2023-05-24T04:00:39.809563+0000","last_fullsized":"2023-05-24T04:00:39.809563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100311+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:40.100311+0000","last_peered":"2023-05-24T04:00:40.100311+0000","last_clean":"2023-05-24T04:00:40.100311+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:40.100311+0000","last_undegraded":"2023-05-24T04:00:40.100311+0000","last_fullsized":"2023-05-24T04:00:40.100311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102471+0000","last_change":"2023-05-24T03:59:57.934717+0000","last_active":"2023-05-24T04:00:40.102471+0000","last_peered":"2023-05-24T04:00:40.102471+0000","last_clean":"2023-05-24T04:00:40.102471+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:00:40.102471+0000","last_undegraded":"2023-05-24T04:00:40.102471+0000","last_fullsized":"2023-05-24T04:00:40.102471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102613+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:40.102613+0000","last_peered":"2023-05-24T04:00:40.102613+0000","last_clean":"2023-05-24T04:00:40.102613+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:40.102613+0000","last_undegraded":"2023-05-24T04:00:40.102613+0000","last_fullsized":"2023-05-24T04:00:40.102613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.670171+0000","last_change":"2023-05-24T04:01:34.670258+0000","last_active":"2023-05-24T04:01:34.670171+0000","last_peered":"2023-05-24T04:01:34.670171+0000","last_clean":"2023-05-24T04:01:34.670171+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:01:34.670171+0000","last_undegraded":"2023-05-24T04:01:34.670171+0000","last_fullsized":"2023-05-24T04:01:34.670171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.669939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:37.730029+0000","scrub_duration":0.0034536499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103365+0000","last_change":"2023-05-24T03:59:57.934004+0000","last_active":"2023-05-24T04:00:40.103365+0000","last_peered":"2023-05-24T04:00:40.103365+0000","last_clean":"2023-05-24T04:00:40.103365+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:00:40.103365+0000","last_undegraded":"2023-05-24T04:00:40.103365+0000","last_fullsized":"2023-05-24T04:00:40.103365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098718+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:40.098718+0000","last_peered":"2023-05-24T04:00:40.098718+0000","last_clean":"2023-05-24T04:00:40.098718+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:40.098718+0000","last_undegraded":"2023-05-24T04:00:40.098718+0000","last_fullsized":"2023-05-24T04:00:40.098718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099175+0000","last_change":"2023-05-24T03:59:57.910957+0000","last_active":"2023-05-24T04:00:40.099175+0000","last_peered":"2023-05-24T04:00:40.099175+0000","last_clean":"2023-05-24T04:00:40.099175+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:00:40.099175+0000","last_undegraded":"2023-05-24T04:00:40.099175+0000","last_fullsized":"2023-05-24T04:00:40.099175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.398495+0000","last_change":"2023-05-24T04:01:36.398595+0000","last_active":"2023-05-24T04:01:36.398495+0000","last_peered":"2023-05-24T04:01:36.398495+0000","last_clean":"2023-05-24T04:01:36.398495+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:01:36.398495+0000","last_undegraded":"2023-05-24T04:01:36.398495+0000","last_fullsized":"2023-05-24T04:01:36.398495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.398288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:35.536921+0000","scrub_duration":0.0033273310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099841+0000","last_change":"2023-05-24T03:59:57.924178+0000","last_active":"2023-05-24T04:00:40.099841+0000","last_peered":"2023-05-24T04:00:40.099841+0000","last_clean":"2023-05-24T04:00:40.099841+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:00:40.099841+0000","last_undegraded":"2023-05-24T04:00:40.099841+0000","last_fullsized":"2023-05-24T04:00:40.099841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.130996+0000","last_change":"2023-05-24T04:01:29.131084+0000","last_active":"2023-05-24T04:01:29.130996+0000","last_peered":"2023-05-24T04:01:29.130996+0000","last_clean":"2023-05-24T04:01:29.130996+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:01:29.130996+0000","last_undegraded":"2023-05-24T04:01:29.130996+0000","last_fullsized":"2023-05-24T04:01:29.130996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.130752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:36.271021+0000","scrub_duration":0.003228191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.339754+0000","last_change":"2023-05-24T04:01:26.339849+0000","last_active":"2023-05-24T04:01:26.339754+0000","last_peered":"2023-05-24T04:01:26.339754+0000","last_clean":"2023-05-24T04:01:26.339754+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:01:26.339754+0000","last_undegraded":"2023-05-24T04:01:26.339754+0000","last_fullsized":"2023-05-24T04:01:26.339754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.339543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:20:58.800839+0000","scrub_duration":0.0038659369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.243947+0000","last_change":"2023-05-24T04:01:20.244112+0000","last_active":"2023-05-24T04:01:20.243947+0000","last_peered":"2023-05-24T04:01:20.243947+0000","last_clean":"2023-05-24T04:01:20.243947+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:01:20.243947+0000","last_undegraded":"2023-05-24T04:01:20.243947+0000","last_fullsized":"2023-05-24T04:01:20.243947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.243690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:16.537332+0000","scrub_duration":0.0033338600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811840+0000","last_change":"2023-05-24T03:59:57.916026+0000","last_active":"2023-05-24T04:00:39.811840+0000","last_peered":"2023-05-24T04:00:39.811840+0000","last_clean":"2023-05-24T04:00:39.811840+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:00:39.811840+0000","last_undegraded":"2023-05-24T04:00:39.811840+0000","last_fullsized":"2023-05-24T04:00:39.811840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808340+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:39.808340+0000","last_peered":"2023-05-24T04:00:39.808340+0000","last_clean":"2023-05-24T04:00:39.808340+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:39.808340+0000","last_undegraded":"2023-05-24T04:00:39.808340+0000","last_fullsized":"2023-05-24T04:00:39.808340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099861+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:40.099861+0000","last_peered":"2023-05-24T04:00:40.099861+0000","last_clean":"2023-05-24T04:00:40.099861+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:40.099861+0000","last_undegraded":"2023-05-24T04:00:40.099861+0000","last_fullsized":"2023-05-24T04:00:40.099861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.465219+0000","last_change":"2023-05-24T04:01:26.465383+0000","last_active":"2023-05-24T04:01:26.465219+0000","last_peered":"2023-05-24T04:01:26.465219+0000","last_clean":"2023-05-24T04:01:26.465219+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:01:26.465219+0000","last_undegraded":"2023-05-24T04:01:26.465219+0000","last_fullsized":"2023-05-24T04:01:26.465219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.464980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:49.208763+0000","scrub_duration":0.003657731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805692+0000","last_change":"2023-05-24T03:59:57.912042+0000","last_active":"2023-05-24T04:00:39.805692+0000","last_peered":"2023-05-24T04:00:39.805692+0000","last_clean":"2023-05-24T04:00:39.805692+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:00:39.805692+0000","last_undegraded":"2023-05-24T04:00:39.805692+0000","last_fullsized":"2023-05-24T04:00:39.805692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.806144+0000","last_change":"2023-05-24T03:59:57.931399+0000","last_active":"2023-05-24T04:00:39.806144+0000","last_peered":"2023-05-24T04:00:39.806144+0000","last_clean":"2023-05-24T04:00:39.806144+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:00:39.806144+0000","last_undegraded":"2023-05-24T04:00:39.806144+0000","last_fullsized":"2023-05-24T04:00:39.806144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.153399+0000","last_change":"2023-05-24T04:01:30.153492+0000","last_active":"2023-05-24T04:01:30.153399+0000","last_peered":"2023-05-24T04:01:30.153399+0000","last_clean":"2023-05-24T04:01:30.153399+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:01:30.153399+0000","last_undegraded":"2023-05-24T04:01:30.153399+0000","last_fullsized":"2023-05-24T04:01:30.153399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.153179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:26.061011+0000","scrub_duration":0.0036045560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103423+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:40.103423+0000","last_peered":"2023-05-24T04:00:40.103423+0000","last_clean":"2023-05-24T04:00:40.103423+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:40.103423+0000","last_undegraded":"2023-05-24T04:00:40.103423+0000","last_fullsized":"2023-05-24T04:00:40.103423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811528+0000","last_change":"2023-05-24T03:59:57.916421+0000","last_active":"2023-05-24T04:00:39.811528+0000","last_peered":"2023-05-24T04:00:39.811528+0000","last_clean":"2023-05-24T04:00:39.811528+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:00:39.811528+0000","last_undegraded":"2023-05-24T04:00:39.811528+0000","last_fullsized":"2023-05-24T04:00:39.811528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.394121+0000","last_change":"2023-05-24T04:01:34.394285+0000","last_active":"2023-05-24T04:01:34.394121+0000","last_peered":"2023-05-24T04:01:34.394121+0000","last_clean":"2023-05-24T04:01:34.394121+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:01:34.394121+0000","last_undegraded":"2023-05-24T04:01:34.394121+0000","last_fullsized":"2023-05-24T04:01:34.394121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.393879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:08.002884+0000","scrub_duration":0.0036074449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099537+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:40.099537+0000","last_peered":"2023-05-24T04:00:40.099537+0000","last_clean":"2023-05-24T04:00:40.099537+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:40.099537+0000","last_undegraded":"2023-05-24T04:00:40.099537+0000","last_fullsized":"2023-05-24T04:00:40.099537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.166848+0000","last_change":"2023-05-24T04:01:35.166953+0000","last_active":"2023-05-24T04:01:35.166848+0000","last_peered":"2023-05-24T04:01:35.166848+0000","last_clean":"2023-05-24T04:01:35.166848+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:01:35.166848+0000","last_undegraded":"2023-05-24T04:01:35.166848+0000","last_fullsized":"2023-05-24T04:01:35.166848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.166621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:50:45.681248+0000","scrub_duration":0.0037053350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.817991+0000","last_change":"2023-05-24T04:00:39.816564+0000","last_active":"2023-05-24T04:00:39.817991+0000","last_peered":"2023-05-24T04:00:39.817991+0000","last_clean":"2023-05-24T04:00:39.817991+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:00:39.817991+0000","last_undegraded":"2023-05-24T04:00:39.817991+0000","last_fullsized":"2023-05-24T04:00:39.817991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809324+0000","last_change":"2023-05-24T03:59:57.918440+0000","last_active":"2023-05-24T04:00:39.809324+0000","last_peered":"2023-05-24T04:00:39.809324+0000","last_clean":"2023-05-24T04:00:39.809324+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:00:39.809324+0000","last_undegraded":"2023-05-24T04:00:39.809324+0000","last_fullsized":"2023-05-24T04:00:39.809324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811010+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:39.811010+0000","last_peered":"2023-05-24T04:00:39.811010+0000","last_clean":"2023-05-24T04:00:39.811010+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:39.811010+0000","last_undegraded":"2023-05-24T04:00:39.811010+0000","last_fullsized":"2023-05-24T04:00:39.811010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103091+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:40.103091+0000","last_peered":"2023-05-24T04:00:40.103091+0000","last_clean":"2023-05-24T04:00:40.103091+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:40.103091+0000","last_undegraded":"2023-05-24T04:00:40.103091+0000","last_fullsized":"2023-05-24T04:00:40.103091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.356918+0000","last_change":"2023-05-24T04:01:36.357015+0000","last_active":"2023-05-24T04:01:36.356918+0000","last_peered":"2023-05-24T04:01:36.356918+0000","last_clean":"2023-05-24T04:01:36.356918+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:01:36.356918+0000","last_undegraded":"2023-05-24T04:01:36.356918+0000","last_fullsized":"2023-05-24T04:01:36.356918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.356683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:22:55.377329+0000","scrub_duration":0.0034088299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6382,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.137},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.78300000000000003}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0780000000000001}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98099999999999998}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.1839999999999999}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.228}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.26}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.04},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.85499999999999998}]},{"osd":2,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.089}]},{"osd":4,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.99199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.92600000000000005}]},{"osd":1,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.077},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.0109999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.1659999999999999}]},{"osd":6,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.109}]},{"osd":7,"last update":"Wed May 24 04:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.248},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.1359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.169},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.29}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.22},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.131}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.93899999999999995}]},{"osd":3,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.875}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.81799999999999995}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.745},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.085}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.998},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0309999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67500000000000004}]},{"osd":1,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.83699999999999997}]},{"osd":4,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.026},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.3120000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.0629999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.127}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.78800000000000003}]},{"osd":1,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.63500000000000001}]},{"osd":3,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.97399999999999998}]},{"osd":4,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.0129999999999999}]},{"osd":5,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0840000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed May 24 04:00:47 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.1080000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.64400000000000002}]},{"osd":3,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.86699999999999999}]},{"osd":4,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98199999999999998}]},{"osd":5,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.2070000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.081},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0449999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1379999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.78200000000000003}]},{"osd":2,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.871}]},{"osd":3,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.90300000000000002}]},{"osd":4,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.109}]},{"osd":5,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.2270000000000001}]},{"osd":6,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.1739999999999999}]},{"osd":7,"last update":"Wed May 24 04:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.085},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.389}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:01:41.814 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.815 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.816 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.816 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.817 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.817 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.818 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.819 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.819 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.820 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.820 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.821 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.821 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.821 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.821 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.822 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.822 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.822 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.823 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.823 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.823 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.824 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.824 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.824 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.825 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.825 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.825 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.825 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.826 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.826 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.827 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.827 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.828 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.828 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.829 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.829 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.830 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.830 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.830 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.831 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.831 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.831 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.832 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.832 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.833 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.833 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-05-24T03:59:52.435685+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=52, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.833 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.833 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.834 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.834 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.834 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.835 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.835 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.836 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.836 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.837 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.837 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.837 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.838 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.838 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.839 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.839 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.839 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.840 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.840 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.840 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.841 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.841 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.842 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.842 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.843 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.843 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-05-24T03:59:56.477972+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=56, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.844 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.844 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.844 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.845 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.845 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.845 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.846 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.846 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.847 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.847 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.848 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.848 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.848 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.849 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.849 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.849 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.850 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.850 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.850 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.851 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.851 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.852 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:01:41.852 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T04:01:52.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:52.806 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:52.810 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:52.813 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:01:52.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:01.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:02:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 Processor -- start 2023-05-24T04:02:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 -- start start 2023-05-24T04:02:01.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3181464d0 0x7fb3180be640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:01.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb318071830 0x7fb31806a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3180bd910 con 0x7fb3180beb80 2023-05-24T04:02:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3180bc400 con 0x7fb318071830 2023-05-24T04:02:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31eef6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3180bdb60 con 0x7fb3181464d0 2023-05-24T04:02:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb318071830 0x7fb31806a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb318071830 0x7fb31806a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46612/0 (socket says 172.21.15.40:46612) 2023-05-24T04:02:01.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb317fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb3180beb80 0x7fb3180699e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33022/0 (socket says 172.21.15.40:33022) 2023-05-24T04:02:01.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 -- 172.21.15.40:0/4013216228 learned_addr learned my addr 172.21.15.40:0/4013216228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:01.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 -- 172.21.15.40:0/4013216228 >> v2:172.21.15.67:3300/0 conn(0x7fb3181464d0 msgr2=0x7fb3180be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:01.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 --2- 172.21.15.40:0/4013216228 >> v2:172.21.15.67:3300/0 conn(0x7fb3181464d0 0x7fb3180be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 -- 172.21.15.40:0/4013216228 >> v1:172.21.15.40:6789/0 conn(0x7fb3180beb80 legacy=0x7fb3180699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.985+0000 7fb31d493640 1 -- 172.21.15.40:0/4013216228 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180bbc00 con 0x7fb318071830 2023-05-24T04:02:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31d493640 1 --2- 172.21.15.40:0/4013216228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb318071830 0x7fb31806a0f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb31806f2b0 tx=0x7fb31001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8372c7d5bb725697 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb3177fe640 1 -- 172.21.15.40:0/4013216228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100a5720 con 0x7fb318071830 2023-05-24T04:02:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb3177fe640 1 -- 172.21.15.40:0/4013216228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100a5880 con 0x7fb318071830 2023-05-24T04:02:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb3177fe640 1 -- 172.21.15.40:0/4013216228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100a5c10 con 0x7fb318071830 2023-05-24T04:02:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 -- 172.21.15.40:0/4013216228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb318071830 msgr2=0x7fb31806a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 --2- 172.21.15.40:0/4013216228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb318071830 0x7fb31806a0f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb31806f2b0 tx=0x7fb31001c8a0 comp rx=0 tx=0).stop 2023-05-24T04:02:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 -- 172.21.15.40:0/4013216228 shutdown_connections 2023-05-24T04:02:01.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 --2- 172.21.15.40:0/4013216228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb318071830 0x7fb31806a0f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:01.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 --2- 172.21.15.40:0/4013216228 >> v2:172.21.15.67:3300/0 conn(0x7fb3181464d0 0x7fb3180be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:01.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 -- 172.21.15.40:0/4013216228 >> 172.21.15.40:0/4013216228 conn(0x7fb31806aef0 msgr2=0x7fb31806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:01.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 -- 172.21.15.40:0/4013216228 shutdown_connections 2023-05-24T04:02:01.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 -- 172.21.15.40:0/4013216228 wait complete. 2023-05-24T04:02:02.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 Processor -- start 2023-05-24T04:02:02.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.989+0000 7fb31eef6640 1 -- start start 2023-05-24T04:02:02.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb318071830 0x7fb318137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:02.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 0x7fb318134760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:02.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3181464d0 0x7fb3180a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:02.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180bae70 con 0x7fb3180beb80 2023-05-24T04:02:02.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180a7250 con 0x7fb3181464d0 2023-05-24T04:02:02.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180a6c70 con 0x7fb318071830 2023-05-24T04:02:02.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 0x7fb318134760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:02.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 0x7fb318134760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46628/0 (socket says 172.21.15.40:46628) 2023-05-24T04:02:02.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 -- 172.21.15.40:0/3665837643 learned_addr learned my addr 172.21.15.40:0/3665837643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:02.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 -- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb318071830 msgr2=0x7fb318137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:02.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb318071830 0x7fb318137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31d493640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3181464d0 0x7fb3180a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:02.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 -- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3181464d0 msgr2=0x7fb3180a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:02.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3181464d0 0x7fb3180a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 -- 172.21.15.40:0/3665837643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009b30 con 0x7fb3180beb80 2023-05-24T04:02:02.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb317fff640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 0x7fb318134760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c530 tx=0x7fb30400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:02.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304007500 con 0x7fb3180beb80 2023-05-24T04:02:02.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb304007660 con 0x7fb3180beb80 2023-05-24T04:02:02.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3180bb9b0 con 0x7fb3180beb80 2023-05-24T04:02:02.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304004a10 con 0x7fb3180beb80 2023-05-24T04:02:02.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3180bb820 con 0x7fb3180beb80 2023-05-24T04:02:02.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31806a630 con 0x7fb3180beb80 2023-05-24T04:02:02.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb304004b70 con 0x7fb3180beb80 2023-05-24T04:02:02.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb3157fa640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb2fc0662b0 0x7fb2fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:02.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb304083410 con 0x7fb3180beb80 2023-05-24T04:02:02.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31cc92640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb2fc0662b0 0x7fb2fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:02.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.993+0000 7fb31cc92640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb2fc0662b0 0x7fb2fc068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb31814cb40 tx=0x7fb30c006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:02.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:01.997+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb3040505f0 con 0x7fb3180beb80 2023-05-24T04:02:02.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.149+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3180674e0 con 0x7fb2fc0662b0 2023-05-24T04:02:02.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.177+0000 7fb3157fa640 1 -- 172.21.15.40:0/3665837643 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390440 (secure 0 0 0) 0x7fb3180674e0 con 0x7fb2fc0662b0 2023-05-24T04:02:02.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:02:02.187 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:02:02.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb2fc0662b0 msgr2=0x7fb2fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:02.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb2fc0662b0 0x7fb2fc068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb31814cb40 tx=0x7fb30c006c00 comp rx=0 tx=0).stop 2023-05-24T04:02:02.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 msgr2=0x7fb318134760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:02.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 0x7fb318134760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c530 tx=0x7fb30400c9f0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 shutdown_connections 2023-05-24T04:02:02.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fb2fc0662b0 0x7fb2fc068760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3181464d0 0x7fb3180a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3180beb80 0x7fb318134760 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 --2- 172.21.15.40:0/3665837643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb318071830 0x7fb318137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 >> 172.21.15.40:0/3665837643 conn(0x7fb31806aef0 msgr2=0x7fb318141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 shutdown_connections 2023-05-24T04:02:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:02.181+0000 7fb31eef6640 1 -- 172.21.15.40:0/3665837643 wait complete. 2023-05-24T04:02:02.204 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-05-24T04:02:00.567904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596750,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005473"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098252+0000","last_change":"2023-05-24T04:00:01.986454+0000","last_active":"2023-05-24T04:00:40.098252+0000","last_peered":"2023-05-24T04:00:40.098252+0000","last_clean":"2023-05-24T04:00:40.098252+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:00:40.098252+0000","last_undegraded":"2023-05-24T04:00:40.098252+0000","last_fullsized":"2023-05-24T04:00:40.098252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.473614+0000","last_change":"2023-05-24T04:01:29.473721+0000","last_active":"2023-05-24T04:01:29.473614+0000","last_peered":"2023-05-24T04:01:29.473614+0000","last_clean":"2023-05-24T04:01:29.473614+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:01:29.473614+0000","last_undegraded":"2023-05-24T04:01:29.473614+0000","last_fullsized":"2023-05-24T04:01:29.473614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.473421+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:39.840985+0000","scrub_duration":0.0082611170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808728+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808728+0000","last_peered":"2023-05-24T04:00:39.808728+0000","last_clean":"2023-05-24T04:00:39.808728+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808728+0000","last_undegraded":"2023-05-24T04:00:39.808728+0000","last_fullsized":"2023-05-24T04:00:39.808728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807833+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807833+0000","last_peered":"2023-05-24T04:00:39.807833+0000","last_clean":"2023-05-24T04:00:39.807833+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807833+0000","last_undegraded":"2023-05-24T04:00:39.807833+0000","last_fullsized":"2023-05-24T04:00:39.807833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:39.501018+0000","last_change":"2023-05-24T04:01:39.501018+0000","last_active":"2023-05-24T04:01:39.501018+0000","last_peered":"2023-05-24T04:01:39.501018+0000","last_clean":"2023-05-24T04:01:39.501018+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:01:39.501018+0000","last_undegraded":"2023-05-24T04:01:39.501018+0000","last_fullsized":"2023-05-24T04:01:39.501018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:39.500706+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:39.500706+0000","last_clean_scrub_stamp":"2023-05-24T04:01:39.500706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:38.854419+0000","scrub_duration":0.0037390499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.568929+0000","last_change":"2023-05-24T04:01:24.569026+0000","last_active":"2023-05-24T04:01:24.568929+0000","last_peered":"2023-05-24T04:01:24.568929+0000","last_clean":"2023-05-24T04:01:24.568929+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:01:24.568929+0000","last_undegraded":"2023-05-24T04:01:24.568929+0000","last_fullsized":"2023-05-24T04:01:24.568929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.568716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:27.628807+0000","scrub_duration":0.0033214799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101720+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101720+0000","last_peered":"2023-05-24T04:00:40.101720+0000","last_clean":"2023-05-24T04:00:40.101720+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101720+0000","last_undegraded":"2023-05-24T04:00:40.101720+0000","last_fullsized":"2023-05-24T04:00:40.101720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:51.397239+0000","last_change":"2023-05-24T04:01:51.397341+0000","last_active":"2023-05-24T04:01:51.397239+0000","last_peered":"2023-05-24T04:01:51.397239+0000","last_clean":"2023-05-24T04:01:51.397239+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:01:51.397239+0000","last_undegraded":"2023-05-24T04:01:51.397239+0000","last_fullsized":"2023-05-24T04:01:51.397239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:51.397019+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:51.397019+0000","last_clean_scrub_stamp":"2023-05-24T04:01:51.397019+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:29.883107+0000","scrub_duration":0.0065764580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809161+0000","last_change":"2023-05-24T03:59:57.927467+0000","last_active":"2023-05-24T04:00:39.809161+0000","last_peered":"2023-05-24T04:00:39.809161+0000","last_clean":"2023-05-24T04:00:39.809161+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:00:39.809161+0000","last_undegraded":"2023-05-24T04:00:39.809161+0000","last_fullsized":"2023-05-24T04:00:39.809161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099334+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099334+0000","last_peered":"2023-05-24T04:00:40.099334+0000","last_clean":"2023-05-24T04:00:40.099334+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099334+0000","last_undegraded":"2023-05-24T04:00:40.099334+0000","last_fullsized":"2023-05-24T04:00:40.099334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.400500+0000","last_change":"2023-05-24T04:01:45.400608+0000","last_active":"2023-05-24T04:01:45.400500+0000","last_peered":"2023-05-24T04:01:45.400500+0000","last_clean":"2023-05-24T04:01:45.400500+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:01:45.400500+0000","last_undegraded":"2023-05-24T04:01:45.400500+0000","last_fullsized":"2023-05-24T04:01:45.400500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:45.400310+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:45.400310+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.400310+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:44.754023+0000","scrub_duration":0.0068925899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809852+0000","last_change":"2023-05-24T03:59:57.927835+0000","last_active":"2023-05-24T04:00:39.809852+0000","last_peered":"2023-05-24T04:00:39.809852+0000","last_clean":"2023-05-24T04:00:39.809852+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:00:39.809852+0000","last_undegraded":"2023-05-24T04:00:39.809852+0000","last_fullsized":"2023-05-24T04:00:39.809852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.618365+0000","last_change":"2023-05-24T04:01:55.618615+0000","last_active":"2023-05-24T04:01:55.618365+0000","last_peered":"2023-05-24T04:01:55.618365+0000","last_clean":"2023-05-24T04:01:55.618365+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:01:55.618365+0000","last_undegraded":"2023-05-24T04:01:55.618365+0000","last_fullsized":"2023-05-24T04:01:55.618365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:55.618101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:55.618101+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.618101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:34.104189+0000","scrub_duration":0.0039436059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.542381+0000","last_change":"2023-05-24T04:01:22.542492+0000","last_active":"2023-05-24T04:01:22.542381+0000","last_peered":"2023-05-24T04:01:22.542381+0000","last_clean":"2023-05-24T04:01:22.542381+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:01:22.542381+0000","last_undegraded":"2023-05-24T04:01:22.542381+0000","last_fullsized":"2023-05-24T04:01:22.542381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.542168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:13.410065+0000","scrub_duration":0.003819444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.484589+0000","last_change":"2023-05-24T04:01:45.484684+0000","last_active":"2023-05-24T04:01:45.484589+0000","last_peered":"2023-05-24T04:01:45.484589+0000","last_clean":"2023-05-24T04:01:45.484589+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:01:45.484589+0000","last_undegraded":"2023-05-24T04:01:45.484589+0000","last_fullsized":"2023-05-24T04:01:45.484589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:45.484393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:45.484393+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.484393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:44.530511+0000","scrub_duration":0.0034391399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810269+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810269+0000","last_peered":"2023-05-24T04:00:39.810269+0000","last_clean":"2023-05-24T04:00:39.810269+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810269+0000","last_undegraded":"2023-05-24T04:00:39.810269+0000","last_fullsized":"2023-05-24T04:00:39.810269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.210580+0000","last_change":"2023-05-24T04:01:36.210680+0000","last_active":"2023-05-24T04:01:36.210580+0000","last_peered":"2023-05-24T04:01:36.210580+0000","last_clean":"2023-05-24T04:01:36.210580+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:01:36.210580+0000","last_undegraded":"2023-05-24T04:01:36.210580+0000","last_fullsized":"2023-05-24T04:01:36.210580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.210367+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:19.478523+0000","scrub_duration":0.003865659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.453894+0000","last_change":"2023-05-24T04:01:50.454078+0000","last_active":"2023-05-24T04:01:50.453894+0000","last_peered":"2023-05-24T04:01:50.453894+0000","last_clean":"2023-05-24T04:01:50.453894+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:01:50.453894+0000","last_undegraded":"2023-05-24T04:01:50.453894+0000","last_fullsized":"2023-05-24T04:01:50.453894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.453676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.453676+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.453676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:21.183230+0000","scrub_duration":0.003547335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.638966+0000","last_change":"2023-05-24T04:01:45.639129+0000","last_active":"2023-05-24T04:01:45.638966+0000","last_peered":"2023-05-24T04:01:45.638966+0000","last_clean":"2023-05-24T04:01:45.638966+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:01:45.638966+0000","last_undegraded":"2023-05-24T04:01:45.638966+0000","last_fullsized":"2023-05-24T04:01:45.638966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:45.638738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:45.638738+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.638738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:21.861642+0000","scrub_duration":0.0040594979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.702301+0000","last_change":"2023-05-24T04:01:29.702398+0000","last_active":"2023-05-24T04:01:29.702301+0000","last_peered":"2023-05-24T04:01:29.702301+0000","last_clean":"2023-05-24T04:01:29.702301+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:01:29.702301+0000","last_undegraded":"2023-05-24T04:01:29.702301+0000","last_fullsized":"2023-05-24T04:01:29.702301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.702108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:20.570006+0000","scrub_duration":0.0033797469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.353569+0000","last_change":"2023-05-24T04:01:53.353680+0000","last_active":"2023-05-24T04:01:53.353569+0000","last_peered":"2023-05-24T04:01:53.353569+0000","last_clean":"2023-05-24T04:01:53.353569+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:01:53.353569+0000","last_undegraded":"2023-05-24T04:01:53.353569+0000","last_fullsized":"2023-05-24T04:01:53.353569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:53.353364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:53.353364+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.353364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:49.261197+0000","scrub_duration":0.0034261130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811323+0000","last_change":"2023-05-24T04:00:01.984899+0000","last_active":"2023-05-24T04:00:39.811323+0000","last_peered":"2023-05-24T04:00:39.811323+0000","last_clean":"2023-05-24T04:00:39.811323+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:00:39.811323+0000","last_undegraded":"2023-05-24T04:00:39.811323+0000","last_fullsized":"2023-05-24T04:00:39.811323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:33.580827+0000","last_change":"2023-05-24T04:01:33.580913+0000","last_active":"2023-05-24T04:01:33.580827+0000","last_peered":"2023-05-24T04:01:33.580827+0000","last_clean":"2023-05-24T04:01:33.580827+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:01:33.580827+0000","last_undegraded":"2023-05-24T04:01:33.580827+0000","last_fullsized":"2023-05-24T04:01:33.580827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_clean_scrub_stamp":"2023-05-24T04:01:33.580634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:32.719267+0000","scrub_duration":0.0034014739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.701421+0000","last_change":"2023-05-24T04:01:32.701508+0000","last_active":"2023-05-24T04:01:32.701421+0000","last_peered":"2023-05-24T04:01:32.701421+0000","last_clean":"2023-05-24T04:01:32.701421+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:01:32.701421+0000","last_undegraded":"2023-05-24T04:01:32.701421+0000","last_fullsized":"2023-05-24T04:01:32.701421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.701223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:00:56.829588+0000","scrub_duration":0.0032971739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098790+0000","last_change":"2023-05-24T03:59:57.937144+0000","last_active":"2023-05-24T04:00:40.098790+0000","last_peered":"2023-05-24T04:00:40.098790+0000","last_clean":"2023-05-24T04:00:40.098790+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:00:40.098790+0000","last_undegraded":"2023-05-24T04:00:40.098790+0000","last_fullsized":"2023-05-24T04:00:40.098790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:31.399044+0000","last_change":"2023-05-24T04:01:31.399136+0000","last_active":"2023-05-24T04:01:31.399044+0000","last_peered":"2023-05-24T04:01:31.399044+0000","last_clean":"2023-05-24T04:01:31.399044+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:01:31.399044+0000","last_undegraded":"2023-05-24T04:01:31.399044+0000","last_fullsized":"2023-05-24T04:01:31.399044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_clean_scrub_stamp":"2023-05-24T04:01:31.398830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:05.007835+0000","scrub_duration":0.0036452780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.661633+0000","last_change":"2023-05-24T04:01:46.661762+0000","last_active":"2023-05-24T04:01:46.661633+0000","last_peered":"2023-05-24T04:01:46.661633+0000","last_clean":"2023-05-24T04:01:46.661633+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:01:46.661633+0000","last_undegraded":"2023-05-24T04:01:46.661633+0000","last_fullsized":"2023-05-24T04:01:46.661633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:46.661420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:46.661420+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.661420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:14:08.876249+0000","scrub_duration":0.0037910399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.623427+0000","last_change":"2023-05-24T04:01:20.623465+0000","last_active":"2023-05-24T04:01:20.623427+0000","last_peered":"2023-05-24T04:01:20.623427+0000","last_clean":"2023-05-24T04:01:20.623427+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:01:20.623427+0000","last_undegraded":"2023-05-24T04:01:20.623427+0000","last_fullsized":"2023-05-24T04:01:20.623427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.623341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:43.367125+0000","scrub_duration":0.0026911190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:52.419838+0000","last_change":"2023-05-24T04:01:52.419937+0000","last_active":"2023-05-24T04:01:52.419838+0000","last_peered":"2023-05-24T04:01:52.419838+0000","last_clean":"2023-05-24T04:01:52.419838+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:01:52.419838+0000","last_undegraded":"2023-05-24T04:01:52.419838+0000","last_fullsized":"2023-05-24T04:01:52.419838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:52.419605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:52.419605+0000","last_clean_scrub_stamp":"2023-05-24T04:01:52.419605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:37.222469+0000","scrub_duration":0.0035731449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098375+0000","last_change":"2023-05-24T04:00:01.985606+0000","last_active":"2023-05-24T04:00:40.098375+0000","last_peered":"2023-05-24T04:00:40.098375+0000","last_clean":"2023-05-24T04:00:40.098375+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:00:40.098375+0000","last_undegraded":"2023-05-24T04:00:40.098375+0000","last_fullsized":"2023-05-24T04:00:40.098375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"29'5","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.924760+0000","last_change":"2023-05-24T04:01:46.924950+0000","last_active":"2023-05-24T04:01:46.924760+0000","last_peered":"2023-05-24T04:01:46.924760+0000","last_clean":"2023-05-24T04:01:46.924760+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:01:46.924760+0000","last_undegraded":"2023-05-24T04:01:46.924760+0000","last_fullsized":"2023-05-24T04:01:46.924760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-05-24T04:01:46.924540+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-05-24T04:01:46.924540+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.924540+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:43.218183+0000","scrub_duration":0.0085557979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.683506+0000","last_change":"2023-05-24T04:01:43.683595+0000","last_active":"2023-05-24T04:01:43.683506+0000","last_peered":"2023-05-24T04:01:43.683506+0000","last_clean":"2023-05-24T04:01:43.683506+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:01:43.683506+0000","last_undegraded":"2023-05-24T04:01:43.683506+0000","last_fullsized":"2023-05-24T04:01:43.683506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.683302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.683302+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.683302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:42.821935+0000","scrub_duration":0.0037036439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099786+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099786+0000","last_peered":"2023-05-24T04:00:40.099786+0000","last_clean":"2023-05-24T04:00:40.099786+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099786+0000","last_undegraded":"2023-05-24T04:00:40.099786+0000","last_fullsized":"2023-05-24T04:00:40.099786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'22","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.292743+0000","last_change":"2023-05-24T04:01:55.292848+0000","last_active":"2023-05-24T04:01:55.292743+0000","last_peered":"2023-05-24T04:01:55.292743+0000","last_clean":"2023-05-24T04:01:55.292743+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:01:55.292743+0000","last_undegraded":"2023-05-24T04:01:55.292743+0000","last_fullsized":"2023-05-24T04:01:55.292743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2023-05-24T04:01:55.292550+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2023-05-24T04:01:55.292550+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.292550+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:20:06.103036+0000","scrub_duration":0.011296013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.193685+0000","last_change":"2023-05-24T04:01:23.193776+0000","last_active":"2023-05-24T04:01:23.193685+0000","last_peered":"2023-05-24T04:01:23.193685+0000","last_clean":"2023-05-24T04:01:23.193685+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:01:23.193685+0000","last_undegraded":"2023-05-24T04:01:23.193685+0000","last_fullsized":"2023-05-24T04:01:23.193685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.193479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:14.734145+0000","scrub_duration":0.0035797390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099802+0000","last_change":"2023-05-24T04:00:01.988562+0000","last_active":"2023-05-24T04:00:40.099802+0000","last_peered":"2023-05-24T04:00:40.099802+0000","last_clean":"2023-05-24T04:00:40.099802+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:00:40.099802+0000","last_undegraded":"2023-05-24T04:00:40.099802+0000","last_fullsized":"2023-05-24T04:00:40.099802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.190969+0000","last_change":"2023-05-24T04:01:25.191060+0000","last_active":"2023-05-24T04:01:25.190969+0000","last_peered":"2023-05-24T04:01:25.190969+0000","last_clean":"2023-05-24T04:01:25.190969+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:01:25.190969+0000","last_undegraded":"2023-05-24T04:01:25.190969+0000","last_fullsized":"2023-05-24T04:01:25.190969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.190751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:03.676839+0000","scrub_duration":0.0032725419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.589652+0000","last_change":"2023-05-24T04:01:22.589749+0000","last_active":"2023-05-24T04:01:22.589652+0000","last_peered":"2023-05-24T04:01:22.589652+0000","last_clean":"2023-05-24T04:01:22.589652+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:01:22.589652+0000","last_undegraded":"2023-05-24T04:01:22.589652+0000","last_fullsized":"2023-05-24T04:01:22.589652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.589468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:45:57.220840+0000","scrub_duration":0.0034413989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.443104+0000","last_change":"2023-05-24T04:01:35.443206+0000","last_active":"2023-05-24T04:01:35.443104+0000","last_peered":"2023-05-24T04:01:35.443104+0000","last_clean":"2023-05-24T04:01:35.443104+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:01:35.443104+0000","last_undegraded":"2023-05-24T04:01:35.443104+0000","last_fullsized":"2023-05-24T04:01:35.443104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.442898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:31.248990+0000","scrub_duration":0.0067569300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098002+0000","last_change":"2023-05-24T04:00:01.977530+0000","last_active":"2023-05-24T04:00:40.098002+0000","last_peered":"2023-05-24T04:00:40.098002+0000","last_clean":"2023-05-24T04:00:40.098002+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:00:40.098002+0000","last_undegraded":"2023-05-24T04:00:40.098002+0000","last_fullsized":"2023-05-24T04:00:40.098002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:56.385588+0000","last_change":"2023-05-24T04:01:56.385698+0000","last_active":"2023-05-24T04:01:56.385588+0000","last_peered":"2023-05-24T04:01:56.385588+0000","last_clean":"2023-05-24T04:01:56.385588+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:01:56.385588+0000","last_undegraded":"2023-05-24T04:01:56.385588+0000","last_fullsized":"2023-05-24T04:01:56.385588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:56.385366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:56.385366+0000","last_clean_scrub_stamp":"2023-05-24T04:01:56.385366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:43:47.909596+0000","scrub_duration":0.0038443430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.651626+0000","last_change":"2023-05-24T04:01:20.651747+0000","last_active":"2023-05-24T04:01:20.651626+0000","last_peered":"2023-05-24T04:01:20.651626+0000","last_clean":"2023-05-24T04:01:20.651626+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:01:20.651626+0000","last_undegraded":"2023-05-24T04:01:20.651626+0000","last_fullsized":"2023-05-24T04:01:20.651626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.651438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:36:56.874342+0000","scrub_duration":0.0035848859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.471196+0000","last_change":"2023-05-24T04:01:40.471303+0000","last_active":"2023-05-24T04:01:40.471196+0000","last_peered":"2023-05-24T04:01:40.471196+0000","last_clean":"2023-05-24T04:01:40.471196+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:01:40.471196+0000","last_undegraded":"2023-05-24T04:01:40.471196+0000","last_fullsized":"2023-05-24T04:01:40.471196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:40.471004+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:40.471004+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.471004+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:50.192281+0000","scrub_duration":0.0070832450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807639+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:00:39.807639+0000","last_peered":"2023-05-24T04:00:39.807639+0000","last_clean":"2023-05-24T04:00:39.807639+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:00:39.807639+0000","last_undegraded":"2023-05-24T04:00:39.807639+0000","last_fullsized":"2023-05-24T04:00:39.807639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.480227+0000","last_change":"2023-05-24T04:01:19.480291+0000","last_active":"2023-05-24T04:01:19.480227+0000","last_peered":"2023-05-24T04:01:19.480227+0000","last_clean":"2023-05-24T04:01:19.480227+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:01:19.480227+0000","last_undegraded":"2023-05-24T04:01:19.480227+0000","last_fullsized":"2023-05-24T04:01:19.480227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.480118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:23.591362+0000","scrub_duration":0.0025500269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.880289+0000","last_change":"2023-05-24T04:01:40.880382+0000","last_active":"2023-05-24T04:01:40.880289+0000","last_peered":"2023-05-24T04:01:40.880289+0000","last_clean":"2023-05-24T04:01:40.880289+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:01:40.880289+0000","last_undegraded":"2023-05-24T04:01:40.880289+0000","last_fullsized":"2023-05-24T04:01:40.880289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:40.880088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:40.880088+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.880088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:36.686179+0000","scrub_duration":0.003581529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.699129+0000","last_change":"2023-05-24T04:01:30.699228+0000","last_active":"2023-05-24T04:01:30.699129+0000","last_peered":"2023-05-24T04:01:30.699129+0000","last_clean":"2023-05-24T04:01:30.699129+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:01:30.699129+0000","last_undegraded":"2023-05-24T04:01:30.699129+0000","last_fullsized":"2023-05-24T04:01:30.699129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.698924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:53.442708+0000","scrub_duration":0.0031884679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.604277+0000","last_change":"2023-05-24T04:01:44.604519+0000","last_active":"2023-05-24T04:01:44.604277+0000","last_peered":"2023-05-24T04:01:44.604277+0000","last_clean":"2023-05-24T04:01:44.604277+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:01:44.604277+0000","last_undegraded":"2023-05-24T04:01:44.604277+0000","last_fullsized":"2023-05-24T04:01:44.604277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.604016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.604016+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.604016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:02:20.806799+0000","scrub_duration":0.0037330570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.662173+0000","last_change":"2023-05-24T04:01:42.662282+0000","last_active":"2023-05-24T04:01:42.662173+0000","last_peered":"2023-05-24T04:01:42.662173+0000","last_clean":"2023-05-24T04:01:42.662173+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:01:42.662173+0000","last_undegraded":"2023-05-24T04:01:42.662173+0000","last_fullsized":"2023-05-24T04:01:42.662173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.661969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.661969+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.661969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:38.468061+0000","scrub_duration":0.0038420709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.679598+0000","last_change":"2023-05-24T04:01:25.679692+0000","last_active":"2023-05-24T04:01:25.679598+0000","last_peered":"2023-05-24T04:01:25.679598+0000","last_clean":"2023-05-24T04:01:25.679598+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:01:25.679598+0000","last_undegraded":"2023-05-24T04:01:25.679598+0000","last_fullsized":"2023-05-24T04:01:25.679598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.679377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:03.205799+0000","scrub_duration":0.0036885849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.432998+0000","last_change":"2023-05-24T04:01:46.433087+0000","last_active":"2023-05-24T04:01:46.432998+0000","last_peered":"2023-05-24T04:01:46.432998+0000","last_clean":"2023-05-24T04:01:46.432998+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:01:46.432998+0000","last_undegraded":"2023-05-24T04:01:46.432998+0000","last_fullsized":"2023-05-24T04:01:46.432998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:46.432784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:46.432784+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.432784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:56.154061+0000","scrub_duration":0.0039204219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811309+0000","last_change":"2023-05-24T04:00:01.968802+0000","last_active":"2023-05-24T04:00:39.811309+0000","last_peered":"2023-05-24T04:00:39.811309+0000","last_clean":"2023-05-24T04:00:39.811309+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:00:39.811309+0000","last_undegraded":"2023-05-24T04:00:39.811309+0000","last_fullsized":"2023-05-24T04:00:39.811309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.639580+0000","last_change":"2023-05-24T04:01:50.639626+0000","last_active":"2023-05-24T04:01:50.639580+0000","last_peered":"2023-05-24T04:01:50.639580+0000","last_clean":"2023-05-24T04:01:50.639580+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:01:50.639580+0000","last_undegraded":"2023-05-24T04:01:50.639580+0000","last_fullsized":"2023-05-24T04:01:50.639580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.639510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.639510+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.639510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:00.360787+0000","scrub_duration":0.0018084279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:49.333199+0000","last_change":"2023-05-24T04:01:49.333308+0000","last_active":"2023-05-24T04:01:49.333199+0000","last_peered":"2023-05-24T04:01:49.333199+0000","last_clean":"2023-05-24T04:01:49.333199+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:01:49.333199+0000","last_undegraded":"2023-05-24T04:01:49.333199+0000","last_fullsized":"2023-05-24T04:01:49.333199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:49.332974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:49.332974+0000","last_clean_scrub_stamp":"2023-05-24T04:01:49.332974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:33.955176+0000","scrub_duration":0.0036926239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:39.366417+0000","last_change":"2023-05-24T04:01:39.366510+0000","last_active":"2023-05-24T04:01:39.366417+0000","last_peered":"2023-05-24T04:01:39.366417+0000","last_clean":"2023-05-24T04:01:39.366417+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:01:39.366417+0000","last_undegraded":"2023-05-24T04:01:39.366417+0000","last_fullsized":"2023-05-24T04:01:39.366417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:39.366218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:39.366218+0000","last_clean_scrub_stamp":"2023-05-24T04:01:39.366218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:38.504851+0000","scrub_duration":0.0036500320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811186+0000","last_change":"2023-05-24T04:00:01.979260+0000","last_active":"2023-05-24T04:00:39.811186+0000","last_peered":"2023-05-24T04:00:39.811186+0000","last_clean":"2023-05-24T04:00:39.811186+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:00:39.811186+0000","last_undegraded":"2023-05-24T04:00:39.811186+0000","last_fullsized":"2023-05-24T04:00:39.811186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:41.562237+0000","last_change":"2023-05-24T04:00:40.102360+0000","last_active":"2023-05-24T04:00:41.562237+0000","last_peered":"2023-05-24T04:00:41.562237+0000","last_clean":"2023-05-24T04:00:41.562237+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:00:41.562237+0000","last_undegraded":"2023-05-24T04:00:41.562237+0000","last_fullsized":"2023-05-24T04:00:41.562237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.712817+0000","last_change":"2023-05-24T04:01:26.712817+0000","last_active":"2023-05-24T04:01:26.712817+0000","last_peered":"2023-05-24T04:01:26.712817+0000","last_clean":"2023-05-24T04:01:26.712817+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:01:26.712817+0000","last_undegraded":"2023-05-24T04:01:26.712817+0000","last_fullsized":"2023-05-24T04:01:26.712817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.712506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:30.823750+0000","scrub_duration":0.0075320789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.403790+0000","last_change":"2023-05-24T04:01:23.403937+0000","last_active":"2023-05-24T04:01:23.403790+0000","last_peered":"2023-05-24T04:01:23.403790+0000","last_clean":"2023-05-24T04:01:23.403790+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:01:23.403790+0000","last_undegraded":"2023-05-24T04:01:23.403790+0000","last_fullsized":"2023-05-24T04:01:23.403790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.403578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:34:05.102350+0000","scrub_duration":0.003686197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.540889+0000","last_change":"2023-05-24T04:01:53.541116+0000","last_active":"2023-05-24T04:01:53.540889+0000","last_peered":"2023-05-24T04:01:53.540889+0000","last_clean":"2023-05-24T04:01:53.540889+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:01:53.540889+0000","last_undegraded":"2023-05-24T04:01:53.540889+0000","last_fullsized":"2023-05-24T04:01:53.540889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:53.540576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:53.540576+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.540576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:29.763480+0000","scrub_duration":0.0040370190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.439618+0000","last_change":"2023-05-24T04:01:43.439708+0000","last_active":"2023-05-24T04:01:43.439618+0000","last_peered":"2023-05-24T04:01:43.439618+0000","last_clean":"2023-05-24T04:01:43.439618+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:01:43.439618+0000","last_undegraded":"2023-05-24T04:01:43.439618+0000","last_fullsized":"2023-05-24T04:01:43.439618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.439415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.439415+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.439415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:53.160692+0000","scrub_duration":0.0031035960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.426620+0000","last_change":"2023-05-24T04:01:28.426714+0000","last_active":"2023-05-24T04:01:28.426620+0000","last_peered":"2023-05-24T04:01:28.426620+0000","last_clean":"2023-05-24T04:01:28.426620+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:01:28.426620+0000","last_undegraded":"2023-05-24T04:01:28.426620+0000","last_fullsized":"2023-05-24T04:01:28.426620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:31.486492+0000","scrub_duration":0.0036793720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.787411+0000","last_change":"2023-05-24T04:01:36.787411+0000","last_active":"2023-05-24T04:01:36.787411+0000","last_peered":"2023-05-24T04:01:36.787411+0000","last_clean":"2023-05-24T04:01:36.787411+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:01:36.787411+0000","last_undegraded":"2023-05-24T04:01:36.787411+0000","last_fullsized":"2023-05-24T04:01:36.787411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.787113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.787113+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.787113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:10.396118+0000","scrub_duration":0.0076298199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103455+0000","last_change":"2023-05-24T04:00:01.980316+0000","last_active":"2023-05-24T04:00:40.103455+0000","last_peered":"2023-05-24T04:00:40.103455+0000","last_clean":"2023-05-24T04:00:40.103455+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:00:40.103455+0000","last_undegraded":"2023-05-24T04:00:40.103455+0000","last_fullsized":"2023-05-24T04:00:40.103455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.619238+0000","last_change":"2023-05-24T04:01:30.619338+0000","last_active":"2023-05-24T04:01:30.619238+0000","last_peered":"2023-05-24T04:01:30.619238+0000","last_clean":"2023-05-24T04:01:30.619238+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:01:30.619238+0000","last_undegraded":"2023-05-24T04:01:30.619238+0000","last_fullsized":"2023-05-24T04:01:30.619238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.619015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:36:30.639136+0000","scrub_duration":0.0034554199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.514838+0000","last_change":"2023-05-24T04:01:38.514932+0000","last_active":"2023-05-24T04:01:38.514838+0000","last_peered":"2023-05-24T04:01:38.514838+0000","last_clean":"2023-05-24T04:01:38.514838+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:01:38.514838+0000","last_undegraded":"2023-05-24T04:01:38.514838+0000","last_fullsized":"2023-05-24T04:01:38.514838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.514605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.514605+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.514605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:34.808247+0000","scrub_duration":0.0034984259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.340111+0000","last_change":"2023-05-24T04:01:38.340209+0000","last_active":"2023-05-24T04:01:38.340111+0000","last_peered":"2023-05-24T04:01:38.340111+0000","last_clean":"2023-05-24T04:01:38.340111+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:01:38.340111+0000","last_undegraded":"2023-05-24T04:01:38.340111+0000","last_fullsized":"2023-05-24T04:01:38.340111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.339881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.339881+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.339881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:34.145972+0000","scrub_duration":0.0037010139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.727356+0000","last_change":"2023-05-24T04:01:32.727356+0000","last_active":"2023-05-24T04:01:32.727356+0000","last_peered":"2023-05-24T04:01:32.727356+0000","last_clean":"2023-05-24T04:01:32.727356+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:01:32.727356+0000","last_undegraded":"2023-05-24T04:01:32.727356+0000","last_fullsized":"2023-05-24T04:01:32.727356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.727017+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:35.787107+0000","scrub_duration":0.013968662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099324+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:00:40.099324+0000","last_peered":"2023-05-24T04:00:40.099324+0000","last_clean":"2023-05-24T04:00:40.099324+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:00:40.099324+0000","last_undegraded":"2023-05-24T04:00:40.099324+0000","last_fullsized":"2023-05-24T04:00:40.099324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:49.633427+0000","last_change":"2023-05-24T04:01:49.633595+0000","last_active":"2023-05-24T04:01:49.633427+0000","last_peered":"2023-05-24T04:01:49.633427+0000","last_clean":"2023-05-24T04:01:49.633427+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:01:49.633427+0000","last_undegraded":"2023-05-24T04:01:49.633427+0000","last_fullsized":"2023-05-24T04:01:49.633427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:49.633185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:49.633185+0000","last_clean_scrub_stamp":"2023-05-24T04:01:49.633185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:48.986898+0000","scrub_duration":0.0034477499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.583003+0000","last_change":"2023-05-24T04:01:32.583136+0000","last_active":"2023-05-24T04:01:32.583003+0000","last_peered":"2023-05-24T04:01:32.583003+0000","last_clean":"2023-05-24T04:01:32.583003+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:01:32.583003+0000","last_undegraded":"2023-05-24T04:01:32.583003+0000","last_fullsized":"2023-05-24T04:01:32.583003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.582758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:28.388850+0000","scrub_duration":0.0033355210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.812075+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:00:39.812075+0000","last_peered":"2023-05-24T04:00:39.812075+0000","last_clean":"2023-05-24T04:00:39.812075+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:00:39.812075+0000","last_undegraded":"2023-05-24T04:00:39.812075+0000","last_fullsized":"2023-05-24T04:00:39.812075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:21.224023+0000","last_change":"2023-05-24T04:01:21.224114+0000","last_active":"2023-05-24T04:01:21.224023+0000","last_peered":"2023-05-24T04:01:21.224023+0000","last_clean":"2023-05-24T04:01:21.224023+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:01:21.224023+0000","last_undegraded":"2023-05-24T04:01:21.224023+0000","last_fullsized":"2023-05-24T04:01:21.224023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_clean_scrub_stamp":"2023-05-24T04:01:21.223826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:20.577539+0000","scrub_duration":0.003384424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.418436+0000","last_change":"2023-05-24T04:01:43.418527+0000","last_active":"2023-05-24T04:01:43.418436+0000","last_peered":"2023-05-24T04:01:43.418436+0000","last_clean":"2023-05-24T04:01:43.418436+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:01:43.418436+0000","last_undegraded":"2023-05-24T04:01:43.418436+0000","last_fullsized":"2023-05-24T04:01:43.418436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.418236+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:31:45.503007+0000","scrub_duration":0.0037295280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103110+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:00:40.103110+0000","last_peered":"2023-05-24T04:00:40.103110+0000","last_clean":"2023-05-24T04:00:40.103110+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:00:40.103110+0000","last_undegraded":"2023-05-24T04:00:40.103110+0000","last_fullsized":"2023-05-24T04:00:40.103110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.182538+0000","last_change":"2023-05-24T04:01:22.182646+0000","last_active":"2023-05-24T04:01:22.182538+0000","last_peered":"2023-05-24T04:01:22.182538+0000","last_clean":"2023-05-24T04:01:22.182538+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:01:22.182538+0000","last_undegraded":"2023-05-24T04:01:22.182538+0000","last_fullsized":"2023-05-24T04:01:22.182538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.182299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:31.903576+0000","scrub_duration":0.0036481510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.639339+0000","last_change":"2023-05-24T04:01:28.639425+0000","last_active":"2023-05-24T04:01:28.639339+0000","last_peered":"2023-05-24T04:01:28.639339+0000","last_clean":"2023-05-24T04:01:28.639339+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:01:28.639339+0000","last_undegraded":"2023-05-24T04:01:28.639339+0000","last_fullsized":"2023-05-24T04:01:28.639339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.639145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:22:23.648965+0000","scrub_duration":0.0032025460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101076+0000","last_change":"2023-05-24T04:00:01.977171+0000","last_active":"2023-05-24T04:00:40.101076+0000","last_peered":"2023-05-24T04:00:40.101076+0000","last_clean":"2023-05-24T04:00:40.101076+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:00:40.101076+0000","last_undegraded":"2023-05-24T04:00:40.101076+0000","last_fullsized":"2023-05-24T04:00:40.101076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810617+0000","last_change":"2023-05-24T03:59:57.930347+0000","last_active":"2023-05-24T04:00:39.810617+0000","last_peered":"2023-05-24T04:00:39.810617+0000","last_clean":"2023-05-24T04:00:39.810617+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:00:39.810617+0000","last_undegraded":"2023-05-24T04:00:39.810617+0000","last_fullsized":"2023-05-24T04:00:39.810617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.466463+0000","last_change":"2023-05-24T04:01:45.466577+0000","last_active":"2023-05-24T04:01:45.466463+0000","last_peered":"2023-05-24T04:01:45.466463+0000","last_clean":"2023-05-24T04:01:45.466463+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:01:45.466463+0000","last_undegraded":"2023-05-24T04:01:45.466463+0000","last_fullsized":"2023-05-24T04:01:45.466463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:45.466250+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:45.466250+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.466250+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:23.952338+0000","scrub_duration":0.0064192219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:54.561128+0000","last_change":"2023-05-24T04:01:54.561285+0000","last_active":"2023-05-24T04:01:54.561128+0000","last_peered":"2023-05-24T04:01:54.561128+0000","last_clean":"2023-05-24T04:01:54.561128+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:01:54.561128+0000","last_undegraded":"2023-05-24T04:01:54.561128+0000","last_fullsized":"2023-05-24T04:01:54.561128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:54.560915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:54.560915+0000","last_clean_scrub_stamp":"2023-05-24T04:01:54.560915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:14:16.775744+0000","scrub_duration":0.0042359340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:18.500583+0000","last_change":"2023-05-24T04:01:18.500643+0000","last_active":"2023-05-24T04:01:18.500583+0000","last_peered":"2023-05-24T04:01:18.500583+0000","last_clean":"2023-05-24T04:01:18.500583+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:01:18.500583+0000","last_undegraded":"2023-05-24T04:01:18.500583+0000","last_fullsized":"2023-05-24T04:01:18.500583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_clean_scrub_stamp":"2023-05-24T04:01:18.500449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:56.026871+0000","scrub_duration":0.002394424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.398653+0000","last_change":"2023-05-24T04:01:44.398755+0000","last_active":"2023-05-24T04:01:44.398653+0000","last_peered":"2023-05-24T04:01:44.398653+0000","last_clean":"2023-05-24T04:01:44.398653+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:01:44.398653+0000","last_undegraded":"2023-05-24T04:01:44.398653+0000","last_fullsized":"2023-05-24T04:01:44.398653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.398442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.398442+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.398442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:40.692084+0000","scrub_duration":0.003757781,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.594545+0000","last_change":"2023-05-24T04:01:50.594674+0000","last_active":"2023-05-24T04:01:50.594545+0000","last_peered":"2023-05-24T04:01:50.594545+0000","last_clean":"2023-05-24T04:01:50.594545+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:01:50.594545+0000","last_undegraded":"2023-05-24T04:01:50.594545+0000","last_fullsized":"2023-05-24T04:01:50.594545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.594348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.594348+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.594348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:36:58.756373+0000","scrub_duration":0.003806481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.691383+0000","last_change":"2023-05-24T04:01:38.691478+0000","last_active":"2023-05-24T04:01:38.691383+0000","last_peered":"2023-05-24T04:01:38.691383+0000","last_clean":"2023-05-24T04:01:38.691383+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:01:38.691383+0000","last_undegraded":"2023-05-24T04:01:38.691383+0000","last_fullsized":"2023-05-24T04:01:38.691383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.691168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.691168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.691168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:33:29.718005+0000","scrub_duration":0.0036320480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.926186+0000","last_change":"2023-05-24T04:01:48.926300+0000","last_active":"2023-05-24T04:01:48.926186+0000","last_peered":"2023-05-24T04:01:48.926186+0000","last_clean":"2023-05-24T04:01:48.926186+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:01:48.926186+0000","last_undegraded":"2023-05-24T04:01:48.926186+0000","last_fullsized":"2023-05-24T04:01:48.926186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:48.925963+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:48.925963+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.925963+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:58.647240+0000","scrub_duration":0.0065857550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.805586+0000","last_change":"2023-05-24T04:00:01.967866+0000","last_active":"2023-05-24T04:00:39.805586+0000","last_peered":"2023-05-24T04:00:39.805586+0000","last_clean":"2023-05-24T04:00:39.805586+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:00:39.805586+0000","last_undegraded":"2023-05-24T04:00:39.805586+0000","last_fullsized":"2023-05-24T04:00:39.805586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808148+0000","last_change":"2023-05-24T03:59:57.939037+0000","last_active":"2023-05-24T04:00:39.808148+0000","last_peered":"2023-05-24T04:00:39.808148+0000","last_clean":"2023-05-24T04:00:39.808148+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:00:39.808148+0000","last_undegraded":"2023-05-24T04:00:39.808148+0000","last_fullsized":"2023-05-24T04:00:39.808148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.682550+0000","last_change":"2023-05-24T04:01:28.682735+0000","last_active":"2023-05-24T04:01:28.682550+0000","last_peered":"2023-05-24T04:01:28.682550+0000","last_clean":"2023-05-24T04:01:28.682550+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:01:28.682550+0000","last_undegraded":"2023-05-24T04:01:28.682550+0000","last_fullsized":"2023-05-24T04:01:28.682550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.682312+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:51.426096+0000","scrub_duration":0.0083039610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:52.564470+0000","last_change":"2023-05-24T04:01:52.564673+0000","last_active":"2023-05-24T04:01:52.564470+0000","last_peered":"2023-05-24T04:01:52.564470+0000","last_clean":"2023-05-24T04:01:52.564470+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:01:52.564470+0000","last_undegraded":"2023-05-24T04:01:52.564470+0000","last_fullsized":"2023-05-24T04:01:52.564470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:52.564264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:52.564264+0000","last_clean_scrub_stamp":"2023-05-24T04:01:52.564264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:02:28.767046+0000","scrub_duration":0.003889867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-05-24T04:01:20.107711+0000","last_change":"2023-05-24T04:01:56.385749+0000","last_active":"2023-05-24T04:01:20.107711+0000","last_peered":"2023-05-24T04:01:20.107711+0000","last_clean":"2023-05-24T04:01:20.107711+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:01:20.107711+0000","last_undegraded":"2023-05-24T04:01:20.107711+0000","last_fullsized":"2023-05-24T04:01:20.107711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.910276+0000","last_change":"2023-05-24T04:01:53.910386+0000","last_active":"2023-05-24T04:01:53.910276+0000","last_peered":"2023-05-24T04:01:53.910276+0000","last_clean":"2023-05-24T04:01:53.910276+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:01:53.910276+0000","last_undegraded":"2023-05-24T04:01:53.910276+0000","last_fullsized":"2023-05-24T04:01:53.910276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:53.910051+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:53.910051+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.910051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:32.396139+0000","scrub_duration":0.0071371179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099183+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:00:40.099183+0000","last_peered":"2023-05-24T04:00:40.099183+0000","last_clean":"2023-05-24T04:00:40.099183+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:00:40.099183+0000","last_undegraded":"2023-05-24T04:00:40.099183+0000","last_fullsized":"2023-05-24T04:00:40.099183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102879+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102879+0000","last_peered":"2023-05-24T04:00:40.102879+0000","last_clean":"2023-05-24T04:00:40.102879+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102879+0000","last_undegraded":"2023-05-24T04:00:40.102879+0000","last_fullsized":"2023-05-24T04:00:40.102879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.593437+0000","last_change":"2023-05-24T04:01:26.593566+0000","last_active":"2023-05-24T04:01:26.593437+0000","last_peered":"2023-05-24T04:01:26.593437+0000","last_clean":"2023-05-24T04:01:26.593437+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:01:26.593437+0000","last_undegraded":"2023-05-24T04:01:26.593437+0000","last_fullsized":"2023-05-24T04:01:26.593437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.593234+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:45.271490+0000","scrub_duration":0.010776361999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102682+0000","last_change":"2023-05-24T03:59:57.931398+0000","last_active":"2023-05-24T04:00:40.102682+0000","last_peered":"2023-05-24T04:00:40.102682+0000","last_clean":"2023-05-24T04:00:40.102682+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:00:40.102682+0000","last_undegraded":"2023-05-24T04:00:40.102682+0000","last_fullsized":"2023-05-24T04:00:40.102682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102376+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102376+0000","last_peered":"2023-05-24T04:00:40.102376+0000","last_clean":"2023-05-24T04:00:40.102376+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102376+0000","last_undegraded":"2023-05-24T04:00:40.102376+0000","last_fullsized":"2023-05-24T04:00:40.102376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:41.901071+0000","last_change":"2023-05-24T04:01:41.901166+0000","last_active":"2023-05-24T04:01:41.901071+0000","last_peered":"2023-05-24T04:01:41.901071+0000","last_clean":"2023-05-24T04:01:41.901071+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:01:41.901071+0000","last_undegraded":"2023-05-24T04:01:41.901071+0000","last_fullsized":"2023-05-24T04:01:41.901071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:41.900867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:41.900867+0000","last_clean_scrub_stamp":"2023-05-24T04:01:41.900867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:41.039500+0000","scrub_duration":0.0032151889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811756+0000","last_change":"2023-05-24T03:59:57.915094+0000","last_active":"2023-05-24T04:00:39.811756+0000","last_peered":"2023-05-24T04:00:39.811756+0000","last_clean":"2023-05-24T04:00:39.811756+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:00:39.811756+0000","last_undegraded":"2023-05-24T04:00:39.811756+0000","last_fullsized":"2023-05-24T04:00:39.811756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.471333+0000","last_change":"2023-05-24T04:01:24.471496+0000","last_active":"2023-05-24T04:01:24.471333+0000","last_peered":"2023-05-24T04:01:24.471333+0000","last_clean":"2023-05-24T04:01:24.471333+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:01:24.471333+0000","last_undegraded":"2023-05-24T04:01:24.471333+0000","last_fullsized":"2023-05-24T04:01:24.471333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.471086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:02.166879+0000","scrub_duration":0.003897663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.441669+0000","last_change":"2023-05-24T04:01:30.441761+0000","last_active":"2023-05-24T04:01:30.441669+0000","last_peered":"2023-05-24T04:01:30.441669+0000","last_clean":"2023-05-24T04:01:30.441669+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:01:30.441669+0000","last_undegraded":"2023-05-24T04:01:30.441669+0000","last_fullsized":"2023-05-24T04:01:30.441669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.441462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:33.501553+0000","scrub_duration":0.0033727969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100850+0000","last_change":"2023-05-24T04:00:01.983871+0000","last_active":"2023-05-24T04:00:40.100850+0000","last_peered":"2023-05-24T04:00:40.100850+0000","last_clean":"2023-05-24T04:00:40.100850+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:00:40.100850+0000","last_undegraded":"2023-05-24T04:00:40.100850+0000","last_fullsized":"2023-05-24T04:00:40.100850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:47.968777+0000","last_change":"2023-05-24T04:01:47.968912+0000","last_active":"2023-05-24T04:01:47.968777+0000","last_peered":"2023-05-24T04:01:47.968777+0000","last_clean":"2023-05-24T04:01:47.968777+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:01:47.968777+0000","last_undegraded":"2023-05-24T04:01:47.968777+0000","last_fullsized":"2023-05-24T04:01:47.968777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-05-24T04:01:47.968582+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-05-24T04:01:47.968582+0000","last_clean_scrub_stamp":"2023-05-24T04:01:47.968582+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:47.322295+0000","scrub_duration":0.010408659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.660388+0000","last_change":"2023-05-24T04:01:19.660455+0000","last_active":"2023-05-24T04:01:19.660388+0000","last_peered":"2023-05-24T04:01:19.660388+0000","last_clean":"2023-05-24T04:01:19.660388+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:01:19.660388+0000","last_undegraded":"2023-05-24T04:01:19.660388+0000","last_fullsized":"2023-05-24T04:01:19.660388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.660252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:10.528149+0000","scrub_duration":0.0021841819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102172+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102172+0000","last_peered":"2023-05-24T04:00:40.102172+0000","last_clean":"2023-05-24T04:00:40.102172+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102172+0000","last_undegraded":"2023-05-24T04:00:40.102172+0000","last_fullsized":"2023-05-24T04:00:40.102172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:37.714866+0000","last_change":"2023-05-24T04:01:37.715058+0000","last_active":"2023-05-24T04:01:37.714866+0000","last_peered":"2023-05-24T04:01:37.714866+0000","last_clean":"2023-05-24T04:01:37.714866+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:01:37.714866+0000","last_undegraded":"2023-05-24T04:01:37.714866+0000","last_fullsized":"2023-05-24T04:01:37.714866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:37.714599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:37.714599+0000","last_clean_scrub_stamp":"2023-05-24T04:01:37.714599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:10:58.960865+0000","scrub_duration":0.0035932920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.608379+0000","last_change":"2023-05-24T04:01:28.608543+0000","last_active":"2023-05-24T04:01:28.608379+0000","last_peered":"2023-05-24T04:01:28.608379+0000","last_clean":"2023-05-24T04:01:28.608379+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:01:28.608379+0000","last_undegraded":"2023-05-24T04:01:28.608379+0000","last_fullsized":"2023-05-24T04:01:28.608379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.608121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:02.217126+0000","scrub_duration":0.003151638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.809563+0000","last_change":"2023-05-24T03:59:57.924424+0000","last_active":"2023-05-24T04:00:39.809563+0000","last_peered":"2023-05-24T04:00:39.809563+0000","last_clean":"2023-05-24T04:00:39.809563+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:00:39.809563+0000","last_undegraded":"2023-05-24T04:00:39.809563+0000","last_fullsized":"2023-05-24T04:00:39.809563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.100311+0000","last_change":"2023-05-24T03:59:57.930811+0000","last_active":"2023-05-24T04:00:40.100311+0000","last_peered":"2023-05-24T04:00:40.100311+0000","last_clean":"2023-05-24T04:00:40.100311+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:00:40.100311+0000","last_undegraded":"2023-05-24T04:00:40.100311+0000","last_fullsized":"2023-05-24T04:00:40.100311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.665625+0000","last_change":"2023-05-24T04:01:38.665712+0000","last_active":"2023-05-24T04:01:38.665625+0000","last_peered":"2023-05-24T04:01:38.665625+0000","last_clean":"2023-05-24T04:01:38.665625+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:01:38.665625+0000","last_undegraded":"2023-05-24T04:01:38.665625+0000","last_fullsized":"2023-05-24T04:01:38.665625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.665421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.665421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.665421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:12.274426+0000","scrub_duration":0.0037066880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102613+0000","last_change":"2023-05-24T03:59:57.940624+0000","last_active":"2023-05-24T04:00:40.102613+0000","last_peered":"2023-05-24T04:00:40.102613+0000","last_clean":"2023-05-24T04:00:40.102613+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:00:40.102613+0000","last_undegraded":"2023-05-24T04:00:40.102613+0000","last_fullsized":"2023-05-24T04:00:40.102613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.670171+0000","last_change":"2023-05-24T04:01:34.670258+0000","last_active":"2023-05-24T04:01:34.670171+0000","last_peered":"2023-05-24T04:01:34.670171+0000","last_clean":"2023-05-24T04:01:34.670171+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:01:34.670171+0000","last_undegraded":"2023-05-24T04:01:34.670171+0000","last_fullsized":"2023-05-24T04:01:34.670171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.669939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:37.730029+0000","scrub_duration":0.0034536499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.682327+0000","last_change":"2023-05-24T04:01:48.682421+0000","last_active":"2023-05-24T04:01:48.682327+0000","last_peered":"2023-05-24T04:01:48.682327+0000","last_clean":"2023-05-24T04:01:48.682327+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:01:48.682327+0000","last_undegraded":"2023-05-24T04:01:48.682327+0000","last_fullsized":"2023-05-24T04:01:48.682327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:48.682117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:48.682117+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.682117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:44.975759+0000","scrub_duration":0.0036825590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.098718+0000","last_change":"2023-05-24T03:59:57.930850+0000","last_active":"2023-05-24T04:00:40.098718+0000","last_peered":"2023-05-24T04:00:40.098718+0000","last_clean":"2023-05-24T04:00:40.098718+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:00:40.098718+0000","last_undegraded":"2023-05-24T04:00:40.098718+0000","last_fullsized":"2023-05-24T04:00:40.098718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.374850+0000","last_change":"2023-05-24T04:01:55.375016+0000","last_active":"2023-05-24T04:01:55.374850+0000","last_peered":"2023-05-24T04:01:55.374850+0000","last_clean":"2023-05-24T04:01:55.374850+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:01:55.374850+0000","last_undegraded":"2023-05-24T04:01:55.374850+0000","last_fullsized":"2023-05-24T04:01:55.374850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:55.374597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:55.374597+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.374597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:01.349504+0000","scrub_duration":0.0031554949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.398495+0000","last_change":"2023-05-24T04:01:36.398595+0000","last_active":"2023-05-24T04:01:36.398495+0000","last_peered":"2023-05-24T04:01:36.398495+0000","last_clean":"2023-05-24T04:01:36.398495+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:01:36.398495+0000","last_undegraded":"2023-05-24T04:01:36.398495+0000","last_fullsized":"2023-05-24T04:01:36.398495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.398288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:35.536921+0000","scrub_duration":0.0033273310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:54.918812+0000","last_change":"2023-05-24T04:01:54.918914+0000","last_active":"2023-05-24T04:01:54.918812+0000","last_peered":"2023-05-24T04:01:54.918812+0000","last_clean":"2023-05-24T04:01:54.918812+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:01:54.918812+0000","last_undegraded":"2023-05-24T04:01:54.918812+0000","last_fullsized":"2023-05-24T04:01:54.918812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:54.918585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:54.918585+0000","last_clean_scrub_stamp":"2023-05-24T04:01:54.918585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:39.721448+0000","scrub_duration":0.0038101939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.130996+0000","last_change":"2023-05-24T04:01:29.131084+0000","last_active":"2023-05-24T04:01:29.130996+0000","last_peered":"2023-05-24T04:01:29.130996+0000","last_clean":"2023-05-24T04:01:29.130996+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:01:29.130996+0000","last_undegraded":"2023-05-24T04:01:29.130996+0000","last_fullsized":"2023-05-24T04:01:29.130996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.130752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:36.271021+0000","scrub_duration":0.003228191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.339754+0000","last_change":"2023-05-24T04:01:26.339849+0000","last_active":"2023-05-24T04:01:26.339754+0000","last_peered":"2023-05-24T04:01:26.339754+0000","last_clean":"2023-05-24T04:01:26.339754+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:01:26.339754+0000","last_undegraded":"2023-05-24T04:01:26.339754+0000","last_fullsized":"2023-05-24T04:01:26.339754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.339543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:20:58.800839+0000","scrub_duration":0.0038659369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.243947+0000","last_change":"2023-05-24T04:01:20.244112+0000","last_active":"2023-05-24T04:01:20.243947+0000","last_peered":"2023-05-24T04:01:20.243947+0000","last_clean":"2023-05-24T04:01:20.243947+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:01:20.243947+0000","last_undegraded":"2023-05-24T04:01:20.243947+0000","last_fullsized":"2023-05-24T04:01:20.243947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.243690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:16.537332+0000","scrub_duration":0.0033338600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.419334+0000","last_change":"2023-05-24T04:01:42.419433+0000","last_active":"2023-05-24T04:01:42.419334+0000","last_peered":"2023-05-24T04:01:42.419334+0000","last_clean":"2023-05-24T04:01:42.419334+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:01:42.419334+0000","last_undegraded":"2023-05-24T04:01:42.419334+0000","last_fullsized":"2023-05-24T04:01:42.419334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.419129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.419129+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.419129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:41.772842+0000","scrub_duration":0.0031554510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808340+0000","last_change":"2023-05-24T03:59:57.923416+0000","last_active":"2023-05-24T04:00:39.808340+0000","last_peered":"2023-05-24T04:00:39.808340+0000","last_clean":"2023-05-24T04:00:39.808340+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:00:39.808340+0000","last_undegraded":"2023-05-24T04:00:39.808340+0000","last_fullsized":"2023-05-24T04:00:39.808340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099861+0000","last_change":"2023-05-24T03:59:57.937759+0000","last_active":"2023-05-24T04:00:40.099861+0000","last_peered":"2023-05-24T04:00:40.099861+0000","last_clean":"2023-05-24T04:00:40.099861+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:00:40.099861+0000","last_undegraded":"2023-05-24T04:00:40.099861+0000","last_fullsized":"2023-05-24T04:00:40.099861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.465219+0000","last_change":"2023-05-24T04:01:26.465383+0000","last_active":"2023-05-24T04:01:26.465219+0000","last_peered":"2023-05-24T04:01:26.465219+0000","last_clean":"2023-05-24T04:01:26.465219+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:01:26.465219+0000","last_undegraded":"2023-05-24T04:01:26.465219+0000","last_fullsized":"2023-05-24T04:01:26.465219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.464980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:49.208763+0000","scrub_duration":0.003657731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.383570+0000","last_change":"2023-05-24T04:01:40.383667+0000","last_active":"2023-05-24T04:01:40.383570+0000","last_peered":"2023-05-24T04:01:40.383570+0000","last_clean":"2023-05-24T04:01:40.383570+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:01:40.383570+0000","last_undegraded":"2023-05-24T04:01:40.383570+0000","last_fullsized":"2023-05-24T04:01:40.383570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:40.383350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:40.383350+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.383350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:01:04.511715+0000","scrub_duration":0.0034523900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.449381+0000","last_change":"2023-05-24T04:01:44.449478+0000","last_active":"2023-05-24T04:01:44.449381+0000","last_peered":"2023-05-24T04:01:44.449381+0000","last_clean":"2023-05-24T04:01:44.449381+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:01:44.449381+0000","last_undegraded":"2023-05-24T04:01:44.449381+0000","last_fullsized":"2023-05-24T04:01:44.449381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.449173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.449173+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.449173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:11.033995+0000","scrub_duration":0.0038145229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.153399+0000","last_change":"2023-05-24T04:01:30.153492+0000","last_active":"2023-05-24T04:01:30.153399+0000","last_peered":"2023-05-24T04:01:30.153399+0000","last_clean":"2023-05-24T04:01:30.153399+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:01:30.153399+0000","last_undegraded":"2023-05-24T04:01:30.153399+0000","last_fullsized":"2023-05-24T04:01:30.153399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.153179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:26.061011+0000","scrub_duration":0.0036045560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103423+0000","last_change":"2023-05-24T03:59:57.928701+0000","last_active":"2023-05-24T04:00:40.103423+0000","last_peered":"2023-05-24T04:00:40.103423+0000","last_clean":"2023-05-24T04:00:40.103423+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:00:40.103423+0000","last_undegraded":"2023-05-24T04:00:40.103423+0000","last_fullsized":"2023-05-24T04:00:40.103423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.394667+0000","last_change":"2023-05-24T04:01:48.394790+0000","last_active":"2023-05-24T04:01:48.394667+0000","last_peered":"2023-05-24T04:01:48.394667+0000","last_clean":"2023-05-24T04:01:48.394667+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:01:48.394667+0000","last_undegraded":"2023-05-24T04:01:48.394667+0000","last_fullsized":"2023-05-24T04:01:48.394667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:48.394452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:48.394452+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.394452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:26.880540+0000","scrub_duration":0.0032445310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.394121+0000","last_change":"2023-05-24T04:01:34.394285+0000","last_active":"2023-05-24T04:01:34.394121+0000","last_peered":"2023-05-24T04:01:34.394121+0000","last_clean":"2023-05-24T04:01:34.394121+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:01:34.394121+0000","last_undegraded":"2023-05-24T04:01:34.394121+0000","last_fullsized":"2023-05-24T04:01:34.394121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.393879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:08.002884+0000","scrub_duration":0.0036074449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099537+0000","last_change":"2023-05-24T03:59:57.938002+0000","last_active":"2023-05-24T04:00:40.099537+0000","last_peered":"2023-05-24T04:00:40.099537+0000","last_clean":"2023-05-24T04:00:40.099537+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:00:40.099537+0000","last_undegraded":"2023-05-24T04:00:40.099537+0000","last_fullsized":"2023-05-24T04:00:40.099537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.166848+0000","last_change":"2023-05-24T04:01:35.166953+0000","last_active":"2023-05-24T04:01:35.166848+0000","last_peered":"2023-05-24T04:01:35.166848+0000","last_clean":"2023-05-24T04:01:35.166848+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:01:35.166848+0000","last_undegraded":"2023-05-24T04:01:35.166848+0000","last_fullsized":"2023-05-24T04:01:35.166848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.166621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:50:45.681248+0000","scrub_duration":0.0037053350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:41.427494+0000","last_change":"2023-05-24T04:01:41.427551+0000","last_active":"2023-05-24T04:01:41.427494+0000","last_peered":"2023-05-24T04:01:41.427494+0000","last_clean":"2023-05-24T04:01:41.427494+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:01:41.427494+0000","last_undegraded":"2023-05-24T04:01:41.427494+0000","last_fullsized":"2023-05-24T04:01:41.427494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:41.427368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:41.427368+0000","last_clean_scrub_stamp":"2023-05-24T04:01:41.427368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:37.721011+0000","scrub_duration":0.0035447759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.653593+0000","last_change":"2023-05-24T04:01:42.653683+0000","last_active":"2023-05-24T04:01:42.653593+0000","last_peered":"2023-05-24T04:01:42.653593+0000","last_clean":"2023-05-24T04:01:42.653593+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:01:42.653593+0000","last_undegraded":"2023-05-24T04:01:42.653593+0000","last_fullsized":"2023-05-24T04:01:42.653593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.653385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.653385+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.653385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:36:50.815411+0000","scrub_duration":0.0038377929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.811010+0000","last_change":"2023-05-24T03:59:57.928910+0000","last_active":"2023-05-24T04:00:39.811010+0000","last_peered":"2023-05-24T04:00:39.811010+0000","last_clean":"2023-05-24T04:00:39.811010+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:00:39.811010+0000","last_undegraded":"2023-05-24T04:00:39.811010+0000","last_fullsized":"2023-05-24T04:00:39.811010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.103091+0000","last_change":"2023-05-24T03:59:57.940934+0000","last_active":"2023-05-24T04:00:40.103091+0000","last_peered":"2023-05-24T04:00:40.103091+0000","last_clean":"2023-05-24T04:00:40.103091+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:00:40.103091+0000","last_undegraded":"2023-05-24T04:00:40.103091+0000","last_fullsized":"2023-05-24T04:00:40.103091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.356918+0000","last_change":"2023-05-24T04:01:36.357015+0000","last_active":"2023-05-24T04:01:36.356918+0000","last_peered":"2023-05-24T04:01:36.356918+0000","last_clean":"2023-05-24T04:01:36.356918+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:01:36.356918+0000","last_undegraded":"2023-05-24T04:01:36.356918+0000","last_fullsized":"2023-05-24T04:01:36.356918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.356683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:22:55.377329+0000","scrub_duration":0.0034088299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6382,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78700000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98099999999999998,"5min":1.355,"15min":1.355},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1459999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.88,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.266,"15min":1.266},"last":1.077},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.94399999999999995,"15min":0.95099999999999996},"min":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.258,"5min":1.28,"15min":1.28},"last":0.74399999999999999}]},{"osd":2,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94499999999999995,"15min":0.94299999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1739999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.022},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.88700000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.2809999999999999,"5min":1.895,"15min":1.895},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.016,"15min":1.026},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1930000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3360000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96599999999999997,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.995},"min":{"1min":0.69399999999999995,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3169999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.224,"5min":1.528,"15min":1.528},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0960000000000001,"15min":1.1060000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.228,"5min":1.375,"15min":1.375},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.196,"15min":1.204},"min":{"1min":0.98799999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.351,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1679999999999999,"15min":1.171},"min":{"1min":0.86499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.3680000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.96399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.874,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.624},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.85799999999999998},"min":{"1min":0.67400000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.133,"5min":1.25,"15min":1.25},"last":1.157},{"interface":"front","average":{"1min":1.022,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.78000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84199999999999997}]},{"osd":2,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92400000000000004,"15min":0.92600000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1419999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.98399999999999999}]},{"osd":3,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.98599999999999999,"15min":0.99399999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.165,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0600000000000001,"15min":1.0720000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1699999999999999,"5min":1.625,"15min":1.625},"last":1.034}]},{"osd":4,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0629999999999999,"15min":1.071},"min":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3160000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.232},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2350000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.92800000000000005}]},{"osd":5,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1850000000000001,"15min":1.2070000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.274,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1930000000000001,"15min":1.214},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.244,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.26}]},{"osd":7,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":1.0669999999999999,"5min":1.014,"15min":1.014},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.284,"15min":1.302},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5409999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2889999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.96299999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.877,"15min":0.874},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91400000000000003,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3009999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0740000000000001}]},{"osd":2,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.68400000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2070000000000001,"5min":1.446,"15min":1.446},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.046,"15min":1.0580000000000001},"min":{"1min":0.81499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.1559999999999999,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0249999999999999,"15min":1.0369999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.343,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.873},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.079,"15min":1.083},"min":{"1min":0.875,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.2729999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.999}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":0.97199999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.258,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.143,"15min":1.151},"min":{"1min":0.745,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4299999999999999,"5min":2.496,"15min":2.496},"last":0.97099999999999997}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.76800000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.476,"5min":1.927,"15min":1.927},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3879999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.0369999999999999}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2310000000000001,"15min":1.2390000000000001},"min":{"1min":1.0169999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4810000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.2010000000000001,"15min":1.2090000000000001},"min":{"1min":0.85899999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3520000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":0.91100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.59099999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.169,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":1.484,"15min":1.484},"last":0.96999999999999997}]},{"osd":1,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.63200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.22,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.64500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.234,"5min":1.29,"15min":1.29},"last":1.123}]},{"osd":2,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.64900000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.0920000000000001,"5min":1.542,"15min":1.542},"last":1.012},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.68500000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2370000000000001,"5min":1.323,"15min":1.323},"last":1.1559999999999999}]},{"osd":3,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93899999999999995,"15min":0.94299999999999995},"min":{"1min":0.629,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1719999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72599999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2569999999999999,"5min":1.407,"15min":1.407},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.99399999999999999,"15min":0.99099999999999999},"min":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.036}]},{"osd":6,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0720000000000001,"15min":1.075},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5309999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.167,"15min":1.165},"min":{"1min":1.0289999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.429,"5min":1.587,"15min":1.587},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.155,"15min":1.165},"min":{"1min":0.79400000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3720000000000001,"5min":1.829,"15min":1.829},"last":1.226},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.244,"15min":1.254},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.4390000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1930000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.89000000000000001,"5min":1.115,"15min":1.115},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.80500000000000005}]},{"osd":1,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93200000000000005,"5min":1.534,"15min":1.534},"last":0.621},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.40500000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.89500000000000002}]},{"osd":2,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97499999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.99299999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1819999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.216}]},{"osd":5,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0720000000000001,"5min":1.798,"15min":1.798},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3120000000000001,"5min":1.895,"15min":1.895},"last":1.024}]},{"osd":6,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0589999999999999,"15min":1.073},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2769999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.258,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1850000000000001}]},{"osd":7,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2390000000000001,"5min":1.734,"15min":1.734},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.107,"15min":1.117},"min":{"1min":0.73099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2949999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.286}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.47599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.123,"15min":1.123},"last":0.751},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.79600000000000004}]},{"osd":1,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.026,"5min":1.056,"15min":1.056},"last":0.873},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":2.246,"15min":2.246},"last":0.70699999999999996}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98599999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.071,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93899999999999995,"15min":0.93200000000000005},"min":{"1min":0.60699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":0.96199999999999997},"min":{"1min":0.67900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3169999999999999,"5min":1.542,"15min":1.542},"last":1.024}]},{"osd":5,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.98499999999999999,"15min":0.97599999999999998},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2729999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.97699999999999998},"min":{"1min":0.59499999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2250000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.747,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4530000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.085}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.046},"min":{"1min":0.73499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3240000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.129,"15min":1.131},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.395,"5min":1.879,"15min":1.879},"last":1.1299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0820000000000001,"5min":1.105,"15min":1.105},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.66000000000000003}]},{"osd":2,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.749},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96999999999999997,"5min":1.133,"15min":1.133},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.03,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.82699999999999996}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.98999999999999999,"15min":1.002},"min":{"1min":0.57799999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.228,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94399999999999995,"15min":0.94699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.258,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.63900000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0800000000000001,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4790000000000001,"5min":1.554,"15min":1.554},"last":1.1739999999999999}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.069,"15min":1.073},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.626,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.365,"5min":1.379,"15min":1.379},"last":1.024}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.622,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.089,"15min":1.0920000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3089999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.995}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.504}]},{"osd":2,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.53100000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.999,"5min":1.163,"15min":1.163},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.80700000000000005,"15min":0.78400000000000003},"min":{"1min":0.751,"5min":0.315,"15min":0.315},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.272,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.155,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.4450000000000001}]},{"osd":4,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.96699999999999997,"15min":0.94899999999999995},"min":{"1min":0.83699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.76900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.272,"5min":1.665,"15min":1.665},"last":1.7969999999999999}]},{"osd":5,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.70399999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.45,"5min":1.609,"15min":1.609},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.94499999999999995,"15min":0.92700000000000005},"min":{"1min":0.71799999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.109}]},{"osd":6,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.026,"15min":1.016},"min":{"1min":0.67300000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.393,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.145},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.173},"min":{"1min":0.88200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3129999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.855}]},{"osd":7,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0840000000000001,"15min":1.081},"min":{"1min":0.69999999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5289999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.091,"15min":1.0740000000000001},"min":{"1min":0.85199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6080000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.069}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:02:02.214 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.215 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.215 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.215 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.216 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.216 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.216 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.217 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.217 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.218 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.218 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.218 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.219 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.219 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.220 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.220 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.220 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.221 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.221 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.222 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.222 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.222 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.223 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.223 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.223 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.224 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.224 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.224 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.225 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.225 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.225 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.226 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.226 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.226 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.227 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.227 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.227 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.228 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.228 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.228 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.229 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.229 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.230 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.230 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:02.230 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T04:02:22.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:02:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.369+0000 7f9cf3023640 1 Processor -- start 2023-05-24T04:02:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.369+0000 7f9cf3023640 1 -- start start 2023-05-24T04:02:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf3023640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec0b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf3023640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cec0b5f40 0x7f9cec0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf3023640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0bd700 con 0x7f9cec0c17e0 2023-05-24T04:02:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf3023640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec14d020 con 0x7f9cec0b5f40 2023-05-24T04:02:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf3023640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0bd390 con 0x7f9cec142c60 2023-05-24T04:02:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cec0b5f40 0x7f9cec0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cec0b5f40 0x7f9cec0c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39302/0 (socket says 172.21.15.40:39302) 2023-05-24T04:02:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 -- 172.21.15.40:0/3144634471 learned_addr learned my addr 172.21.15.40:0/3144634471 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf0dbf640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec0b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 -- 172.21.15.40:0/3144634471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 msgr2=0x7f9cec0b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec0b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 -- 172.21.15.40:0/3144634471 >> v1:172.21.15.67:6789/0 conn(0x7f9cec0c17e0 legacy=0x7f9cec0bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 -- 172.21.15.40:0/3144634471 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0b6d70 con 0x7f9cec0b5f40 2023-05-24T04:02:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cf0dbf640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec0b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9cebfff640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec0c12a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009870 tx=0x7f9cd801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c11d465bcda031e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.373+0000 7f9ceb7fe640 1 -- 172.21.15.40:0/3144634471 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80ab650 con 0x7f9cec0b5f40 2023-05-24T04:02:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9ceb7fe640 1 -- 172.21.15.40:0/3144634471 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80ab7b0 con 0x7f9cec0b5f40 2023-05-24T04:02:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9ceb7fe640 1 -- 172.21.15.40:0/3144634471 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80abb40 con 0x7f9cec0b5f40 2023-05-24T04:02:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/3144634471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 msgr2=0x7f9cec0c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec0c12a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009870 tx=0x7f9cd801c470 comp rx=0 tx=0).stop 2023-05-24T04:02:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/3144634471 shutdown_connections 2023-05-24T04:02:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec0c12a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 --2- 172.21.15.40:0/3144634471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec0b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/3144634471 >> 172.21.15.40:0/3144634471 conn(0x7f9cec06a600 msgr2=0x7f9cec0c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/3144634471 shutdown_connections 2023-05-24T04:02:22.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/3144634471 wait complete. 2023-05-24T04:02:22.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 Processor -- start 2023-05-24T04:02:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- start start 2023-05-24T04:02:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cec0c17e0 0x7f9cec13c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec13cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0bbed0 con 0x7f9cec0b5f40 2023-05-24T04:02:22.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec13daf0 con 0x7f9cec0c17e0 2023-05-24T04:02:22.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec070c90 con 0x7f9cec142c60 2023-05-24T04:02:22.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:22.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec06fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39304/0 (socket says 172.21.15.40:39304) 2023-05-24T04:02:22.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 -- 172.21.15.40:0/192220510 learned_addr learned my addr 172.21.15.40:0/192220510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:22.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cebfff640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cec0c17e0 0x7f9cec13c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:22.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf15c0640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec13cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:22.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 -- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 msgr2=0x7f9cec13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:22.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec13cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 -- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cec0c17e0 msgr2=0x7f9cec13c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:22.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cec0c17e0 0x7f9cec13c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 -- 172.21.15.40:0/192220510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80094d0 con 0x7f9cec0b5f40 2023-05-24T04:02:22.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cebfff640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cec0c17e0 0x7f9cec13c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:02:22.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf0dbf640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec06fc00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c820 tx=0x7f9ce000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:22.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0005ba0 con 0x7f9cec0b5f40 2023-05-24T04:02:22.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0005d00 con 0x7f9cec0b5f40 2023-05-24T04:02:22.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0007a50 con 0x7f9cec0b5f40 2023-05-24T04:02:22.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec14d300 con 0x7f9cec0b5f40 2023-05-24T04:02:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.377+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec14cc80 con 0x7f9cec0b5f40 2023-05-24T04:02:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.381+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec14d490 con 0x7f9cec0b5f40 2023-05-24T04:02:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.381+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ce0007bb0 con 0x7f9cec0b5f40 2023-05-24T04:02:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.381+0000 7f9ce97fa640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9cd0066280 0x7f9cd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.381+0000 7f9cebfff640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9cd0066280 0x7f9cd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.381+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ce0083f20 con 0x7f9cec0b5f40 2023-05-24T04:02:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.381+0000 7f9cebfff640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9cd0066280 0x7f9cd0068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80af000 tx=0x7f9cd80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.385+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9ce0051060 con 0x7f9cec0b5f40 2023-05-24T04:02:22.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.537+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cec070e00 con 0x7f9cd0066280 2023-05-24T04:02:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.553+0000 7f9ce97fa640 1 -- 172.21.15.40:0/192220510 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392049 (secure 0 0 0) 0x7f9cec070e00 con 0x7f9cd0066280 2023-05-24T04:02:22.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:02:22.566 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:02:22.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9cd0066280 msgr2=0x7f9cd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:22.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9cd0066280 0x7f9cd0068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80af000 tx=0x7f9cd80a7000 comp rx=0 tx=0).stop 2023-05-24T04:02:22.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 msgr2=0x7f9cec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:22.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec06fc00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c820 tx=0x7f9ce000cce0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 shutdown_connections 2023-05-24T04:02:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f9cd0066280 0x7f9cd0068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cec142c60 0x7f9cec13cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cec0c17e0 0x7f9cec13c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 --2- 172.21.15.40:0/192220510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec0b5f40 0x7f9cec06fc00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 >> 172.21.15.40:0/192220510 conn(0x7f9cec06a600 msgr2=0x7f9cec0bf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 shutdown_connections 2023-05-24T04:02:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:22.557+0000 7f9cf3023640 1 -- 172.21.15.40:0/192220510 wait complete. 2023-05-24T04:02:22.582 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-05-24T04:02:20.576388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596750,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005375"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:05.698481+0000","last_change":"2023-05-24T04:02:05.698642+0000","last_active":"2023-05-24T04:02:05.698481+0000","last_peered":"2023-05-24T04:02:05.698481+0000","last_clean":"2023-05-24T04:02:05.698481+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:02:05.698481+0000","last_undegraded":"2023-05-24T04:02:05.698481+0000","last_fullsized":"2023-05-24T04:02:05.698481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:05.698261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:05.698261+0000","last_clean_scrub_stamp":"2023-05-24T04:02:05.698261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:11.673169+0000","scrub_duration":0.0038303130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.473721+0000","last_change":"2023-05-24T04:01:29.473721+0000","last_active":"2023-05-24T04:01:29.473721+0000","last_peered":"2023-05-24T04:01:29.473721+0000","last_clean":"2023-05-24T04:01:29.473721+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:01:29.473721+0000","last_undegraded":"2023-05-24T04:01:29.473721+0000","last_fullsized":"2023-05-24T04:01:29.473721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.473421+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:39.840985+0000","scrub_duration":0.0082611170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.808728+0000","last_change":"2023-05-24T03:59:57.935760+0000","last_active":"2023-05-24T04:00:39.808728+0000","last_peered":"2023-05-24T04:00:39.808728+0000","last_clean":"2023-05-24T04:00:39.808728+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:00:39.808728+0000","last_undegraded":"2023-05-24T04:00:39.808728+0000","last_fullsized":"2023-05-24T04:00:39.808728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.807833+0000","last_change":"2023-05-24T04:00:01.974761+0000","last_active":"2023-05-24T04:00:39.807833+0000","last_peered":"2023-05-24T04:00:39.807833+0000","last_clean":"2023-05-24T04:00:39.807833+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:00:39.807833+0000","last_undegraded":"2023-05-24T04:00:39.807833+0000","last_fullsized":"2023-05-24T04:00:39.807833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:39.501018+0000","last_change":"2023-05-24T04:01:39.501018+0000","last_active":"2023-05-24T04:01:39.501018+0000","last_peered":"2023-05-24T04:01:39.501018+0000","last_clean":"2023-05-24T04:01:39.501018+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:01:39.501018+0000","last_undegraded":"2023-05-24T04:01:39.501018+0000","last_fullsized":"2023-05-24T04:01:39.501018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:39.500706+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:39.500706+0000","last_clean_scrub_stamp":"2023-05-24T04:01:39.500706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:38.854419+0000","scrub_duration":0.0037390499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.568929+0000","last_change":"2023-05-24T04:01:24.569026+0000","last_active":"2023-05-24T04:01:24.568929+0000","last_peered":"2023-05-24T04:01:24.568929+0000","last_clean":"2023-05-24T04:01:24.568929+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:01:24.568929+0000","last_undegraded":"2023-05-24T04:01:24.568929+0000","last_fullsized":"2023-05-24T04:01:24.568929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.568716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:27.628807+0000","scrub_duration":0.0033214799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.101720+0000","last_change":"2023-05-24T04:00:01.992536+0000","last_active":"2023-05-24T04:00:40.101720+0000","last_peered":"2023-05-24T04:00:40.101720+0000","last_clean":"2023-05-24T04:00:40.101720+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:00:40.101720+0000","last_undegraded":"2023-05-24T04:00:40.101720+0000","last_fullsized":"2023-05-24T04:00:40.101720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:51.397239+0000","last_change":"2023-05-24T04:01:51.397341+0000","last_active":"2023-05-24T04:01:51.397239+0000","last_peered":"2023-05-24T04:01:51.397239+0000","last_clean":"2023-05-24T04:01:51.397239+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:01:51.397239+0000","last_undegraded":"2023-05-24T04:01:51.397239+0000","last_fullsized":"2023-05-24T04:01:51.397239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:51.397019+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:51.397019+0000","last_clean_scrub_stamp":"2023-05-24T04:01:51.397019+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:29.883107+0000","scrub_duration":0.0065764580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:09.245483+0000","last_change":"2023-05-24T04:02:09.245677+0000","last_active":"2023-05-24T04:02:09.245483+0000","last_peered":"2023-05-24T04:02:09.245483+0000","last_clean":"2023-05-24T04:02:09.245483+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:02:09.245483+0000","last_undegraded":"2023-05-24T04:02:09.245483+0000","last_fullsized":"2023-05-24T04:02:09.245483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:09.245229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:09.245229+0000","last_clean_scrub_stamp":"2023-05-24T04:02:09.245229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:52:41.502729+0000","scrub_duration":0.0036843750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099334+0000","last_change":"2023-05-24T04:00:01.986561+0000","last_active":"2023-05-24T04:00:40.099334+0000","last_peered":"2023-05-24T04:00:40.099334+0000","last_clean":"2023-05-24T04:00:40.099334+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:00:40.099334+0000","last_undegraded":"2023-05-24T04:00:40.099334+0000","last_fullsized":"2023-05-24T04:00:40.099334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.400500+0000","last_change":"2023-05-24T04:01:45.400608+0000","last_active":"2023-05-24T04:01:45.400500+0000","last_peered":"2023-05-24T04:01:45.400500+0000","last_clean":"2023-05-24T04:01:45.400500+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:01:45.400500+0000","last_undegraded":"2023-05-24T04:01:45.400500+0000","last_fullsized":"2023-05-24T04:01:45.400500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:45.400310+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:45.400310+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.400310+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:44.754023+0000","scrub_duration":0.0068925899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:12.277167+0000","last_change":"2023-05-24T04:02:12.277340+0000","last_active":"2023-05-24T04:02:12.277167+0000","last_peered":"2023-05-24T04:02:12.277167+0000","last_clean":"2023-05-24T04:02:12.277167+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:02:12.277167+0000","last_undegraded":"2023-05-24T04:02:12.277167+0000","last_fullsized":"2023-05-24T04:02:12.277167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:12.276916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:12.276916+0000","last_clean_scrub_stamp":"2023-05-24T04:02:12.276916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:01:05.309370+0000","scrub_duration":0.0039295160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.618365+0000","last_change":"2023-05-24T04:01:55.618615+0000","last_active":"2023-05-24T04:01:55.618365+0000","last_peered":"2023-05-24T04:01:55.618365+0000","last_clean":"2023-05-24T04:01:55.618365+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:01:55.618365+0000","last_undegraded":"2023-05-24T04:01:55.618365+0000","last_fullsized":"2023-05-24T04:01:55.618365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:55.618101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:55.618101+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.618101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:34.104189+0000","scrub_duration":0.0039436059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.542381+0000","last_change":"2023-05-24T04:01:22.542492+0000","last_active":"2023-05-24T04:01:22.542381+0000","last_peered":"2023-05-24T04:01:22.542381+0000","last_clean":"2023-05-24T04:01:22.542381+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:01:22.542381+0000","last_undegraded":"2023-05-24T04:01:22.542381+0000","last_fullsized":"2023-05-24T04:01:22.542381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.542168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:13.410065+0000","scrub_duration":0.003819444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.484589+0000","last_change":"2023-05-24T04:01:45.484684+0000","last_active":"2023-05-24T04:01:45.484589+0000","last_peered":"2023-05-24T04:01:45.484589+0000","last_clean":"2023-05-24T04:01:45.484589+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:01:45.484589+0000","last_undegraded":"2023-05-24T04:01:45.484589+0000","last_fullsized":"2023-05-24T04:01:45.484589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:45.484393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:45.484393+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.484393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:44.530511+0000","scrub_duration":0.0034391399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:39.810269+0000","last_change":"2023-05-24T04:00:01.971515+0000","last_active":"2023-05-24T04:00:39.810269+0000","last_peered":"2023-05-24T04:00:39.810269+0000","last_clean":"2023-05-24T04:00:39.810269+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:00:39.810269+0000","last_undegraded":"2023-05-24T04:00:39.810269+0000","last_fullsized":"2023-05-24T04:00:39.810269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.210580+0000","last_change":"2023-05-24T04:01:36.210680+0000","last_active":"2023-05-24T04:01:36.210580+0000","last_peered":"2023-05-24T04:01:36.210580+0000","last_clean":"2023-05-24T04:01:36.210580+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:01:36.210580+0000","last_undegraded":"2023-05-24T04:01:36.210580+0000","last_fullsized":"2023-05-24T04:01:36.210580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.210367+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:19.478523+0000","scrub_duration":0.003865659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.453894+0000","last_change":"2023-05-24T04:01:50.454078+0000","last_active":"2023-05-24T04:01:50.453894+0000","last_peered":"2023-05-24T04:01:50.453894+0000","last_clean":"2023-05-24T04:01:50.453894+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:01:50.453894+0000","last_undegraded":"2023-05-24T04:01:50.453894+0000","last_fullsized":"2023-05-24T04:01:50.453894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.453676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.453676+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.453676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:21.183230+0000","scrub_duration":0.003547335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.639129+0000","last_change":"2023-05-24T04:01:45.639129+0000","last_active":"2023-05-24T04:01:45.639129+0000","last_peered":"2023-05-24T04:01:45.639129+0000","last_clean":"2023-05-24T04:01:45.639129+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:01:45.639129+0000","last_undegraded":"2023-05-24T04:01:45.639129+0000","last_fullsized":"2023-05-24T04:01:45.639129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:45.638738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:45.638738+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.638738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:21.861642+0000","scrub_duration":0.0040594979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.702301+0000","last_change":"2023-05-24T04:01:29.702398+0000","last_active":"2023-05-24T04:01:29.702301+0000","last_peered":"2023-05-24T04:01:29.702301+0000","last_clean":"2023-05-24T04:01:29.702301+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:01:29.702301+0000","last_undegraded":"2023-05-24T04:01:29.702301+0000","last_fullsized":"2023-05-24T04:01:29.702301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.702108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:20.570006+0000","scrub_duration":0.0033797469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.353680+0000","last_change":"2023-05-24T04:01:53.353680+0000","last_active":"2023-05-24T04:01:53.353680+0000","last_peered":"2023-05-24T04:01:53.353680+0000","last_clean":"2023-05-24T04:01:53.353680+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:01:53.353680+0000","last_undegraded":"2023-05-24T04:01:53.353680+0000","last_fullsized":"2023-05-24T04:01:53.353680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:53.353364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:53.353364+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.353364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:49.261197+0000","scrub_duration":0.0034261130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:07.213403+0000","last_change":"2023-05-24T04:02:07.213531+0000","last_active":"2023-05-24T04:02:07.213403+0000","last_peered":"2023-05-24T04:02:07.213403+0000","last_clean":"2023-05-24T04:02:07.213403+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:02:07.213403+0000","last_undegraded":"2023-05-24T04:02:07.213403+0000","last_fullsized":"2023-05-24T04:02:07.213403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:07.213183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:07.213183+0000","last_clean_scrub_stamp":"2023-05-24T04:02:07.213183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:09.297954+0000","scrub_duration":0.0040632890000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:33.580827+0000","last_change":"2023-05-24T04:01:33.580913+0000","last_active":"2023-05-24T04:01:33.580827+0000","last_peered":"2023-05-24T04:01:33.580827+0000","last_clean":"2023-05-24T04:01:33.580827+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:01:33.580827+0000","last_undegraded":"2023-05-24T04:01:33.580827+0000","last_fullsized":"2023-05-24T04:01:33.580827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_clean_scrub_stamp":"2023-05-24T04:01:33.580634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:32.719267+0000","scrub_duration":0.0034014739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.701508+0000","last_change":"2023-05-24T04:01:32.701508+0000","last_active":"2023-05-24T04:01:32.701508+0000","last_peered":"2023-05-24T04:01:32.701508+0000","last_clean":"2023-05-24T04:01:32.701508+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:01:32.701508+0000","last_undegraded":"2023-05-24T04:01:32.701508+0000","last_fullsized":"2023-05-24T04:01:32.701508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.701223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:00:56.829588+0000","scrub_duration":0.0032971739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:08.304877+0000","last_change":"2023-05-24T04:02:08.304973+0000","last_active":"2023-05-24T04:02:08.304877+0000","last_peered":"2023-05-24T04:02:08.304877+0000","last_clean":"2023-05-24T04:02:08.304877+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:02:08.304877+0000","last_undegraded":"2023-05-24T04:02:08.304877+0000","last_fullsized":"2023-05-24T04:02:08.304877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:08.304660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:08.304660+0000","last_clean_scrub_stamp":"2023-05-24T04:02:08.304660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:44:02.723107+0000","scrub_duration":0.0032460050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:31.399044+0000","last_change":"2023-05-24T04:01:31.399136+0000","last_active":"2023-05-24T04:01:31.399044+0000","last_peered":"2023-05-24T04:01:31.399044+0000","last_clean":"2023-05-24T04:01:31.399044+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:01:31.399044+0000","last_undegraded":"2023-05-24T04:01:31.399044+0000","last_fullsized":"2023-05-24T04:01:31.399044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_clean_scrub_stamp":"2023-05-24T04:01:31.398830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:05.007835+0000","scrub_duration":0.0036452780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.661633+0000","last_change":"2023-05-24T04:01:46.661762+0000","last_active":"2023-05-24T04:01:46.661633+0000","last_peered":"2023-05-24T04:01:46.661633+0000","last_clean":"2023-05-24T04:01:46.661633+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:01:46.661633+0000","last_undegraded":"2023-05-24T04:01:46.661633+0000","last_fullsized":"2023-05-24T04:01:46.661633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:46.661420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:46.661420+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.661420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:14:08.876249+0000","scrub_duration":0.0037910399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.623427+0000","last_change":"2023-05-24T04:01:20.623465+0000","last_active":"2023-05-24T04:01:20.623427+0000","last_peered":"2023-05-24T04:01:20.623427+0000","last_clean":"2023-05-24T04:01:20.623427+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:01:20.623427+0000","last_undegraded":"2023-05-24T04:01:20.623427+0000","last_fullsized":"2023-05-24T04:01:20.623427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.623341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:43.367125+0000","scrub_duration":0.0026911190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:52.419838+0000","last_change":"2023-05-24T04:01:52.419937+0000","last_active":"2023-05-24T04:01:52.419838+0000","last_peered":"2023-05-24T04:01:52.419838+0000","last_clean":"2023-05-24T04:01:52.419838+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:01:52.419838+0000","last_undegraded":"2023-05-24T04:01:52.419838+0000","last_fullsized":"2023-05-24T04:01:52.419838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:52.419605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:52.419605+0000","last_clean_scrub_stamp":"2023-05-24T04:01:52.419605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:37.222469+0000","scrub_duration":0.0035731449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:14.165206+0000","last_change":"2023-05-24T04:02:14.165342+0000","last_active":"2023-05-24T04:02:14.165206+0000","last_peered":"2023-05-24T04:02:14.165206+0000","last_clean":"2023-05-24T04:02:14.165206+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:02:14.165206+0000","last_undegraded":"2023-05-24T04:02:14.165206+0000","last_fullsized":"2023-05-24T04:02:14.165206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:14.165004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:14.165004+0000","last_clean_scrub_stamp":"2023-05-24T04:02:14.165004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:16.249775+0000","scrub_duration":0.00379423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"29'5","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.924760+0000","last_change":"2023-05-24T04:01:46.924950+0000","last_active":"2023-05-24T04:01:46.924760+0000","last_peered":"2023-05-24T04:01:46.924760+0000","last_clean":"2023-05-24T04:01:46.924760+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:01:46.924760+0000","last_undegraded":"2023-05-24T04:01:46.924760+0000","last_fullsized":"2023-05-24T04:01:46.924760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-05-24T04:01:46.924540+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-05-24T04:01:46.924540+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.924540+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:43.218183+0000","scrub_duration":0.0085557979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.683506+0000","last_change":"2023-05-24T04:01:43.683595+0000","last_active":"2023-05-24T04:01:43.683506+0000","last_peered":"2023-05-24T04:01:43.683506+0000","last_clean":"2023-05-24T04:01:43.683506+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:01:43.683506+0000","last_undegraded":"2023-05-24T04:01:43.683506+0000","last_fullsized":"2023-05-24T04:01:43.683506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.683302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.683302+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.683302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:42.821935+0000","scrub_duration":0.0037036439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.099786+0000","last_change":"2023-05-24T04:00:01.957844+0000","last_active":"2023-05-24T04:00:40.099786+0000","last_peered":"2023-05-24T04:00:40.099786+0000","last_clean":"2023-05-24T04:00:40.099786+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:00:40.099786+0000","last_undegraded":"2023-05-24T04:00:40.099786+0000","last_fullsized":"2023-05-24T04:00:40.099786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'22","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.292848+0000","last_change":"2023-05-24T04:01:55.292848+0000","last_active":"2023-05-24T04:01:55.292848+0000","last_peered":"2023-05-24T04:01:55.292848+0000","last_clean":"2023-05-24T04:01:55.292848+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:01:55.292848+0000","last_undegraded":"2023-05-24T04:01:55.292848+0000","last_fullsized":"2023-05-24T04:01:55.292848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2023-05-24T04:01:55.292550+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2023-05-24T04:01:55.292550+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.292550+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:20:06.103036+0000","scrub_duration":0.011296013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.193685+0000","last_change":"2023-05-24T04:01:23.193776+0000","last_active":"2023-05-24T04:01:23.193685+0000","last_peered":"2023-05-24T04:01:23.193685+0000","last_clean":"2023-05-24T04:01:23.193685+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:01:23.193685+0000","last_undegraded":"2023-05-24T04:01:23.193685+0000","last_fullsized":"2023-05-24T04:01:23.193685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.193479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:14.734145+0000","scrub_duration":0.0035797390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:00.645274+0000","last_change":"2023-05-24T04:02:00.645438+0000","last_active":"2023-05-24T04:02:00.645274+0000","last_peered":"2023-05-24T04:02:00.645274+0000","last_clean":"2023-05-24T04:02:00.645274+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:02:00.645274+0000","last_undegraded":"2023-05-24T04:02:00.645274+0000","last_fullsized":"2023-05-24T04:02:00.645274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:00.645055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:00.645055+0000","last_clean_scrub_stamp":"2023-05-24T04:02:00.645055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:31.374610+0000","scrub_duration":0.0039620829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.191060+0000","last_change":"2023-05-24T04:01:25.191060+0000","last_active":"2023-05-24T04:01:25.191060+0000","last_peered":"2023-05-24T04:01:25.191060+0000","last_clean":"2023-05-24T04:01:25.191060+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:01:25.191060+0000","last_undegraded":"2023-05-24T04:01:25.191060+0000","last_fullsized":"2023-05-24T04:01:25.191060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.190751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:03.676839+0000","scrub_duration":0.0032725419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.589749+0000","last_change":"2023-05-24T04:01:22.589749+0000","last_active":"2023-05-24T04:01:22.589749+0000","last_peered":"2023-05-24T04:01:22.589749+0000","last_clean":"2023-05-24T04:01:22.589749+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:01:22.589749+0000","last_undegraded":"2023-05-24T04:01:22.589749+0000","last_fullsized":"2023-05-24T04:01:22.589749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.589468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:45:57.220840+0000","scrub_duration":0.0034413989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.443206+0000","last_change":"2023-05-24T04:01:35.443206+0000","last_active":"2023-05-24T04:01:35.443206+0000","last_peered":"2023-05-24T04:01:35.443206+0000","last_clean":"2023-05-24T04:01:35.443206+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:01:35.443206+0000","last_undegraded":"2023-05-24T04:01:35.443206+0000","last_fullsized":"2023-05-24T04:01:35.443206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.442898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:31.248990+0000","scrub_duration":0.0067569300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:15.289973+0000","last_change":"2023-05-24T04:02:15.290099+0000","last_active":"2023-05-24T04:02:15.289973+0000","last_peered":"2023-05-24T04:02:15.289973+0000","last_clean":"2023-05-24T04:02:15.289973+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:02:15.289973+0000","last_undegraded":"2023-05-24T04:02:15.289973+0000","last_fullsized":"2023-05-24T04:02:15.289973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:15.289743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:15.289743+0000","last_clean_scrub_stamp":"2023-05-24T04:02:15.289743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:27.973343+0000","scrub_duration":0.0042023939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:56.385698+0000","last_change":"2023-05-24T04:01:56.385698+0000","last_active":"2023-05-24T04:01:56.385698+0000","last_peered":"2023-05-24T04:01:56.385698+0000","last_clean":"2023-05-24T04:01:56.385698+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:01:56.385698+0000","last_undegraded":"2023-05-24T04:01:56.385698+0000","last_fullsized":"2023-05-24T04:01:56.385698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:56.385366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:56.385366+0000","last_clean_scrub_stamp":"2023-05-24T04:01:56.385366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:43:47.909596+0000","scrub_duration":0.0038443430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.651747+0000","last_change":"2023-05-24T04:01:20.651747+0000","last_active":"2023-05-24T04:01:20.651747+0000","last_peered":"2023-05-24T04:01:20.651747+0000","last_clean":"2023-05-24T04:01:20.651747+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:01:20.651747+0000","last_undegraded":"2023-05-24T04:01:20.651747+0000","last_fullsized":"2023-05-24T04:01:20.651747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.651438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:36:56.874342+0000","scrub_duration":0.0035848859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.471303+0000","last_change":"2023-05-24T04:01:40.471303+0000","last_active":"2023-05-24T04:01:40.471303+0000","last_peered":"2023-05-24T04:01:40.471303+0000","last_clean":"2023-05-24T04:01:40.471303+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:01:40.471303+0000","last_undegraded":"2023-05-24T04:01:40.471303+0000","last_fullsized":"2023-05-24T04:01:40.471303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:40.471004+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:40.471004+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.471004+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:50.192281+0000","scrub_duration":0.0070832450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.636299+0000","last_change":"2023-05-24T04:00:01.995901+0000","last_active":"2023-05-24T04:01:19.636299+0000","last_peered":"2023-05-24T04:01:19.636299+0000","last_clean":"2023-05-24T04:01:19.636299+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:01:19.636299+0000","last_undegraded":"2023-05-24T04:01:19.636299+0000","last_fullsized":"2023-05-24T04:01:19.636299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.480291+0000","last_change":"2023-05-24T04:01:19.480291+0000","last_active":"2023-05-24T04:01:19.480291+0000","last_peered":"2023-05-24T04:01:19.480291+0000","last_clean":"2023-05-24T04:01:19.480291+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:01:19.480291+0000","last_undegraded":"2023-05-24T04:01:19.480291+0000","last_fullsized":"2023-05-24T04:01:19.480291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.480118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:23.591362+0000","scrub_duration":0.0025500269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.880382+0000","last_change":"2023-05-24T04:01:40.880382+0000","last_active":"2023-05-24T04:01:40.880382+0000","last_peered":"2023-05-24T04:01:40.880382+0000","last_clean":"2023-05-24T04:01:40.880382+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:01:40.880382+0000","last_undegraded":"2023-05-24T04:01:40.880382+0000","last_fullsized":"2023-05-24T04:01:40.880382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:40.880088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:40.880088+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.880088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:36.686179+0000","scrub_duration":0.003581529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.699228+0000","last_change":"2023-05-24T04:01:30.699228+0000","last_active":"2023-05-24T04:01:30.699228+0000","last_peered":"2023-05-24T04:01:30.699228+0000","last_clean":"2023-05-24T04:01:30.699228+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:01:30.699228+0000","last_undegraded":"2023-05-24T04:01:30.699228+0000","last_fullsized":"2023-05-24T04:01:30.699228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.698924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:53.442708+0000","scrub_duration":0.0031884679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.604519+0000","last_change":"2023-05-24T04:01:44.604519+0000","last_active":"2023-05-24T04:01:44.604519+0000","last_peered":"2023-05-24T04:01:44.604519+0000","last_clean":"2023-05-24T04:01:44.604519+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:01:44.604519+0000","last_undegraded":"2023-05-24T04:01:44.604519+0000","last_fullsized":"2023-05-24T04:01:44.604519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.604016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.604016+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.604016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:02:20.806799+0000","scrub_duration":0.0037330570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.662282+0000","last_change":"2023-05-24T04:01:42.662282+0000","last_active":"2023-05-24T04:01:42.662282+0000","last_peered":"2023-05-24T04:01:42.662282+0000","last_clean":"2023-05-24T04:01:42.662282+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:01:42.662282+0000","last_undegraded":"2023-05-24T04:01:42.662282+0000","last_fullsized":"2023-05-24T04:01:42.662282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.661969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.661969+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.661969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:38.468061+0000","scrub_duration":0.0038420709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.679692+0000","last_change":"2023-05-24T04:01:25.679692+0000","last_active":"2023-05-24T04:01:25.679692+0000","last_peered":"2023-05-24T04:01:25.679692+0000","last_clean":"2023-05-24T04:01:25.679692+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:01:25.679692+0000","last_undegraded":"2023-05-24T04:01:25.679692+0000","last_fullsized":"2023-05-24T04:01:25.679692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.679377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:03.205799+0000","scrub_duration":0.0036885849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.433087+0000","last_change":"2023-05-24T04:01:46.433087+0000","last_active":"2023-05-24T04:01:46.433087+0000","last_peered":"2023-05-24T04:01:46.433087+0000","last_clean":"2023-05-24T04:01:46.433087+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:01:46.433087+0000","last_undegraded":"2023-05-24T04:01:46.433087+0000","last_fullsized":"2023-05-24T04:01:46.433087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:46.432784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:46.432784+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.432784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:56.154061+0000","scrub_duration":0.0039204219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:59.392402+0000","last_change":"2023-05-24T04:01:59.392402+0000","last_active":"2023-05-24T04:01:59.392402+0000","last_peered":"2023-05-24T04:01:59.392402+0000","last_clean":"2023-05-24T04:01:59.392402+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:01:59.392402+0000","last_undegraded":"2023-05-24T04:01:59.392402+0000","last_fullsized":"2023-05-24T04:01:59.392402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:59.392072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:59.392072+0000","last_clean_scrub_stamp":"2023-05-24T04:01:59.392072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:42.660228+0000","scrub_duration":0.0037627509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.639626+0000","last_change":"2023-05-24T04:01:50.639626+0000","last_active":"2023-05-24T04:01:50.639626+0000","last_peered":"2023-05-24T04:01:50.639626+0000","last_clean":"2023-05-24T04:01:50.639626+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:01:50.639626+0000","last_undegraded":"2023-05-24T04:01:50.639626+0000","last_fullsized":"2023-05-24T04:01:50.639626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.639510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.639510+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.639510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:00.360787+0000","scrub_duration":0.0018084279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:49.333308+0000","last_change":"2023-05-24T04:01:49.333308+0000","last_active":"2023-05-24T04:01:49.333308+0000","last_peered":"2023-05-24T04:01:49.333308+0000","last_clean":"2023-05-24T04:01:49.333308+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:01:49.333308+0000","last_undegraded":"2023-05-24T04:01:49.333308+0000","last_fullsized":"2023-05-24T04:01:49.333308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:49.332974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:49.332974+0000","last_clean_scrub_stamp":"2023-05-24T04:01:49.332974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:33.955176+0000","scrub_duration":0.0036926239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:39.366510+0000","last_change":"2023-05-24T04:01:39.366510+0000","last_active":"2023-05-24T04:01:39.366510+0000","last_peered":"2023-05-24T04:01:39.366510+0000","last_clean":"2023-05-24T04:01:39.366510+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:01:39.366510+0000","last_undegraded":"2023-05-24T04:01:39.366510+0000","last_fullsized":"2023-05-24T04:01:39.366510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:39.366218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:39.366218+0000","last_clean_scrub_stamp":"2023-05-24T04:01:39.366218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:38.504851+0000","scrub_duration":0.0036500320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:14.144472+0000","last_change":"2023-05-24T04:02:14.144606+0000","last_active":"2023-05-24T04:02:14.144472+0000","last_peered":"2023-05-24T04:02:14.144472+0000","last_clean":"2023-05-24T04:02:14.144472+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:02:14.144472+0000","last_undegraded":"2023-05-24T04:02:14.144472+0000","last_fullsized":"2023-05-24T04:02:14.144472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:14.144217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:14.144217+0000","last_clean_scrub_stamp":"2023-05-24T04:02:14.144217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:58.766419+0000","scrub_duration":0.0039355299999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:02.381869+0000","last_change":"2023-05-24T04:02:02.381970+0000","last_active":"2023-05-24T04:02:02.381869+0000","last_peered":"2023-05-24T04:02:02.381869+0000","last_clean":"2023-05-24T04:02:02.381869+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:02:02.381869+0000","last_undegraded":"2023-05-24T04:02:02.381869+0000","last_fullsized":"2023-05-24T04:02:02.381869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:02.381670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:02.381670+0000","last_clean_scrub_stamp":"2023-05-24T04:02:02.381670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:53.249567+0000","scrub_duration":0.0037902840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.712817+0000","last_change":"2023-05-24T04:01:26.712817+0000","last_active":"2023-05-24T04:01:26.712817+0000","last_peered":"2023-05-24T04:01:26.712817+0000","last_clean":"2023-05-24T04:01:26.712817+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:01:26.712817+0000","last_undegraded":"2023-05-24T04:01:26.712817+0000","last_fullsized":"2023-05-24T04:01:26.712817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.712506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:30.823750+0000","scrub_duration":0.0075320789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.403937+0000","last_change":"2023-05-24T04:01:23.403937+0000","last_active":"2023-05-24T04:01:23.403937+0000","last_peered":"2023-05-24T04:01:23.403937+0000","last_clean":"2023-05-24T04:01:23.403937+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:01:23.403937+0000","last_undegraded":"2023-05-24T04:01:23.403937+0000","last_fullsized":"2023-05-24T04:01:23.403937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.403578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:34:05.102350+0000","scrub_duration":0.003686197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.541116+0000","last_change":"2023-05-24T04:01:53.541116+0000","last_active":"2023-05-24T04:01:53.541116+0000","last_peered":"2023-05-24T04:01:53.541116+0000","last_clean":"2023-05-24T04:01:53.541116+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:01:53.541116+0000","last_undegraded":"2023-05-24T04:01:53.541116+0000","last_fullsized":"2023-05-24T04:01:53.541116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:53.540576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:53.540576+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.540576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:29.763480+0000","scrub_duration":0.0040370190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.439708+0000","last_change":"2023-05-24T04:01:43.439708+0000","last_active":"2023-05-24T04:01:43.439708+0000","last_peered":"2023-05-24T04:01:43.439708+0000","last_clean":"2023-05-24T04:01:43.439708+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:01:43.439708+0000","last_undegraded":"2023-05-24T04:01:43.439708+0000","last_fullsized":"2023-05-24T04:01:43.439708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.439415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.439415+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.439415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:53.160692+0000","scrub_duration":0.0031035960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.426714+0000","last_change":"2023-05-24T04:01:28.426714+0000","last_active":"2023-05-24T04:01:28.426714+0000","last_peered":"2023-05-24T04:01:28.426714+0000","last_clean":"2023-05-24T04:01:28.426714+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:01:28.426714+0000","last_undegraded":"2023-05-24T04:01:28.426714+0000","last_fullsized":"2023-05-24T04:01:28.426714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:31.486492+0000","scrub_duration":0.0036793720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.787411+0000","last_change":"2023-05-24T04:01:36.787411+0000","last_active":"2023-05-24T04:01:36.787411+0000","last_peered":"2023-05-24T04:01:36.787411+0000","last_clean":"2023-05-24T04:01:36.787411+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:01:36.787411+0000","last_undegraded":"2023-05-24T04:01:36.787411+0000","last_fullsized":"2023-05-24T04:01:36.787411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.787113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.787113+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.787113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:10.396118+0000","scrub_duration":0.0076298199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:16.538998+0000","last_change":"2023-05-24T04:02:16.539139+0000","last_active":"2023-05-24T04:02:16.538998+0000","last_peered":"2023-05-24T04:02:16.538998+0000","last_clean":"2023-05-24T04:02:16.538998+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:02:16.538998+0000","last_undegraded":"2023-05-24T04:02:16.538998+0000","last_fullsized":"2023-05-24T04:02:16.538998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:16.538761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:16.538761+0000","last_clean_scrub_stamp":"2023-05-24T04:02:16.538761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:44:10.957208+0000","scrub_duration":0.003811198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.619338+0000","last_change":"2023-05-24T04:01:30.619338+0000","last_active":"2023-05-24T04:01:30.619338+0000","last_peered":"2023-05-24T04:01:30.619338+0000","last_clean":"2023-05-24T04:01:30.619338+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:01:30.619338+0000","last_undegraded":"2023-05-24T04:01:30.619338+0000","last_fullsized":"2023-05-24T04:01:30.619338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.619015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:36:30.639136+0000","scrub_duration":0.0034554199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.514932+0000","last_change":"2023-05-24T04:01:38.514932+0000","last_active":"2023-05-24T04:01:38.514932+0000","last_peered":"2023-05-24T04:01:38.514932+0000","last_clean":"2023-05-24T04:01:38.514932+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:01:38.514932+0000","last_undegraded":"2023-05-24T04:01:38.514932+0000","last_fullsized":"2023-05-24T04:01:38.514932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.514605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.514605+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.514605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:34.808247+0000","scrub_duration":0.0034984259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.340209+0000","last_change":"2023-05-24T04:01:38.340209+0000","last_active":"2023-05-24T04:01:38.340209+0000","last_peered":"2023-05-24T04:01:38.340209+0000","last_clean":"2023-05-24T04:01:38.340209+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:01:38.340209+0000","last_undegraded":"2023-05-24T04:01:38.340209+0000","last_fullsized":"2023-05-24T04:01:38.340209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.339881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.339881+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.339881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:34.145972+0000","scrub_duration":0.0037010139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.727356+0000","last_change":"2023-05-24T04:01:32.727356+0000","last_active":"2023-05-24T04:01:32.727356+0000","last_peered":"2023-05-24T04:01:32.727356+0000","last_clean":"2023-05-24T04:01:32.727356+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:01:32.727356+0000","last_undegraded":"2023-05-24T04:01:32.727356+0000","last_fullsized":"2023-05-24T04:01:32.727356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.727017+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:35.787107+0000","scrub_duration":0.013968662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:21.009748+0000","last_change":"2023-05-24T04:00:01.995355+0000","last_active":"2023-05-24T04:01:21.009748+0000","last_peered":"2023-05-24T04:01:21.009748+0000","last_clean":"2023-05-24T04:01:21.009748+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:01:21.009748+0000","last_undegraded":"2023-05-24T04:01:21.009748+0000","last_fullsized":"2023-05-24T04:01:21.009748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:49.633595+0000","last_change":"2023-05-24T04:01:49.633595+0000","last_active":"2023-05-24T04:01:49.633595+0000","last_peered":"2023-05-24T04:01:49.633595+0000","last_clean":"2023-05-24T04:01:49.633595+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:01:49.633595+0000","last_undegraded":"2023-05-24T04:01:49.633595+0000","last_fullsized":"2023-05-24T04:01:49.633595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:49.633185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:49.633185+0000","last_clean_scrub_stamp":"2023-05-24T04:01:49.633185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:48.986898+0000","scrub_duration":0.0034477499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.583136+0000","last_change":"2023-05-24T04:01:32.583136+0000","last_active":"2023-05-24T04:01:32.583136+0000","last_peered":"2023-05-24T04:01:32.583136+0000","last_clean":"2023-05-24T04:01:32.583136+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:01:32.583136+0000","last_undegraded":"2023-05-24T04:01:32.583136+0000","last_fullsized":"2023-05-24T04:01:32.583136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.582758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:28.388850+0000","scrub_duration":0.0033355210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.636267+0000","last_change":"2023-05-24T04:00:01.974937+0000","last_active":"2023-05-24T04:01:19.636267+0000","last_peered":"2023-05-24T04:01:19.636267+0000","last_clean":"2023-05-24T04:01:19.636267+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:01:19.636267+0000","last_undegraded":"2023-05-24T04:01:19.636267+0000","last_fullsized":"2023-05-24T04:01:19.636267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:21.224114+0000","last_change":"2023-05-24T04:01:21.224114+0000","last_active":"2023-05-24T04:01:21.224114+0000","last_peered":"2023-05-24T04:01:21.224114+0000","last_clean":"2023-05-24T04:01:21.224114+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:01:21.224114+0000","last_undegraded":"2023-05-24T04:01:21.224114+0000","last_fullsized":"2023-05-24T04:01:21.224114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_clean_scrub_stamp":"2023-05-24T04:01:21.223826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:20.577539+0000","scrub_duration":0.003384424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.418527+0000","last_change":"2023-05-24T04:01:43.418527+0000","last_active":"2023-05-24T04:01:43.418527+0000","last_peered":"2023-05-24T04:01:43.418527+0000","last_clean":"2023-05-24T04:01:43.418527+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:01:43.418527+0000","last_undegraded":"2023-05-24T04:01:43.418527+0000","last_fullsized":"2023-05-24T04:01:43.418527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.418236+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:31:45.503007+0000","scrub_duration":0.0037295280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.108148+0000","last_change":"2023-05-24T04:00:01.980758+0000","last_active":"2023-05-24T04:01:20.108148+0000","last_peered":"2023-05-24T04:01:20.108148+0000","last_clean":"2023-05-24T04:01:20.108148+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:01:20.108148+0000","last_undegraded":"2023-05-24T04:01:20.108148+0000","last_fullsized":"2023-05-24T04:01:20.108148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.182646+0000","last_change":"2023-05-24T04:01:22.182646+0000","last_active":"2023-05-24T04:01:22.182646+0000","last_peered":"2023-05-24T04:01:22.182646+0000","last_clean":"2023-05-24T04:01:22.182646+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:01:22.182646+0000","last_undegraded":"2023-05-24T04:01:22.182646+0000","last_fullsized":"2023-05-24T04:01:22.182646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.182299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:31.903576+0000","scrub_duration":0.0036481510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.639425+0000","last_change":"2023-05-24T04:01:28.639425+0000","last_active":"2023-05-24T04:01:28.639425+0000","last_peered":"2023-05-24T04:01:28.639425+0000","last_clean":"2023-05-24T04:01:28.639425+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:01:28.639425+0000","last_undegraded":"2023-05-24T04:01:28.639425+0000","last_fullsized":"2023-05-24T04:01:28.639425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.639145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:22:23.648965+0000","scrub_duration":0.0032025460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:56.659530+0000","last_change":"2023-05-24T04:01:56.659530+0000","last_active":"2023-05-24T04:01:56.659530+0000","last_peered":"2023-05-24T04:01:56.659530+0000","last_clean":"2023-05-24T04:01:56.659530+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:01:56.659530+0000","last_undegraded":"2023-05-24T04:01:56.659530+0000","last_fullsized":"2023-05-24T04:01:56.659530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:56.659187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:56.659187+0000","last_clean_scrub_stamp":"2023-05-24T04:01:56.659187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:41.462050+0000","scrub_duration":0.0037789669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:07.232603+0000","last_change":"2023-05-24T04:02:07.232603+0000","last_active":"2023-05-24T04:02:07.232603+0000","last_peered":"2023-05-24T04:02:07.232603+0000","last_clean":"2023-05-24T04:02:07.232603+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:02:07.232603+0000","last_undegraded":"2023-05-24T04:02:07.232603+0000","last_fullsized":"2023-05-24T04:02:07.232603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:07.232132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:07.232132+0000","last_clean_scrub_stamp":"2023-05-24T04:02:07.232132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:55.990002+0000","scrub_duration":0.0034619910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.466577+0000","last_change":"2023-05-24T04:01:45.466577+0000","last_active":"2023-05-24T04:01:45.466577+0000","last_peered":"2023-05-24T04:01:45.466577+0000","last_clean":"2023-05-24T04:01:45.466577+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:01:45.466577+0000","last_undegraded":"2023-05-24T04:01:45.466577+0000","last_fullsized":"2023-05-24T04:01:45.466577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:45.466250+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:45.466250+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.466250+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:23.952338+0000","scrub_duration":0.0064192219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:54.561285+0000","last_change":"2023-05-24T04:01:54.561285+0000","last_active":"2023-05-24T04:01:54.561285+0000","last_peered":"2023-05-24T04:01:54.561285+0000","last_clean":"2023-05-24T04:01:54.561285+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:01:54.561285+0000","last_undegraded":"2023-05-24T04:01:54.561285+0000","last_fullsized":"2023-05-24T04:01:54.561285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:54.560915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:54.560915+0000","last_clean_scrub_stamp":"2023-05-24T04:01:54.560915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:14:16.775744+0000","scrub_duration":0.0042359340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:18.500643+0000","last_change":"2023-05-24T04:01:18.500643+0000","last_active":"2023-05-24T04:01:18.500643+0000","last_peered":"2023-05-24T04:01:18.500643+0000","last_clean":"2023-05-24T04:01:18.500643+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:01:18.500643+0000","last_undegraded":"2023-05-24T04:01:18.500643+0000","last_fullsized":"2023-05-24T04:01:18.500643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_clean_scrub_stamp":"2023-05-24T04:01:18.500449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:56.026871+0000","scrub_duration":0.002394424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.398755+0000","last_change":"2023-05-24T04:01:44.398755+0000","last_active":"2023-05-24T04:01:44.398755+0000","last_peered":"2023-05-24T04:01:44.398755+0000","last_clean":"2023-05-24T04:01:44.398755+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:01:44.398755+0000","last_undegraded":"2023-05-24T04:01:44.398755+0000","last_fullsized":"2023-05-24T04:01:44.398755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.398442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.398442+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.398442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:40.692084+0000","scrub_duration":0.003757781,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.594674+0000","last_change":"2023-05-24T04:01:50.594674+0000","last_active":"2023-05-24T04:01:50.594674+0000","last_peered":"2023-05-24T04:01:50.594674+0000","last_clean":"2023-05-24T04:01:50.594674+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:01:50.594674+0000","last_undegraded":"2023-05-24T04:01:50.594674+0000","last_fullsized":"2023-05-24T04:01:50.594674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.594348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.594348+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.594348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:36:58.756373+0000","scrub_duration":0.003806481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.691478+0000","last_change":"2023-05-24T04:01:38.691478+0000","last_active":"2023-05-24T04:01:38.691478+0000","last_peered":"2023-05-24T04:01:38.691478+0000","last_clean":"2023-05-24T04:01:38.691478+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:01:38.691478+0000","last_undegraded":"2023-05-24T04:01:38.691478+0000","last_fullsized":"2023-05-24T04:01:38.691478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.691168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.691168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.691168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:33:29.718005+0000","scrub_duration":0.0036320480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.926300+0000","last_change":"2023-05-24T04:01:48.926300+0000","last_active":"2023-05-24T04:01:48.926300+0000","last_peered":"2023-05-24T04:01:48.926300+0000","last_clean":"2023-05-24T04:01:48.926300+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:01:48.926300+0000","last_undegraded":"2023-05-24T04:01:48.926300+0000","last_fullsized":"2023-05-24T04:01:48.926300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:48.925963+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:48.925963+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.925963+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:58.647240+0000","scrub_duration":0.0065857550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:57.541361+0000","last_change":"2023-05-24T04:01:57.541361+0000","last_active":"2023-05-24T04:01:57.541361+0000","last_peered":"2023-05-24T04:01:57.541361+0000","last_clean":"2023-05-24T04:01:57.541361+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:01:57.541361+0000","last_undegraded":"2023-05-24T04:01:57.541361+0000","last_fullsized":"2023-05-24T04:01:57.541361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:57.540891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:57.540891+0000","last_clean_scrub_stamp":"2023-05-24T04:01:57.540891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:35.067313+0000","scrub_duration":0.0044948619999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:11.234556+0000","last_change":"2023-05-24T04:02:11.234556+0000","last_active":"2023-05-24T04:02:11.234556+0000","last_peered":"2023-05-24T04:02:11.234556+0000","last_clean":"2023-05-24T04:02:11.234556+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:02:11.234556+0000","last_undegraded":"2023-05-24T04:02:11.234556+0000","last_fullsized":"2023-05-24T04:02:11.234556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:11.234166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:11.234166+0000","last_clean_scrub_stamp":"2023-05-24T04:02:11.234166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:35:02.160810+0000","scrub_duration":0.0040227229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.682735+0000","last_change":"2023-05-24T04:01:28.682735+0000","last_active":"2023-05-24T04:01:28.682735+0000","last_peered":"2023-05-24T04:01:28.682735+0000","last_clean":"2023-05-24T04:01:28.682735+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:01:28.682735+0000","last_undegraded":"2023-05-24T04:01:28.682735+0000","last_fullsized":"2023-05-24T04:01:28.682735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.682312+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:51.426096+0000","scrub_duration":0.0083039610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:52.564673+0000","last_change":"2023-05-24T04:01:52.564673+0000","last_active":"2023-05-24T04:01:52.564673+0000","last_peered":"2023-05-24T04:01:52.564673+0000","last_clean":"2023-05-24T04:01:52.564673+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:01:52.564673+0000","last_undegraded":"2023-05-24T04:01:52.564673+0000","last_fullsized":"2023-05-24T04:01:52.564673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:52.564264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:52.564264+0000","last_clean_scrub_stamp":"2023-05-24T04:01:52.564264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:02:28.767046+0000","scrub_duration":0.003889867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:56.385749+0000","last_change":"2023-05-24T04:02:11.575660+0000","last_active":"2023-05-24T04:01:56.385749+0000","last_peered":"2023-05-24T04:01:56.385749+0000","last_clean":"2023-05-24T04:01:56.385749+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:01:56.385749+0000","last_undegraded":"2023-05-24T04:01:56.385749+0000","last_fullsized":"2023-05-24T04:01:56.385749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:59:57.492936+0000","last_clean_scrub_stamp":"2023-05-24T03:59:57.492936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.910386+0000","last_change":"2023-05-24T04:01:53.910386+0000","last_active":"2023-05-24T04:01:53.910386+0000","last_peered":"2023-05-24T04:01:53.910386+0000","last_clean":"2023-05-24T04:01:53.910386+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:01:53.910386+0000","last_undegraded":"2023-05-24T04:01:53.910386+0000","last_fullsized":"2023-05-24T04:01:53.910386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:53.910051+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:53.910051+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.910051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:32.396139+0000","scrub_duration":0.0071371179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:21.009664+0000","last_change":"2023-05-24T04:00:01.985741+0000","last_active":"2023-05-24T04:01:21.009664+0000","last_peered":"2023-05-24T04:01:21.009664+0000","last_clean":"2023-05-24T04:01:21.009664+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:01:21.009664+0000","last_undegraded":"2023-05-24T04:01:21.009664+0000","last_fullsized":"2023-05-24T04:01:21.009664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102879+0000","last_change":"2023-05-24T04:00:01.959614+0000","last_active":"2023-05-24T04:00:40.102879+0000","last_peered":"2023-05-24T04:00:40.102879+0000","last_clean":"2023-05-24T04:00:40.102879+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:00:40.102879+0000","last_undegraded":"2023-05-24T04:00:40.102879+0000","last_fullsized":"2023-05-24T04:00:40.102879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'12","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.593566+0000","last_change":"2023-05-24T04:01:26.593566+0000","last_active":"2023-05-24T04:01:26.593566+0000","last_peered":"2023-05-24T04:01:26.593566+0000","last_clean":"2023-05-24T04:01:26.593566+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:01:26.593566+0000","last_undegraded":"2023-05-24T04:01:26.593566+0000","last_fullsized":"2023-05-24T04:01:26.593566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.593234+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:45.271490+0000","scrub_duration":0.010776361999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:02.285963+0000","last_change":"2023-05-24T04:02:02.286068+0000","last_active":"2023-05-24T04:02:02.285963+0000","last_peered":"2023-05-24T04:02:02.285963+0000","last_clean":"2023-05-24T04:02:02.285963+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:02:02.285963+0000","last_undegraded":"2023-05-24T04:02:02.285963+0000","last_fullsized":"2023-05-24T04:02:02.285963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:02.285741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:02.285741+0000","last_clean_scrub_stamp":"2023-05-24T04:02:02.285741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:04.370512+0000","scrub_duration":0.0036832649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102376+0000","last_change":"2023-05-24T04:00:01.984976+0000","last_active":"2023-05-24T04:00:40.102376+0000","last_peered":"2023-05-24T04:00:40.102376+0000","last_clean":"2023-05-24T04:00:40.102376+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:00:40.102376+0000","last_undegraded":"2023-05-24T04:00:40.102376+0000","last_fullsized":"2023-05-24T04:00:40.102376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:41.901166+0000","last_change":"2023-05-24T04:01:41.901166+0000","last_active":"2023-05-24T04:01:41.901166+0000","last_peered":"2023-05-24T04:01:41.901166+0000","last_clean":"2023-05-24T04:01:41.901166+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:01:41.901166+0000","last_undegraded":"2023-05-24T04:01:41.901166+0000","last_fullsized":"2023-05-24T04:01:41.901166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:41.900867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:41.900867+0000","last_clean_scrub_stamp":"2023-05-24T04:01:41.900867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:41.039500+0000","scrub_duration":0.0032151889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:58.377052+0000","last_change":"2023-05-24T04:01:58.377145+0000","last_active":"2023-05-24T04:01:58.377052+0000","last_peered":"2023-05-24T04:01:58.377052+0000","last_clean":"2023-05-24T04:01:58.377052+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:01:58.377052+0000","last_undegraded":"2023-05-24T04:01:58.377052+0000","last_fullsized":"2023-05-24T04:01:58.377052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:58.376848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:58.376848+0000","last_clean_scrub_stamp":"2023-05-24T04:01:58.376848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:51:08.891475+0000","scrub_duration":0.0034678589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.471496+0000","last_change":"2023-05-24T04:01:24.471496+0000","last_active":"2023-05-24T04:01:24.471496+0000","last_peered":"2023-05-24T04:01:24.471496+0000","last_clean":"2023-05-24T04:01:24.471496+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:01:24.471496+0000","last_undegraded":"2023-05-24T04:01:24.471496+0000","last_fullsized":"2023-05-24T04:01:24.471496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.471086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:02.166879+0000","scrub_duration":0.003897663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.441669+0000","last_change":"2023-05-24T04:01:30.441761+0000","last_active":"2023-05-24T04:01:30.441669+0000","last_peered":"2023-05-24T04:01:30.441669+0000","last_clean":"2023-05-24T04:01:30.441669+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:01:30.441669+0000","last_undegraded":"2023-05-24T04:01:30.441669+0000","last_fullsized":"2023-05-24T04:01:30.441669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.441462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:33.501553+0000","scrub_duration":0.0033727969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:16.338346+0000","last_change":"2023-05-24T04:02:16.338480+0000","last_active":"2023-05-24T04:02:16.338346+0000","last_peered":"2023-05-24T04:02:16.338346+0000","last_clean":"2023-05-24T04:02:16.338346+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:02:16.338346+0000","last_undegraded":"2023-05-24T04:02:16.338346+0000","last_fullsized":"2023-05-24T04:02:16.338346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:16.338109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:16.338109+0000","last_clean_scrub_stamp":"2023-05-24T04:02:16.338109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:20:04.528677+0000","scrub_duration":0.004010535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:47.968912+0000","last_change":"2023-05-24T04:01:47.968912+0000","last_active":"2023-05-24T04:01:47.968912+0000","last_peered":"2023-05-24T04:01:47.968912+0000","last_clean":"2023-05-24T04:01:47.968912+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:01:47.968912+0000","last_undegraded":"2023-05-24T04:01:47.968912+0000","last_fullsized":"2023-05-24T04:01:47.968912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-05-24T04:01:47.968582+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-05-24T04:01:47.968582+0000","last_clean_scrub_stamp":"2023-05-24T04:01:47.968582+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:47.322295+0000","scrub_duration":0.010408659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.660388+0000","last_change":"2023-05-24T04:01:19.660455+0000","last_active":"2023-05-24T04:01:19.660388+0000","last_peered":"2023-05-24T04:01:19.660388+0000","last_clean":"2023-05-24T04:01:19.660388+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:01:19.660388+0000","last_undegraded":"2023-05-24T04:01:19.660388+0000","last_fullsized":"2023-05-24T04:01:19.660388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.660252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:10.528149+0000","scrub_duration":0.0021841819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:00:40.102172+0000","last_change":"2023-05-24T04:00:01.956370+0000","last_active":"2023-05-24T04:00:40.102172+0000","last_peered":"2023-05-24T04:00:40.102172+0000","last_clean":"2023-05-24T04:00:40.102172+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:00:40.102172+0000","last_undegraded":"2023-05-24T04:00:40.102172+0000","last_fullsized":"2023-05-24T04:00:40.102172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:00:00.903985+0000","last_clean_scrub_stamp":"2023-05-24T04:00:00.903985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:37.715058+0000","last_change":"2023-05-24T04:01:37.715058+0000","last_active":"2023-05-24T04:01:37.715058+0000","last_peered":"2023-05-24T04:01:37.715058+0000","last_clean":"2023-05-24T04:01:37.715058+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:01:37.715058+0000","last_undegraded":"2023-05-24T04:01:37.715058+0000","last_fullsized":"2023-05-24T04:01:37.715058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:37.714599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:37.714599+0000","last_clean_scrub_stamp":"2023-05-24T04:01:37.714599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:10:58.960865+0000","scrub_duration":0.0035932920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.608543+0000","last_change":"2023-05-24T04:01:28.608543+0000","last_active":"2023-05-24T04:01:28.608543+0000","last_peered":"2023-05-24T04:01:28.608543+0000","last_clean":"2023-05-24T04:01:28.608543+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:01:28.608543+0000","last_undegraded":"2023-05-24T04:01:28.608543+0000","last_fullsized":"2023-05-24T04:01:28.608543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.608121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:02.217126+0000","scrub_duration":0.003151638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:03.197202+0000","last_change":"2023-05-24T04:02:03.197202+0000","last_active":"2023-05-24T04:02:03.197202+0000","last_peered":"2023-05-24T04:02:03.197202+0000","last_clean":"2023-05-24T04:02:03.197202+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:02:03.197202+0000","last_undegraded":"2023-05-24T04:02:03.197202+0000","last_fullsized":"2023-05-24T04:02:03.197202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:03.196919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:03.196919+0000","last_clean_scrub_stamp":"2023-05-24T04:02:03.196919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:13:57.881045+0000","scrub_duration":0.0031955859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:57.366451+0000","last_change":"2023-05-24T04:01:57.366451+0000","last_active":"2023-05-24T04:01:57.366451+0000","last_peered":"2023-05-24T04:01:57.366451+0000","last_clean":"2023-05-24T04:01:57.366451+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:01:57.366451+0000","last_undegraded":"2023-05-24T04:01:57.366451+0000","last_fullsized":"2023-05-24T04:01:57.366451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:57.366142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:57.366142+0000","last_clean_scrub_stamp":"2023-05-24T04:01:57.366142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:44:40.431018+0000","scrub_duration":0.0038440430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.665712+0000","last_change":"2023-05-24T04:01:38.665712+0000","last_active":"2023-05-24T04:01:38.665712+0000","last_peered":"2023-05-24T04:01:38.665712+0000","last_clean":"2023-05-24T04:01:38.665712+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:01:38.665712+0000","last_undegraded":"2023-05-24T04:01:38.665712+0000","last_fullsized":"2023-05-24T04:01:38.665712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.665421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.665421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.665421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:12.274426+0000","scrub_duration":0.0037066880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:01.429912+0000","last_change":"2023-05-24T04:02:01.429912+0000","last_active":"2023-05-24T04:02:01.429912+0000","last_peered":"2023-05-24T04:02:01.429912+0000","last_clean":"2023-05-24T04:02:01.429912+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:02:01.429912+0000","last_undegraded":"2023-05-24T04:02:01.429912+0000","last_fullsized":"2023-05-24T04:02:01.429912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:01.429604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:01.429604+0000","last_clean_scrub_stamp":"2023-05-24T04:02:01.429604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:07.404512+0000","scrub_duration":0.003172879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.670258+0000","last_change":"2023-05-24T04:01:34.670258+0000","last_active":"2023-05-24T04:01:34.670258+0000","last_peered":"2023-05-24T04:01:34.670258+0000","last_clean":"2023-05-24T04:01:34.670258+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:01:34.670258+0000","last_undegraded":"2023-05-24T04:01:34.670258+0000","last_fullsized":"2023-05-24T04:01:34.670258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.669939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:37.730029+0000","scrub_duration":0.0034536499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.682421+0000","last_change":"2023-05-24T04:01:48.682421+0000","last_active":"2023-05-24T04:01:48.682421+0000","last_peered":"2023-05-24T04:01:48.682421+0000","last_clean":"2023-05-24T04:01:48.682421+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:01:48.682421+0000","last_undegraded":"2023-05-24T04:01:48.682421+0000","last_fullsized":"2023-05-24T04:01:48.682421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:48.682117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:48.682117+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.682117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:44.975759+0000","scrub_duration":0.0036825590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:06.007614+0000","last_change":"2023-05-24T04:02:06.007614+0000","last_active":"2023-05-24T04:02:06.007614+0000","last_peered":"2023-05-24T04:02:06.007614+0000","last_clean":"2023-05-24T04:02:06.007614+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:02:06.007614+0000","last_undegraded":"2023-05-24T04:02:06.007614+0000","last_fullsized":"2023-05-24T04:02:06.007614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:06.007306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:06.007306+0000","last_clean_scrub_stamp":"2023-05-24T04:02:06.007306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:49.275462+0000","scrub_duration":0.0037354580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.375016+0000","last_change":"2023-05-24T04:01:55.375016+0000","last_active":"2023-05-24T04:01:55.375016+0000","last_peered":"2023-05-24T04:01:55.375016+0000","last_clean":"2023-05-24T04:01:55.375016+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:01:55.375016+0000","last_undegraded":"2023-05-24T04:01:55.375016+0000","last_fullsized":"2023-05-24T04:01:55.375016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:55.374597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:55.374597+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.374597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:01.349504+0000","scrub_duration":0.0031554949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.398595+0000","last_change":"2023-05-24T04:01:36.398595+0000","last_active":"2023-05-24T04:01:36.398595+0000","last_peered":"2023-05-24T04:01:36.398595+0000","last_clean":"2023-05-24T04:01:36.398595+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:01:36.398595+0000","last_undegraded":"2023-05-24T04:01:36.398595+0000","last_fullsized":"2023-05-24T04:01:36.398595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.398288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:35.536921+0000","scrub_duration":0.0033273310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:54.918914+0000","last_change":"2023-05-24T04:01:54.918914+0000","last_active":"2023-05-24T04:01:54.918914+0000","last_peered":"2023-05-24T04:01:54.918914+0000","last_clean":"2023-05-24T04:01:54.918914+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:01:54.918914+0000","last_undegraded":"2023-05-24T04:01:54.918914+0000","last_fullsized":"2023-05-24T04:01:54.918914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:54.918585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:54.918585+0000","last_clean_scrub_stamp":"2023-05-24T04:01:54.918585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:39.721448+0000","scrub_duration":0.0038101939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.131084+0000","last_change":"2023-05-24T04:01:29.131084+0000","last_active":"2023-05-24T04:01:29.131084+0000","last_peered":"2023-05-24T04:01:29.131084+0000","last_clean":"2023-05-24T04:01:29.131084+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:01:29.131084+0000","last_undegraded":"2023-05-24T04:01:29.131084+0000","last_fullsized":"2023-05-24T04:01:29.131084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.130752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:36.271021+0000","scrub_duration":0.003228191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.339849+0000","last_change":"2023-05-24T04:01:26.339849+0000","last_active":"2023-05-24T04:01:26.339849+0000","last_peered":"2023-05-24T04:01:26.339849+0000","last_clean":"2023-05-24T04:01:26.339849+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:01:26.339849+0000","last_undegraded":"2023-05-24T04:01:26.339849+0000","last_fullsized":"2023-05-24T04:01:26.339849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.339543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:20:58.800839+0000","scrub_duration":0.0038659369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.243947+0000","last_change":"2023-05-24T04:01:20.244112+0000","last_active":"2023-05-24T04:01:20.243947+0000","last_peered":"2023-05-24T04:01:20.243947+0000","last_clean":"2023-05-24T04:01:20.243947+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:01:20.243947+0000","last_undegraded":"2023-05-24T04:01:20.243947+0000","last_fullsized":"2023-05-24T04:01:20.243947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.243690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:16.537332+0000","scrub_duration":0.0033338600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.419334+0000","last_change":"2023-05-24T04:01:42.419433+0000","last_active":"2023-05-24T04:01:42.419334+0000","last_peered":"2023-05-24T04:01:42.419334+0000","last_clean":"2023-05-24T04:01:42.419334+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:01:42.419334+0000","last_undegraded":"2023-05-24T04:01:42.419334+0000","last_fullsized":"2023-05-24T04:01:42.419334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.419129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.419129+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.419129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:41.772842+0000","scrub_duration":0.0031554510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:57.228533+0000","last_change":"2023-05-24T04:01:57.228627+0000","last_active":"2023-05-24T04:01:57.228533+0000","last_peered":"2023-05-24T04:01:57.228533+0000","last_clean":"2023-05-24T04:01:57.228533+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:01:57.228533+0000","last_undegraded":"2023-05-24T04:01:57.228533+0000","last_fullsized":"2023-05-24T04:01:57.228533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:57.228320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:57.228320+0000","last_clean_scrub_stamp":"2023-05-24T04:01:57.228320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:19:45.418887+0000","scrub_duration":0.0039390689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:04.027937+0000","last_change":"2023-05-24T04:02:04.028023+0000","last_active":"2023-05-24T04:02:04.027937+0000","last_peered":"2023-05-24T04:02:04.027937+0000","last_clean":"2023-05-24T04:02:04.027937+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:02:04.027937+0000","last_undegraded":"2023-05-24T04:02:04.027937+0000","last_fullsized":"2023-05-24T04:02:04.027937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:04.027738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:04.027738+0000","last_clean_scrub_stamp":"2023-05-24T04:02:04.027738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:10.002646+0000","scrub_duration":0.0036723709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.465219+0000","last_change":"2023-05-24T04:01:26.465383+0000","last_active":"2023-05-24T04:01:26.465219+0000","last_peered":"2023-05-24T04:01:26.465219+0000","last_clean":"2023-05-24T04:01:26.465219+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:01:26.465219+0000","last_undegraded":"2023-05-24T04:01:26.465219+0000","last_fullsized":"2023-05-24T04:01:26.465219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.464980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:49.208763+0000","scrub_duration":0.003657731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.383570+0000","last_change":"2023-05-24T04:01:40.383667+0000","last_active":"2023-05-24T04:01:40.383570+0000","last_peered":"2023-05-24T04:01:40.383570+0000","last_clean":"2023-05-24T04:01:40.383570+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:01:40.383570+0000","last_undegraded":"2023-05-24T04:01:40.383570+0000","last_fullsized":"2023-05-24T04:01:40.383570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:40.383350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:40.383350+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.383350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:01:04.511715+0000","scrub_duration":0.0034523900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.449381+0000","last_change":"2023-05-24T04:01:44.449478+0000","last_active":"2023-05-24T04:01:44.449381+0000","last_peered":"2023-05-24T04:01:44.449381+0000","last_clean":"2023-05-24T04:01:44.449381+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:01:44.449381+0000","last_undegraded":"2023-05-24T04:01:44.449381+0000","last_fullsized":"2023-05-24T04:01:44.449381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.449173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.449173+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.449173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:11.033995+0000","scrub_duration":0.0038145229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.153399+0000","last_change":"2023-05-24T04:01:30.153492+0000","last_active":"2023-05-24T04:01:30.153399+0000","last_peered":"2023-05-24T04:01:30.153399+0000","last_clean":"2023-05-24T04:01:30.153399+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:01:30.153399+0000","last_undegraded":"2023-05-24T04:01:30.153399+0000","last_fullsized":"2023-05-24T04:01:30.153399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.153179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:26.061011+0000","scrub_duration":0.0036045560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:03.404748+0000","last_change":"2023-05-24T04:02:03.404841+0000","last_active":"2023-05-24T04:02:03.404748+0000","last_peered":"2023-05-24T04:02:03.404748+0000","last_clean":"2023-05-24T04:02:03.404748+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:02:03.404748+0000","last_undegraded":"2023-05-24T04:02:03.404748+0000","last_fullsized":"2023-05-24T04:02:03.404748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:03.404530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:03.404530+0000","last_clean_scrub_stamp":"2023-05-24T04:02:03.404530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:46.672686+0000","scrub_duration":0.0034870420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.394667+0000","last_change":"2023-05-24T04:01:48.394790+0000","last_active":"2023-05-24T04:01:48.394667+0000","last_peered":"2023-05-24T04:01:48.394667+0000","last_clean":"2023-05-24T04:01:48.394667+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:01:48.394667+0000","last_undegraded":"2023-05-24T04:01:48.394667+0000","last_fullsized":"2023-05-24T04:01:48.394667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:48.394452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:48.394452+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.394452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:26.880540+0000","scrub_duration":0.0032445310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.394121+0000","last_change":"2023-05-24T04:01:34.394285+0000","last_active":"2023-05-24T04:01:34.394121+0000","last_peered":"2023-05-24T04:01:34.394121+0000","last_clean":"2023-05-24T04:01:34.394121+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:01:34.394121+0000","last_undegraded":"2023-05-24T04:01:34.394121+0000","last_fullsized":"2023-05-24T04:01:34.394121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.393879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:08.002884+0000","scrub_duration":0.0036074449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:58.900888+0000","last_change":"2023-05-24T04:01:58.900981+0000","last_active":"2023-05-24T04:01:58.900888+0000","last_peered":"2023-05-24T04:01:58.900888+0000","last_clean":"2023-05-24T04:01:58.900888+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:01:58.900888+0000","last_undegraded":"2023-05-24T04:01:58.900888+0000","last_fullsized":"2023-05-24T04:01:58.900888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:58.900675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:58.900675+0000","last_clean_scrub_stamp":"2023-05-24T04:01:58.900675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:29.630229+0000","scrub_duration":0.0037702809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.166848+0000","last_change":"2023-05-24T04:01:35.166953+0000","last_active":"2023-05-24T04:01:35.166848+0000","last_peered":"2023-05-24T04:01:35.166848+0000","last_clean":"2023-05-24T04:01:35.166848+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:01:35.166848+0000","last_undegraded":"2023-05-24T04:01:35.166848+0000","last_fullsized":"2023-05-24T04:01:35.166848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.166621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:50:45.681248+0000","scrub_duration":0.0037053350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:41.427494+0000","last_change":"2023-05-24T04:01:41.427551+0000","last_active":"2023-05-24T04:01:41.427494+0000","last_peered":"2023-05-24T04:01:41.427494+0000","last_clean":"2023-05-24T04:01:41.427494+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:01:41.427494+0000","last_undegraded":"2023-05-24T04:01:41.427494+0000","last_fullsized":"2023-05-24T04:01:41.427494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:41.427368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:41.427368+0000","last_clean_scrub_stamp":"2023-05-24T04:01:41.427368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:37.721011+0000","scrub_duration":0.0035447759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.653683+0000","last_change":"2023-05-24T04:01:42.653683+0000","last_active":"2023-05-24T04:01:42.653683+0000","last_peered":"2023-05-24T04:01:42.653683+0000","last_clean":"2023-05-24T04:01:42.653683+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:01:42.653683+0000","last_undegraded":"2023-05-24T04:01:42.653683+0000","last_fullsized":"2023-05-24T04:01:42.653683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.653385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.653385+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.653385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:36:50.815411+0000","scrub_duration":0.0038377929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:14.212883+0000","last_change":"2023-05-24T04:02:14.213000+0000","last_active":"2023-05-24T04:02:14.212883+0000","last_peered":"2023-05-24T04:02:14.212883+0000","last_clean":"2023-05-24T04:02:14.212883+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:02:14.212883+0000","last_undegraded":"2023-05-24T04:02:14.212883+0000","last_fullsized":"2023-05-24T04:02:14.212883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:14.212679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:14.212679+0000","last_clean_scrub_stamp":"2023-05-24T04:02:14.212679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:50.037098+0000","scrub_duration":0.0034665529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:10.516285+0000","last_change":"2023-05-24T04:02:10.516447+0000","last_active":"2023-05-24T04:02:10.516285+0000","last_peered":"2023-05-24T04:02:10.516285+0000","last_clean":"2023-05-24T04:02:10.516285+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:02:10.516285+0000","last_undegraded":"2023-05-24T04:02:10.516285+0000","last_fullsized":"2023-05-24T04:02:10.516285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:10.516032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:10.516032+0000","last_clean_scrub_stamp":"2023-05-24T04:02:10.516032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:12.600804+0000","scrub_duration":0.0040991619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.357015+0000","last_change":"2023-05-24T04:01:36.357015+0000","last_active":"2023-05-24T04:01:36.357015+0000","last_peered":"2023-05-24T04:01:36.357015+0000","last_clean":"2023-05-24T04:01:36.357015+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:01:36.357015+0000","last_undegraded":"2023-05-24T04:01:36.357015+0000","last_fullsized":"2023-05-24T04:01:36.357015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.356683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:22:55.377329+0000","scrub_duration":0.0034088299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6382,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78700000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98099999999999998,"5min":1.355,"15min":1.355},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1459999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.88,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.266,"15min":1.266},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.94399999999999995,"15min":0.95099999999999996},"min":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.258,"5min":1.28,"15min":1.28},"last":0.747}]},{"osd":2,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94499999999999995,"15min":0.94299999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1739999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.88700000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.2809999999999999,"5min":1.895,"15min":1.895},"last":1.3049999999999999}]},{"osd":3,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.016,"15min":1.026},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1930000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.196},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3360000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.032}]},{"osd":4,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96599999999999997,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.075},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.995},"min":{"1min":0.69399999999999995,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3169999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.365}]},{"osd":5,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.224,"5min":1.528,"15min":1.528},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0960000000000001,"15min":1.1060000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.228,"5min":1.375,"15min":1.375},"last":1.155}]},{"osd":6,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.196,"15min":1.204},"min":{"1min":0.98799999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.351,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.244},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1679999999999999,"15min":1.171},"min":{"1min":0.86499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.3680000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.411}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.874,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.85799999999999998},"min":{"1min":0.67400000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.755}]},{"osd":1,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.133,"5min":1.25,"15min":1.25},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.022,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.78000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0389999999999999}]},{"osd":2,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92400000000000004,"15min":0.92600000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1419999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.96199999999999997}]},{"osd":3,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.98599999999999999,"15min":0.99399999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.165,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0600000000000001,"15min":1.0720000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1699999999999999,"5min":1.625,"15min":1.625},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0629999999999999,"15min":1.071},"min":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3160000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.878},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2350000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.02}]},{"osd":5,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1850000000000001,"15min":1.2070000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.274,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1930000000000001,"15min":1.214},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.244,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":1.0669999999999999,"5min":1.014,"15min":1.014},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":1.107},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.284,"15min":1.302},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5409999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.96299999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.877,"15min":0.874},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.071}]},{"osd":1,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91400000000000003,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3009999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.98699999999999999}]},{"osd":2,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.68400000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2070000000000001,"5min":1.446,"15min":1.446},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.046,"15min":1.0580000000000001},"min":{"1min":0.81499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.1559999999999999,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.03}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0249999999999999,"15min":1.0369999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.343,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.079,"15min":1.083},"min":{"1min":0.875,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.2729999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.86199999999999999}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":0.97199999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.258,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.143,"15min":1.151},"min":{"1min":0.745,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4299999999999999,"5min":2.496,"15min":2.496},"last":1.2310000000000001}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.76800000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.476,"5min":1.927,"15min":1.927},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3879999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.2}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2310000000000001,"15min":1.2390000000000001},"min":{"1min":1.0169999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4810000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.2010000000000001,"15min":1.2090000000000001},"min":{"1min":0.85899999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3520000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.171}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.59099999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.169,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":1.484,"15min":1.484},"last":0.85099999999999998}]},{"osd":1,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.63200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.22,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.64500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.234,"5min":1.29,"15min":1.29},"last":1.0589999999999999}]},{"osd":2,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.64900000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.0920000000000001,"5min":1.542,"15min":1.542},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.68500000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2370000000000001,"5min":1.323,"15min":1.323},"last":0.92700000000000005}]},{"osd":3,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93899999999999995,"15min":0.94299999999999995},"min":{"1min":0.629,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1719999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72599999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.997}]},{"osd":5,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2569999999999999,"5min":1.407,"15min":1.407},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.99399999999999999,"15min":0.99099999999999999},"min":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.1699999999999999}]},{"osd":6,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0720000000000001,"15min":1.075},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5309999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.179,"5min":1.167,"15min":1.165},"min":{"1min":1.0289999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.429,"5min":1.587,"15min":1.587},"last":1.1419999999999999}]},{"osd":7,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.155,"15min":1.165},"min":{"1min":0.79400000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3720000000000001,"5min":1.829,"15min":1.829},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.244,"15min":1.254},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.4390000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1120000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.89000000000000001,"5min":1.115,"15min":1.115},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.88400000000000001}]},{"osd":1,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93200000000000005,"5min":1.534,"15min":1.534},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.40500000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.76100000000000001}]},{"osd":2,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97499999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.99299999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.034},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1819999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.92800000000000005}]},{"osd":5,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0720000000000001,"5min":1.798,"15min":1.798},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3120000000000001,"5min":1.895,"15min":1.895},"last":0.96099999999999997}]},{"osd":6,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0589999999999999,"15min":1.073},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2769999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.258,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.2150000000000001}]},{"osd":7,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2390000000000001,"5min":1.734,"15min":1.734},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.107,"15min":1.117},"min":{"1min":0.73099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2949999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.131}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.47599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.123,"15min":1.123},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.026,"5min":1.056,"15min":1.056},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":2.246,"15min":2.246},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98599999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.071,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93899999999999995,"15min":0.93200000000000005},"min":{"1min":0.60699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":0.96199999999999997},"min":{"1min":0.67900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3169999999999999,"5min":1.542,"15min":1.542},"last":0.85099999999999998}]},{"osd":5,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.98499999999999999,"15min":0.97599999999999998},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2729999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.97699999999999998},"min":{"1min":0.59499999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2250000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.747,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4530000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.875}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.046},"min":{"1min":0.73499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3240000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.129,"15min":1.131},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.395,"5min":1.879,"15min":1.879},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0820000000000001,"5min":1.105,"15min":1.105},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96999999999999997,"5min":1.133,"15min":1.133},"last":0.70699999999999996}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.03,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.98999999999999999,"15min":1.002},"min":{"1min":0.57799999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.228,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94399999999999995,"15min":0.94699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.258,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.2809999999999999}]},{"osd":5,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.63900000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0800000000000001,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4790000000000001,"5min":1.554,"15min":1.554},"last":1.2430000000000001}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.069,"15min":1.073},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.626,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.365,"5min":1.379,"15min":1.379},"last":1.177}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.622,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.089,"15min":1.0920000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3089999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1279999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.53100000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.999,"5min":1.163,"15min":1.163},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.80700000000000005,"15min":0.78400000000000003},"min":{"1min":0.751,"5min":0.315,"15min":0.315},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.91800000000000004}]},{"osd":3,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.272,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.625},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.155,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.85199999999999998}]},{"osd":4,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.96699999999999997,"15min":0.94899999999999995},"min":{"1min":0.83699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.76900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.272,"5min":1.665,"15min":1.665},"last":0.96999999999999997}]},{"osd":5,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.70399999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.45,"5min":1.609,"15min":1.609},"last":1.129},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.94499999999999995,"15min":0.92700000000000005},"min":{"1min":0.71799999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.88800000000000001}]},{"osd":6,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.026,"15min":1.016},"min":{"1min":0.67300000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.393,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.173},"min":{"1min":0.88200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3129999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.0589999999999999}]},{"osd":7,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0840000000000001,"15min":1.081},"min":{"1min":0.69999999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5289999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.242},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.091,"15min":1.0740000000000001},"min":{"1min":0.85199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6080000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:02:22.594 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.594 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.595 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.595 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.596 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.597 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.597 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.598 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.599 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.599 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.600 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-05-24T03:59:57.492936+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=59, tm_sec=57, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.600 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.600 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.601 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.601 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T04:00:00.903985+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=0, tm_sec=0, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=4, tm_min=1, tm_sec=16, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T04:02:22.602 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T04:02:22.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:22.929 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:22.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:22.935 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:22.938 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:42.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T04:02:42.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 Processor -- start 2023-05-24T04:02:42.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 -- start start 2023-05-24T04:02:42.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76ac0a52f0 0x7f76ac14a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:42.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76ac070c50 0x7f76ac0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:42.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac0bcb70 con 0x7f76ac14a340 2023-05-24T04:02:42.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac0a4da0 con 0x7f76ac070c50 2023-05-24T04:02:42.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b378e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac0bc800 con 0x7f76ac0a52f0 2023-05-24T04:02:42.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76ac070c50 0x7f76ac0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:42.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76ac070c50 0x7f76ac0710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60928/0 (socket says 172.21.15.40:60928) 2023-05-24T04:02:42.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 -- 172.21.15.40:0/1685239791 learned_addr learned my addr 172.21.15.40:0/1685239791 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:42.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b0d29640 1 --2- 172.21.15.40:0/1685239791 >> v2:172.21.15.67:3300/0 conn(0x7f76ac0a52f0 0x7f76ac14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:42.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 -- 172.21.15.40:0/1685239791 >> v2:172.21.15.67:3300/0 conn(0x7f76ac0a52f0 msgr2=0x7f76ac14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:42.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 --2- 172.21.15.40:0/1685239791 >> v2:172.21.15.67:3300/0 conn(0x7f76ac0a52f0 0x7f76ac14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 -- 172.21.15.40:0/1685239791 >> v1:172.21.15.67:6789/0 conn(0x7f76ac14a340 legacy=0x7f76ac06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:42.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.733+0000 7f76b1d2b640 1 -- 172.21.15.40:0/1685239791 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac06ca60 con 0x7f76ac070c50 2023-05-24T04:02:42.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b1d2b640 1 --2- 172.21.15.40:0/1685239791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac070c50 0x7f76ac0710d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06e610 tx=0x7f769c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7f1f64fdd388f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:42.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76a3fff640 1 -- 172.21.15.40:0/1685239791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c0ab600 con 0x7f76ac070c50 2023-05-24T04:02:42.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76a3fff640 1 -- 172.21.15.40:0/1685239791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c0a7050 con 0x7f76ac070c50 2023-05-24T04:02:42.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76a3fff640 1 -- 172.21.15.40:0/1685239791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c0ab980 con 0x7f76ac070c50 2023-05-24T04:02:42.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- 172.21.15.40:0/1685239791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac070c50 msgr2=0x7f76ac0710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:42.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 --2- 172.21.15.40:0/1685239791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac070c50 0x7f76ac0710d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06e610 tx=0x7f769c01c470 comp rx=0 tx=0).stop 2023-05-24T04:02:42.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- 172.21.15.40:0/1685239791 shutdown_connections 2023-05-24T04:02:42.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 --2- 172.21.15.40:0/1685239791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac070c50 0x7f76ac0710d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 --2- 172.21.15.40:0/1685239791 >> v2:172.21.15.67:3300/0 conn(0x7f76ac0a52f0 0x7f76ac14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- 172.21.15.40:0/1685239791 >> 172.21.15.40:0/1685239791 conn(0x7f76ac0c0280 msgr2=0x7f76ac0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:42.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- 172.21.15.40:0/1685239791 shutdown_connections 2023-05-24T04:02:42.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- 172.21.15.40:0/1685239791 wait complete. 2023-05-24T04:02:42.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 Processor -- start 2023-05-24T04:02:42.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- start start 2023-05-24T04:02:42.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76ac070c50 0x7f76ac148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:42.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 0x7f76ac151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:42.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76ac14a340 0x7f76ac152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:42.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac14f0c0 con 0x7f76ac0a52f0 2023-05-24T04:02:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac1e5490 con 0x7f76ac14a340 2023-05-24T04:02:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b378e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac148f70 con 0x7f76ac070c50 2023-05-24T04:02:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 0x7f76ac151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 0x7f76ac151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60940/0 (socket says 172.21.15.40:60940) 2023-05-24T04:02:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 -- 172.21.15.40:0/2024619492 learned_addr learned my addr 172.21.15.40:0/2024619492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b1d2b640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76ac14a340 0x7f76ac152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b152a640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76ac070c50 0x7f76ac148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 -- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76ac070c50 msgr2=0x7f76ac148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76ac070c50 0x7f76ac148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 -- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76ac14a340 msgr2=0x7f76ac152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76ac14a340 0x7f76ac152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 -- 172.21.15.40:0/2024619492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0094d0 con 0x7f76ac0a52f0 2023-05-24T04:02:42.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b1d2b640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76ac14a340 0x7f76ac152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:42.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b152a640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76ac070c50 0x7f76ac148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:42.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76b0d29640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 0x7f76ac151ec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f76a8007ef0 tx=0x7f76a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:42.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8014620 con 0x7f76ac0a52f0 2023-05-24T04:02:42.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.737+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a8014780 con 0x7f76ac0a52f0 2023-05-24T04:02:42.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac06d1c0 con 0x7f76ac0a52f0 2023-05-24T04:02:42.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8014b30 con 0x7f76ac0a52f0 2023-05-24T04:02:42.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac06d030 con 0x7f76ac0a52f0 2023-05-24T04:02:42.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac157a10 con 0x7f76ac0a52f0 2023-05-24T04:02:42.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76a8014c90 con 0x7f76ac0a52f0 2023-05-24T04:02:42.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76a1ffb640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7698066280 0x7f7698068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:42.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76a80849c0 con 0x7f76ac0a52f0 2023-05-24T04:02:42.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76b152a640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7698066280 0x7f7698068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:42.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.741+0000 7f76b152a640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7698066280 0x7f7698068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76a4000f70 tx=0x7f76a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:42.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.745+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f76a8051ba0 con 0x7f76ac0a52f0 2023-05-24T04:02:42.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.897+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 --> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76ac04ddd0 con 0x7f7698066280 2023-05-24T04:02:42.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.925+0000 7f76a1ffb640 1 -- 172.21.15.40:0/2024619492 <== mgr.4103 v2:172.21.15.40:6832/1050561817 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392835 (secure 0 0 0) 0x7f76ac04ddd0 con 0x7f7698066280 2023-05-24T04:02:42.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:02:42.949 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-24T04:02:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7698066280 msgr2=0x7f7698068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7698066280 0x7f7698068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76a4000f70 tx=0x7f76a4009040 comp rx=0 tx=0).stop 2023-05-24T04:02:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 msgr2=0x7f76ac151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 0x7f76ac151ec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f76a8007ef0 tx=0x7f76a800e4b0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 shutdown_connections 2023-05-24T04:02:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f7698066280 0x7f7698068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76ac14a340 0x7f76ac152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76ac0a52f0 0x7f76ac151ec0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 --2- 172.21.15.40:0/2024619492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76ac070c50 0x7f76ac148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:42.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 >> 172.21.15.40:0/2024619492 conn(0x7f76ac0c0280 msgr2=0x7f76ac0a3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:42.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 shutdown_connections 2023-05-24T04:02:42.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:42.929+0000 7f76b378e640 1 -- 172.21.15.40:0/2024619492 wait complete. 2023-05-24T04:02:42.955 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-05-24T04:02:42.585250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596750,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147120,"kb_used_data":3696,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827600,"statfs":{"total":773094113280,"available":772943462400,"internally_reserved":0,"allocated":3784704,"data_stored":2266900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004707"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:05.698642+0000","last_change":"2023-05-24T04:02:05.698642+0000","last_active":"2023-05-24T04:02:05.698642+0000","last_peered":"2023-05-24T04:02:05.698642+0000","last_clean":"2023-05-24T04:02:05.698642+0000","last_became_active":"2023-05-24T04:00:01.985882+0000","last_became_peered":"2023-05-24T04:00:01.985882+0000","last_unstale":"2023-05-24T04:02:05.698642+0000","last_undegraded":"2023-05-24T04:02:05.698642+0000","last_fullsized":"2023-05-24T04:02:05.698642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:05.698261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:05.698261+0000","last_clean_scrub_stamp":"2023-05-24T04:02:05.698261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:11.673169+0000","scrub_duration":0.0038303130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.473721+0000","last_change":"2023-05-24T04:01:29.473721+0000","last_active":"2023-05-24T04:01:29.473721+0000","last_peered":"2023-05-24T04:01:29.473721+0000","last_clean":"2023-05-24T04:01:29.473721+0000","last_became_active":"2023-05-24T03:59:57.541330+0000","last_became_peered":"2023-05-24T03:59:57.541330+0000","last_unstale":"2023-05-24T04:01:29.473721+0000","last_undegraded":"2023-05-24T04:01:29.473721+0000","last_fullsized":"2023-05-24T04:01:29.473721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-05-24T04:01:29.473421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.473421+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:39.840985+0000","scrub_duration":0.0082611170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:17.275639+0000","last_change":"2023-05-24T04:02:17.275639+0000","last_active":"2023-05-24T04:02:17.275639+0000","last_peered":"2023-05-24T04:02:17.275639+0000","last_clean":"2023-05-24T04:02:17.275639+0000","last_became_active":"2023-05-24T03:59:57.935391+0000","last_became_peered":"2023-05-24T03:59:57.935391+0000","last_unstale":"2023-05-24T04:02:17.275639+0000","last_undegraded":"2023-05-24T04:02:17.275639+0000","last_fullsized":"2023-05-24T04:02:17.275639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:17.275242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:17.275242+0000","last_clean_scrub_stamp":"2023-05-24T04:02:17.275242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:41:31.631976+0000","scrub_duration":0.0037555449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:18.282977+0000","last_change":"2023-05-24T04:02:18.282977+0000","last_active":"2023-05-24T04:02:18.282977+0000","last_peered":"2023-05-24T04:02:18.282977+0000","last_clean":"2023-05-24T04:02:18.282977+0000","last_became_active":"2023-05-24T04:00:01.973689+0000","last_became_peered":"2023-05-24T04:00:01.973689+0000","last_unstale":"2023-05-24T04:02:18.282977+0000","last_undegraded":"2023-05-24T04:02:18.282977+0000","last_fullsized":"2023-05-24T04:02:18.282977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:18.282588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:18.282588+0000","last_clean_scrub_stamp":"2023-05-24T04:02:18.282588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:50.791325+0000","scrub_duration":0.003801811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:39.501018+0000","last_change":"2023-05-24T04:01:39.501018+0000","last_active":"2023-05-24T04:01:39.501018+0000","last_peered":"2023-05-24T04:01:39.501018+0000","last_clean":"2023-05-24T04:01:39.501018+0000","last_became_active":"2023-05-24T03:59:57.537894+0000","last_became_peered":"2023-05-24T03:59:57.537894+0000","last_unstale":"2023-05-24T04:01:39.501018+0000","last_undegraded":"2023-05-24T04:01:39.501018+0000","last_fullsized":"2023-05-24T04:01:39.501018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:39.500706+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:39.500706+0000","last_clean_scrub_stamp":"2023-05-24T04:01:39.500706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:38.854419+0000","scrub_duration":0.0037390499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.569026+0000","last_change":"2023-05-24T04:01:24.569026+0000","last_active":"2023-05-24T04:01:24.569026+0000","last_peered":"2023-05-24T04:01:24.569026+0000","last_clean":"2023-05-24T04:01:24.569026+0000","last_became_active":"2023-05-24T03:59:57.912662+0000","last_became_peered":"2023-05-24T03:59:57.912662+0000","last_unstale":"2023-05-24T04:01:24.569026+0000","last_undegraded":"2023-05-24T04:01:24.569026+0000","last_fullsized":"2023-05-24T04:01:24.569026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.568716+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.568716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:27.628807+0000","scrub_duration":0.0033214799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:30.677392+0000","last_change":"2023-05-24T04:02:30.677392+0000","last_active":"2023-05-24T04:02:30.677392+0000","last_peered":"2023-05-24T04:02:30.677392+0000","last_clean":"2023-05-24T04:02:30.677392+0000","last_became_active":"2023-05-24T04:00:01.991159+0000","last_became_peered":"2023-05-24T04:00:01.991159+0000","last_unstale":"2023-05-24T04:02:30.677392+0000","last_undegraded":"2023-05-24T04:02:30.677392+0000","last_fullsized":"2023-05-24T04:02:30.677392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:30.676996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:30.676996+0000","last_clean_scrub_stamp":"2023-05-24T04:02:30.676996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:50:48.828978+0000","scrub_duration":0.0038899859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:51.397341+0000","last_change":"2023-05-24T04:01:51.397341+0000","last_active":"2023-05-24T04:01:51.397341+0000","last_peered":"2023-05-24T04:01:51.397341+0000","last_clean":"2023-05-24T04:01:51.397341+0000","last_became_active":"2023-05-24T03:59:57.568192+0000","last_became_peered":"2023-05-24T03:59:57.568192+0000","last_unstale":"2023-05-24T04:01:51.397341+0000","last_undegraded":"2023-05-24T04:01:51.397341+0000","last_fullsized":"2023-05-24T04:01:51.397341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:51.397019+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:51.397019+0000","last_clean_scrub_stamp":"2023-05-24T04:01:51.397019+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:29.883107+0000","scrub_duration":0.0065764580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:09.245677+0000","last_change":"2023-05-24T04:02:09.245677+0000","last_active":"2023-05-24T04:02:09.245677+0000","last_peered":"2023-05-24T04:02:09.245677+0000","last_clean":"2023-05-24T04:02:09.245677+0000","last_became_active":"2023-05-24T03:59:57.925795+0000","last_became_peered":"2023-05-24T03:59:57.925795+0000","last_unstale":"2023-05-24T04:02:09.245677+0000","last_undegraded":"2023-05-24T04:02:09.245677+0000","last_fullsized":"2023-05-24T04:02:09.245677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:09.245229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:09.245229+0000","last_clean_scrub_stamp":"2023-05-24T04:02:09.245229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:52:41.502729+0000","scrub_duration":0.0036843750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:21.218925+0000","last_change":"2023-05-24T04:02:21.218925+0000","last_active":"2023-05-24T04:02:21.218925+0000","last_peered":"2023-05-24T04:02:21.218925+0000","last_clean":"2023-05-24T04:02:21.218925+0000","last_became_active":"2023-05-24T04:00:01.983771+0000","last_became_peered":"2023-05-24T04:00:01.983771+0000","last_unstale":"2023-05-24T04:02:21.218925+0000","last_undegraded":"2023-05-24T04:02:21.218925+0000","last_fullsized":"2023-05-24T04:02:21.218925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:21.218530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:21.218530+0000","last_clean_scrub_stamp":"2023-05-24T04:02:21.218530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:52:05.840732+0000","scrub_duration":0.0041688009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.400608+0000","last_change":"2023-05-24T04:01:45.400608+0000","last_active":"2023-05-24T04:01:45.400608+0000","last_peered":"2023-05-24T04:01:45.400608+0000","last_clean":"2023-05-24T04:01:45.400608+0000","last_became_active":"2023-05-24T03:59:57.565502+0000","last_became_peered":"2023-05-24T03:59:57.565502+0000","last_unstale":"2023-05-24T04:01:45.400608+0000","last_undegraded":"2023-05-24T04:01:45.400608+0000","last_fullsized":"2023-05-24T04:01:45.400608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:45.400310+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:45.400310+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.400310+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:44.754023+0000","scrub_duration":0.0068925899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:12.277340+0000","last_change":"2023-05-24T04:02:12.277340+0000","last_active":"2023-05-24T04:02:12.277340+0000","last_peered":"2023-05-24T04:02:12.277340+0000","last_clean":"2023-05-24T04:02:12.277340+0000","last_became_active":"2023-05-24T03:59:57.925932+0000","last_became_peered":"2023-05-24T03:59:57.925932+0000","last_unstale":"2023-05-24T04:02:12.277340+0000","last_undegraded":"2023-05-24T04:02:12.277340+0000","last_fullsized":"2023-05-24T04:02:12.277340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:12.276916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:12.276916+0000","last_clean_scrub_stamp":"2023-05-24T04:02:12.276916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:01:05.309370+0000","scrub_duration":0.0039295160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.618615+0000","last_change":"2023-05-24T04:01:55.618615+0000","last_active":"2023-05-24T04:01:55.618615+0000","last_peered":"2023-05-24T04:01:55.618615+0000","last_clean":"2023-05-24T04:01:55.618615+0000","last_became_active":"2023-05-24T04:00:01.978487+0000","last_became_peered":"2023-05-24T04:00:01.978487+0000","last_unstale":"2023-05-24T04:01:55.618615+0000","last_undegraded":"2023-05-24T04:01:55.618615+0000","last_fullsized":"2023-05-24T04:01:55.618615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:55.618101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:55.618101+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.618101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:34.104189+0000","scrub_duration":0.0039436059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.542492+0000","last_change":"2023-05-24T04:01:22.542492+0000","last_active":"2023-05-24T04:01:22.542492+0000","last_peered":"2023-05-24T04:01:22.542492+0000","last_clean":"2023-05-24T04:01:22.542492+0000","last_became_active":"2023-05-24T03:59:57.561143+0000","last_became_peered":"2023-05-24T03:59:57.561143+0000","last_unstale":"2023-05-24T04:01:22.542492+0000","last_undegraded":"2023-05-24T04:01:22.542492+0000","last_fullsized":"2023-05-24T04:01:22.542492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:22.542168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.542168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:13.410065+0000","scrub_duration":0.003819444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.484684+0000","last_change":"2023-05-24T04:01:45.484684+0000","last_active":"2023-05-24T04:01:45.484684+0000","last_peered":"2023-05-24T04:01:45.484684+0000","last_clean":"2023-05-24T04:01:45.484684+0000","last_became_active":"2023-05-24T03:59:57.938505+0000","last_became_peered":"2023-05-24T03:59:57.938505+0000","last_unstale":"2023-05-24T04:01:45.484684+0000","last_undegraded":"2023-05-24T04:01:45.484684+0000","last_fullsized":"2023-05-24T04:01:45.484684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:45.484393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:45.484393+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.484393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:44.530511+0000","scrub_duration":0.0034391399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:28.315510+0000","last_change":"2023-05-24T04:02:28.315510+0000","last_active":"2023-05-24T04:02:28.315510+0000","last_peered":"2023-05-24T04:02:28.315510+0000","last_clean":"2023-05-24T04:02:28.315510+0000","last_became_active":"2023-05-24T04:00:01.970403+0000","last_became_peered":"2023-05-24T04:00:01.970403+0000","last_unstale":"2023-05-24T04:02:28.315510+0000","last_undegraded":"2023-05-24T04:02:28.315510+0000","last_fullsized":"2023-05-24T04:02:28.315510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:28.315187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:28.315187+0000","last_clean_scrub_stamp":"2023-05-24T04:02:28.315187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:05.471260+0000","scrub_duration":0.0044097060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.210680+0000","last_change":"2023-05-24T04:01:36.210680+0000","last_active":"2023-05-24T04:01:36.210680+0000","last_peered":"2023-05-24T04:01:36.210680+0000","last_clean":"2023-05-24T04:01:36.210680+0000","last_became_active":"2023-05-24T03:59:57.543142+0000","last_became_peered":"2023-05-24T03:59:57.543142+0000","last_unstale":"2023-05-24T04:01:36.210680+0000","last_undegraded":"2023-05-24T04:01:36.210680+0000","last_fullsized":"2023-05-24T04:01:36.210680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-05-24T04:01:36.210367+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.210367+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:19.478523+0000","scrub_duration":0.003865659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.454078+0000","last_change":"2023-05-24T04:01:50.454078+0000","last_active":"2023-05-24T04:01:50.454078+0000","last_peered":"2023-05-24T04:01:50.454078+0000","last_clean":"2023-05-24T04:01:50.454078+0000","last_became_active":"2023-05-24T03:59:57.935726+0000","last_became_peered":"2023-05-24T03:59:57.935726+0000","last_unstale":"2023-05-24T04:01:50.454078+0000","last_undegraded":"2023-05-24T04:01:50.454078+0000","last_fullsized":"2023-05-24T04:01:50.454078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.453676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.453676+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.453676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:21.183230+0000","scrub_duration":0.003547335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.639129+0000","last_change":"2023-05-24T04:01:45.639129+0000","last_active":"2023-05-24T04:01:45.639129+0000","last_peered":"2023-05-24T04:01:45.639129+0000","last_clean":"2023-05-24T04:01:45.639129+0000","last_became_active":"2023-05-24T04:00:01.986416+0000","last_became_peered":"2023-05-24T04:00:01.986416+0000","last_unstale":"2023-05-24T04:01:45.639129+0000","last_undegraded":"2023-05-24T04:01:45.639129+0000","last_fullsized":"2023-05-24T04:01:45.639129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:45.638738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:45.638738+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.638738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:21.861642+0000","scrub_duration":0.0040594979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.702398+0000","last_change":"2023-05-24T04:01:29.702398+0000","last_active":"2023-05-24T04:01:29.702398+0000","last_peered":"2023-05-24T04:01:29.702398+0000","last_clean":"2023-05-24T04:01:29.702398+0000","last_became_active":"2023-05-24T03:59:57.534420+0000","last_became_peered":"2023-05-24T03:59:57.534420+0000","last_unstale":"2023-05-24T04:01:29.702398+0000","last_undegraded":"2023-05-24T04:01:29.702398+0000","last_fullsized":"2023-05-24T04:01:29.702398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.702108+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.702108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:20.570006+0000","scrub_duration":0.0033797469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.353680+0000","last_change":"2023-05-24T04:01:53.353680+0000","last_active":"2023-05-24T04:01:53.353680+0000","last_peered":"2023-05-24T04:01:53.353680+0000","last_clean":"2023-05-24T04:01:53.353680+0000","last_became_active":"2023-05-24T03:59:57.922479+0000","last_became_peered":"2023-05-24T03:59:57.922479+0000","last_unstale":"2023-05-24T04:01:53.353680+0000","last_undegraded":"2023-05-24T04:01:53.353680+0000","last_fullsized":"2023-05-24T04:01:53.353680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:53.353364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:53.353364+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.353364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:49.261197+0000","scrub_duration":0.0034261130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:07.213403+0000","last_change":"2023-05-24T04:02:07.213531+0000","last_active":"2023-05-24T04:02:07.213403+0000","last_peered":"2023-05-24T04:02:07.213403+0000","last_clean":"2023-05-24T04:02:07.213403+0000","last_became_active":"2023-05-24T04:00:01.984277+0000","last_became_peered":"2023-05-24T04:00:01.984277+0000","last_unstale":"2023-05-24T04:02:07.213403+0000","last_undegraded":"2023-05-24T04:02:07.213403+0000","last_fullsized":"2023-05-24T04:02:07.213403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:07.213183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:07.213183+0000","last_clean_scrub_stamp":"2023-05-24T04:02:07.213183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:09.297954+0000","scrub_duration":0.0040632890000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:33.580913+0000","last_change":"2023-05-24T04:01:33.580913+0000","last_active":"2023-05-24T04:01:33.580913+0000","last_peered":"2023-05-24T04:01:33.580913+0000","last_clean":"2023-05-24T04:01:33.580913+0000","last_became_active":"2023-05-24T03:59:57.536787+0000","last_became_peered":"2023-05-24T03:59:57.536787+0000","last_unstale":"2023-05-24T04:01:33.580913+0000","last_undegraded":"2023-05-24T04:01:33.580913+0000","last_fullsized":"2023-05-24T04:01:33.580913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:33.580634+0000","last_clean_scrub_stamp":"2023-05-24T04:01:33.580634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:32.719267+0000","scrub_duration":0.0034014739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.701508+0000","last_change":"2023-05-24T04:01:32.701508+0000","last_active":"2023-05-24T04:01:32.701508+0000","last_peered":"2023-05-24T04:01:32.701508+0000","last_clean":"2023-05-24T04:01:32.701508+0000","last_became_active":"2023-05-24T03:59:57.931260+0000","last_became_peered":"2023-05-24T03:59:57.931260+0000","last_unstale":"2023-05-24T04:01:32.701508+0000","last_undegraded":"2023-05-24T04:01:32.701508+0000","last_fullsized":"2023-05-24T04:01:32.701508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.701223+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.701223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:00:56.829588+0000","scrub_duration":0.0032971739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:08.304973+0000","last_change":"2023-05-24T04:02:08.304973+0000","last_active":"2023-05-24T04:02:08.304973+0000","last_peered":"2023-05-24T04:02:08.304973+0000","last_clean":"2023-05-24T04:02:08.304973+0000","last_became_active":"2023-05-24T03:59:57.936748+0000","last_became_peered":"2023-05-24T03:59:57.936748+0000","last_unstale":"2023-05-24T04:02:08.304973+0000","last_undegraded":"2023-05-24T04:02:08.304973+0000","last_fullsized":"2023-05-24T04:02:08.304973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:08.304660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:08.304660+0000","last_clean_scrub_stamp":"2023-05-24T04:02:08.304660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:44:02.723107+0000","scrub_duration":0.0032460050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:31.399136+0000","last_change":"2023-05-24T04:01:31.399136+0000","last_active":"2023-05-24T04:01:31.399136+0000","last_peered":"2023-05-24T04:01:31.399136+0000","last_clean":"2023-05-24T04:01:31.399136+0000","last_became_active":"2023-05-24T03:59:57.541630+0000","last_became_peered":"2023-05-24T03:59:57.541630+0000","last_unstale":"2023-05-24T04:01:31.399136+0000","last_undegraded":"2023-05-24T04:01:31.399136+0000","last_fullsized":"2023-05-24T04:01:31.399136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:31.398830+0000","last_clean_scrub_stamp":"2023-05-24T04:01:31.398830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:05.007835+0000","scrub_duration":0.0036452780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.661762+0000","last_change":"2023-05-24T04:01:46.661762+0000","last_active":"2023-05-24T04:01:46.661762+0000","last_peered":"2023-05-24T04:01:46.661762+0000","last_clean":"2023-05-24T04:01:46.661762+0000","last_became_active":"2023-05-24T04:00:01.986730+0000","last_became_peered":"2023-05-24T04:00:01.986730+0000","last_unstale":"2023-05-24T04:01:46.661762+0000","last_undegraded":"2023-05-24T04:01:46.661762+0000","last_fullsized":"2023-05-24T04:01:46.661762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:46.661420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:46.661420+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.661420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:14:08.876249+0000","scrub_duration":0.0037910399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.623465+0000","last_change":"2023-05-24T04:01:20.623465+0000","last_active":"2023-05-24T04:01:20.623465+0000","last_peered":"2023-05-24T04:01:20.623465+0000","last_clean":"2023-05-24T04:01:20.623465+0000","last_became_active":"2023-05-24T03:59:57.919187+0000","last_became_peered":"2023-05-24T03:59:57.919187+0000","last_unstale":"2023-05-24T04:01:20.623465+0000","last_undegraded":"2023-05-24T04:01:20.623465+0000","last_fullsized":"2023-05-24T04:01:20.623465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.623341+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.623341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:43.367125+0000","scrub_duration":0.0026911190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:52.419937+0000","last_change":"2023-05-24T04:01:52.419937+0000","last_active":"2023-05-24T04:01:52.419937+0000","last_peered":"2023-05-24T04:01:52.419937+0000","last_clean":"2023-05-24T04:01:52.419937+0000","last_became_active":"2023-05-24T03:59:57.548720+0000","last_became_peered":"2023-05-24T03:59:57.548720+0000","last_unstale":"2023-05-24T04:01:52.419937+0000","last_undegraded":"2023-05-24T04:01:52.419937+0000","last_fullsized":"2023-05-24T04:01:52.419937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:52.419605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:52.419605+0000","last_clean_scrub_stamp":"2023-05-24T04:01:52.419605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:37.222469+0000","scrub_duration":0.0035731449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:14.165342+0000","last_change":"2023-05-24T04:02:14.165342+0000","last_active":"2023-05-24T04:02:14.165342+0000","last_peered":"2023-05-24T04:02:14.165342+0000","last_clean":"2023-05-24T04:02:14.165342+0000","last_became_active":"2023-05-24T04:00:01.984604+0000","last_became_peered":"2023-05-24T04:00:01.984604+0000","last_unstale":"2023-05-24T04:02:14.165342+0000","last_undegraded":"2023-05-24T04:02:14.165342+0000","last_fullsized":"2023-05-24T04:02:14.165342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:14.165004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:14.165004+0000","last_clean_scrub_stamp":"2023-05-24T04:02:14.165004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:16.249775+0000","scrub_duration":0.00379423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.924950+0000","last_change":"2023-05-24T04:01:46.924950+0000","last_active":"2023-05-24T04:01:46.924950+0000","last_peered":"2023-05-24T04:01:46.924950+0000","last_clean":"2023-05-24T04:01:46.924950+0000","last_became_active":"2023-05-24T03:59:57.547773+0000","last_became_peered":"2023-05-24T03:59:57.547773+0000","last_unstale":"2023-05-24T04:01:46.924950+0000","last_undegraded":"2023-05-24T04:01:46.924950+0000","last_fullsized":"2023-05-24T04:01:46.924950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-05-24T04:01:46.924540+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-05-24T04:01:46.924540+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.924540+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:43.218183+0000","scrub_duration":0.0085557979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.683595+0000","last_change":"2023-05-24T04:01:43.683595+0000","last_active":"2023-05-24T04:01:43.683595+0000","last_peered":"2023-05-24T04:01:43.683595+0000","last_clean":"2023-05-24T04:01:43.683595+0000","last_became_active":"2023-05-24T03:59:57.933142+0000","last_became_peered":"2023-05-24T03:59:57.933142+0000","last_unstale":"2023-05-24T04:01:43.683595+0000","last_undegraded":"2023-05-24T04:01:43.683595+0000","last_fullsized":"2023-05-24T04:01:43.683595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.683302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.683302+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.683302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:42.821935+0000","scrub_duration":0.0037036439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:21.335996+0000","last_change":"2023-05-24T04:02:21.335996+0000","last_active":"2023-05-24T04:02:21.335996+0000","last_peered":"2023-05-24T04:02:21.335996+0000","last_clean":"2023-05-24T04:02:21.335996+0000","last_became_active":"2023-05-24T04:00:01.957434+0000","last_became_peered":"2023-05-24T04:00:01.957434+0000","last_unstale":"2023-05-24T04:02:21.335996+0000","last_undegraded":"2023-05-24T04:02:21.335996+0000","last_fullsized":"2023-05-24T04:02:21.335996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:21.335652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:21.335652+0000","last_clean_scrub_stamp":"2023-05-24T04:02:21.335652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:41.594487+0000","scrub_duration":0.003863053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'22","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.292848+0000","last_change":"2023-05-24T04:01:55.292848+0000","last_active":"2023-05-24T04:01:55.292848+0000","last_peered":"2023-05-24T04:01:55.292848+0000","last_clean":"2023-05-24T04:01:55.292848+0000","last_became_active":"2023-05-24T03:59:57.553409+0000","last_became_peered":"2023-05-24T03:59:57.553409+0000","last_unstale":"2023-05-24T04:01:55.292848+0000","last_undegraded":"2023-05-24T04:01:55.292848+0000","last_fullsized":"2023-05-24T04:01:55.292848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2023-05-24T04:01:55.292550+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2023-05-24T04:01:55.292550+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.292550+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:20:06.103036+0000","scrub_duration":0.011296013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.193776+0000","last_change":"2023-05-24T04:01:23.193776+0000","last_active":"2023-05-24T04:01:23.193776+0000","last_peered":"2023-05-24T04:01:23.193776+0000","last_clean":"2023-05-24T04:01:23.193776+0000","last_became_active":"2023-05-24T03:59:57.924326+0000","last_became_peered":"2023-05-24T03:59:57.924326+0000","last_unstale":"2023-05-24T04:01:23.193776+0000","last_undegraded":"2023-05-24T04:01:23.193776+0000","last_fullsized":"2023-05-24T04:01:23.193776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.193479+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.193479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:14.734145+0000","scrub_duration":0.0035797390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:00.645438+0000","last_change":"2023-05-24T04:02:00.645438+0000","last_active":"2023-05-24T04:02:00.645438+0000","last_peered":"2023-05-24T04:02:00.645438+0000","last_clean":"2023-05-24T04:02:00.645438+0000","last_became_active":"2023-05-24T04:00:01.987825+0000","last_became_peered":"2023-05-24T04:00:01.987825+0000","last_unstale":"2023-05-24T04:02:00.645438+0000","last_undegraded":"2023-05-24T04:02:00.645438+0000","last_fullsized":"2023-05-24T04:02:00.645438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:00.645055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:00.645055+0000","last_clean_scrub_stamp":"2023-05-24T04:02:00.645055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:31.374610+0000","scrub_duration":0.0039620829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.191060+0000","last_change":"2023-05-24T04:01:25.191060+0000","last_active":"2023-05-24T04:01:25.191060+0000","last_peered":"2023-05-24T04:01:25.191060+0000","last_clean":"2023-05-24T04:01:25.191060+0000","last_became_active":"2023-05-24T03:59:57.929497+0000","last_became_peered":"2023-05-24T03:59:57.929497+0000","last_unstale":"2023-05-24T04:01:25.191060+0000","last_undegraded":"2023-05-24T04:01:25.191060+0000","last_fullsized":"2023-05-24T04:01:25.191060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.190751+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.190751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:03.676839+0000","scrub_duration":0.0032725419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.589749+0000","last_change":"2023-05-24T04:01:22.589749+0000","last_active":"2023-05-24T04:01:22.589749+0000","last_peered":"2023-05-24T04:01:22.589749+0000","last_clean":"2023-05-24T04:01:22.589749+0000","last_became_active":"2023-05-24T03:59:53.474260+0000","last_became_peered":"2023-05-24T03:59:53.474260+0000","last_unstale":"2023-05-24T04:01:22.589749+0000","last_undegraded":"2023-05-24T04:01:22.589749+0000","last_fullsized":"2023-05-24T04:01:22.589749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.589468+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.589468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:45:57.220840+0000","scrub_duration":0.0034413989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.443206+0000","last_change":"2023-05-24T04:01:35.443206+0000","last_active":"2023-05-24T04:01:35.443206+0000","last_peered":"2023-05-24T04:01:35.443206+0000","last_clean":"2023-05-24T04:01:35.443206+0000","last_became_active":"2023-05-24T03:59:57.533309+0000","last_became_peered":"2023-05-24T03:59:57.533309+0000","last_unstale":"2023-05-24T04:01:35.443206+0000","last_undegraded":"2023-05-24T04:01:35.443206+0000","last_fullsized":"2023-05-24T04:01:35.443206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:35.442898+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.442898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:31.248990+0000","scrub_duration":0.0067569300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:15.289973+0000","last_change":"2023-05-24T04:02:15.290099+0000","last_active":"2023-05-24T04:02:15.289973+0000","last_peered":"2023-05-24T04:02:15.289973+0000","last_clean":"2023-05-24T04:02:15.289973+0000","last_became_active":"2023-05-24T04:00:01.977009+0000","last_became_peered":"2023-05-24T04:00:01.977009+0000","last_unstale":"2023-05-24T04:02:15.289973+0000","last_undegraded":"2023-05-24T04:02:15.289973+0000","last_fullsized":"2023-05-24T04:02:15.289973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:15.289743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:15.289743+0000","last_clean_scrub_stamp":"2023-05-24T04:02:15.289743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:27.973343+0000","scrub_duration":0.0042023939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:56.385698+0000","last_change":"2023-05-24T04:01:56.385698+0000","last_active":"2023-05-24T04:01:56.385698+0000","last_peered":"2023-05-24T04:01:56.385698+0000","last_clean":"2023-05-24T04:01:56.385698+0000","last_became_active":"2023-05-24T03:59:57.931004+0000","last_became_peered":"2023-05-24T03:59:57.931004+0000","last_unstale":"2023-05-24T04:01:56.385698+0000","last_undegraded":"2023-05-24T04:01:56.385698+0000","last_fullsized":"2023-05-24T04:01:56.385698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:56.385366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:56.385366+0000","last_clean_scrub_stamp":"2023-05-24T04:01:56.385366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:43:47.909596+0000","scrub_duration":0.0038443430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.651747+0000","last_change":"2023-05-24T04:01:20.651747+0000","last_active":"2023-05-24T04:01:20.651747+0000","last_peered":"2023-05-24T04:01:20.651747+0000","last_clean":"2023-05-24T04:01:20.651747+0000","last_became_active":"2023-05-24T03:59:53.473578+0000","last_became_peered":"2023-05-24T03:59:53.473578+0000","last_unstale":"2023-05-24T04:01:20.651747+0000","last_undegraded":"2023-05-24T04:01:20.651747+0000","last_fullsized":"2023-05-24T04:01:20.651747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.651438+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.651438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:36:56.874342+0000","scrub_duration":0.0035848859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.471303+0000","last_change":"2023-05-24T04:01:40.471303+0000","last_active":"2023-05-24T04:01:40.471303+0000","last_peered":"2023-05-24T04:01:40.471303+0000","last_clean":"2023-05-24T04:01:40.471303+0000","last_became_active":"2023-05-24T03:59:57.549128+0000","last_became_peered":"2023-05-24T03:59:57.549128+0000","last_unstale":"2023-05-24T04:01:40.471303+0000","last_undegraded":"2023-05-24T04:01:40.471303+0000","last_fullsized":"2023-05-24T04:01:40.471303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:40.471004+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:40.471004+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.471004+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:50.192281+0000","scrub_duration":0.0070832450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:33.317328+0000","last_change":"2023-05-24T04:02:33.317568+0000","last_active":"2023-05-24T04:02:33.317328+0000","last_peered":"2023-05-24T04:02:33.317328+0000","last_clean":"2023-05-24T04:02:33.317328+0000","last_became_active":"2023-05-24T04:00:01.995100+0000","last_became_peered":"2023-05-24T04:00:01.995100+0000","last_unstale":"2023-05-24T04:02:33.317328+0000","last_undegraded":"2023-05-24T04:02:33.317328+0000","last_fullsized":"2023-05-24T04:02:33.317328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:33.317084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:33.317084+0000","last_clean_scrub_stamp":"2023-05-24T04:02:33.317084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:33:57.776734+0000","scrub_duration":0.0040555080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.480291+0000","last_change":"2023-05-24T04:01:19.480291+0000","last_active":"2023-05-24T04:01:19.480291+0000","last_peered":"2023-05-24T04:01:19.480291+0000","last_clean":"2023-05-24T04:01:19.480291+0000","last_became_active":"2023-05-24T03:59:57.929055+0000","last_became_peered":"2023-05-24T03:59:57.929055+0000","last_unstale":"2023-05-24T04:01:19.480291+0000","last_undegraded":"2023-05-24T04:01:19.480291+0000","last_fullsized":"2023-05-24T04:01:19.480291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.480118+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.480118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:23.591362+0000","scrub_duration":0.0025500269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.880382+0000","last_change":"2023-05-24T04:01:40.880382+0000","last_active":"2023-05-24T04:01:40.880382+0000","last_peered":"2023-05-24T04:01:40.880382+0000","last_clean":"2023-05-24T04:01:40.880382+0000","last_became_active":"2023-05-24T03:59:53.622101+0000","last_became_peered":"2023-05-24T03:59:53.622101+0000","last_unstale":"2023-05-24T04:01:40.880382+0000","last_undegraded":"2023-05-24T04:01:40.880382+0000","last_fullsized":"2023-05-24T04:01:40.880382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:40.880088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:40.880088+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.880088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:36.686179+0000","scrub_duration":0.003581529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.699228+0000","last_change":"2023-05-24T04:01:30.699228+0000","last_active":"2023-05-24T04:01:30.699228+0000","last_peered":"2023-05-24T04:01:30.699228+0000","last_clean":"2023-05-24T04:01:30.699228+0000","last_became_active":"2023-05-24T03:59:57.531166+0000","last_became_peered":"2023-05-24T03:59:57.531166+0000","last_unstale":"2023-05-24T04:01:30.699228+0000","last_undegraded":"2023-05-24T04:01:30.699228+0000","last_fullsized":"2023-05-24T04:01:30.699228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.698924+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.698924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:53.442708+0000","scrub_duration":0.0031884679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.604519+0000","last_change":"2023-05-24T04:01:44.604519+0000","last_active":"2023-05-24T04:01:44.604519+0000","last_peered":"2023-05-24T04:01:44.604519+0000","last_clean":"2023-05-24T04:01:44.604519+0000","last_became_active":"2023-05-24T04:00:01.961544+0000","last_became_peered":"2023-05-24T04:00:01.961544+0000","last_unstale":"2023-05-24T04:01:44.604519+0000","last_undegraded":"2023-05-24T04:01:44.604519+0000","last_fullsized":"2023-05-24T04:01:44.604519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.604016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.604016+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.604016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:02:20.806799+0000","scrub_duration":0.0037330570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.662282+0000","last_change":"2023-05-24T04:01:42.662282+0000","last_active":"2023-05-24T04:01:42.662282+0000","last_peered":"2023-05-24T04:01:42.662282+0000","last_clean":"2023-05-24T04:01:42.662282+0000","last_became_active":"2023-05-24T03:59:57.943565+0000","last_became_peered":"2023-05-24T03:59:57.943565+0000","last_unstale":"2023-05-24T04:01:42.662282+0000","last_undegraded":"2023-05-24T04:01:42.662282+0000","last_fullsized":"2023-05-24T04:01:42.662282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.661969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.661969+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.661969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:38.468061+0000","scrub_duration":0.0038420709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:25.679692+0000","last_change":"2023-05-24T04:01:25.679692+0000","last_active":"2023-05-24T04:01:25.679692+0000","last_peered":"2023-05-24T04:01:25.679692+0000","last_clean":"2023-05-24T04:01:25.679692+0000","last_became_active":"2023-05-24T03:59:53.621689+0000","last_became_peered":"2023-05-24T03:59:53.621689+0000","last_unstale":"2023-05-24T04:01:25.679692+0000","last_undegraded":"2023-05-24T04:01:25.679692+0000","last_fullsized":"2023-05-24T04:01:25.679692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:25.679377+0000","last_clean_scrub_stamp":"2023-05-24T04:01:25.679377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:03.205799+0000","scrub_duration":0.0036885849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:46.433087+0000","last_change":"2023-05-24T04:01:46.433087+0000","last_active":"2023-05-24T04:01:46.433087+0000","last_peered":"2023-05-24T04:01:46.433087+0000","last_clean":"2023-05-24T04:01:46.433087+0000","last_became_active":"2023-05-24T03:59:57.546619+0000","last_became_peered":"2023-05-24T03:59:57.546619+0000","last_unstale":"2023-05-24T04:01:46.433087+0000","last_undegraded":"2023-05-24T04:01:46.433087+0000","last_fullsized":"2023-05-24T04:01:46.433087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:46.432784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:46.432784+0000","last_clean_scrub_stamp":"2023-05-24T04:01:46.432784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:56.154061+0000","scrub_duration":0.0039204219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:59.392402+0000","last_change":"2023-05-24T04:01:59.392402+0000","last_active":"2023-05-24T04:01:59.392402+0000","last_peered":"2023-05-24T04:01:59.392402+0000","last_clean":"2023-05-24T04:01:59.392402+0000","last_became_active":"2023-05-24T04:00:01.968016+0000","last_became_peered":"2023-05-24T04:00:01.968016+0000","last_unstale":"2023-05-24T04:01:59.392402+0000","last_undegraded":"2023-05-24T04:01:59.392402+0000","last_fullsized":"2023-05-24T04:01:59.392402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:59.392072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:59.392072+0000","last_clean_scrub_stamp":"2023-05-24T04:01:59.392072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:42.660228+0000","scrub_duration":0.0037627509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.639626+0000","last_change":"2023-05-24T04:01:50.639626+0000","last_active":"2023-05-24T04:01:50.639626+0000","last_peered":"2023-05-24T04:01:50.639626+0000","last_clean":"2023-05-24T04:01:50.639626+0000","last_became_active":"2023-05-24T03:59:57.932842+0000","last_became_peered":"2023-05-24T03:59:57.932842+0000","last_unstale":"2023-05-24T04:01:50.639626+0000","last_undegraded":"2023-05-24T04:01:50.639626+0000","last_fullsized":"2023-05-24T04:01:50.639626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.639510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.639510+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.639510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:32:00.360787+0000","scrub_duration":0.0018084279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:49.333308+0000","last_change":"2023-05-24T04:01:49.333308+0000","last_active":"2023-05-24T04:01:49.333308+0000","last_peered":"2023-05-24T04:01:49.333308+0000","last_clean":"2023-05-24T04:01:49.333308+0000","last_became_active":"2023-05-24T03:59:57.543445+0000","last_became_peered":"2023-05-24T03:59:57.543445+0000","last_unstale":"2023-05-24T04:01:49.333308+0000","last_undegraded":"2023-05-24T04:01:49.333308+0000","last_fullsized":"2023-05-24T04:01:49.333308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:49.332974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:49.332974+0000","last_clean_scrub_stamp":"2023-05-24T04:01:49.332974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:33.955176+0000","scrub_duration":0.0036926239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:39.366510+0000","last_change":"2023-05-24T04:01:39.366510+0000","last_active":"2023-05-24T04:01:39.366510+0000","last_peered":"2023-05-24T04:01:39.366510+0000","last_clean":"2023-05-24T04:01:39.366510+0000","last_became_active":"2023-05-24T03:59:53.476028+0000","last_became_peered":"2023-05-24T03:59:53.476028+0000","last_unstale":"2023-05-24T04:01:39.366510+0000","last_undegraded":"2023-05-24T04:01:39.366510+0000","last_fullsized":"2023-05-24T04:01:39.366510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:39.366218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:39.366218+0000","last_clean_scrub_stamp":"2023-05-24T04:01:39.366218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:38.504851+0000","scrub_duration":0.0036500320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:14.144472+0000","last_change":"2023-05-24T04:02:14.144606+0000","last_active":"2023-05-24T04:02:14.144472+0000","last_peered":"2023-05-24T04:02:14.144472+0000","last_clean":"2023-05-24T04:02:14.144472+0000","last_became_active":"2023-05-24T04:00:01.978647+0000","last_became_peered":"2023-05-24T04:00:01.978647+0000","last_unstale":"2023-05-24T04:02:14.144472+0000","last_undegraded":"2023-05-24T04:02:14.144472+0000","last_fullsized":"2023-05-24T04:02:14.144472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:14.144217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:14.144217+0000","last_clean_scrub_stamp":"2023-05-24T04:02:14.144217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:51:58.766419+0000","scrub_duration":0.0039355299999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:02.381869+0000","last_change":"2023-05-24T04:02:02.381970+0000","last_active":"2023-05-24T04:02:02.381869+0000","last_peered":"2023-05-24T04:02:02.381869+0000","last_clean":"2023-05-24T04:02:02.381869+0000","last_became_active":"2023-05-24T04:00:40.101601+0000","last_became_peered":"2023-05-24T04:00:40.101601+0000","last_unstale":"2023-05-24T04:02:02.381869+0000","last_undegraded":"2023-05-24T04:02:02.381869+0000","last_fullsized":"2023-05-24T04:02:02.381869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:02.381670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:02.381670+0000","last_clean_scrub_stamp":"2023-05-24T04:02:02.381670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:53.249567+0000","scrub_duration":0.0037902840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.712817+0000","last_change":"2023-05-24T04:01:26.712817+0000","last_active":"2023-05-24T04:01:26.712817+0000","last_peered":"2023-05-24T04:01:26.712817+0000","last_clean":"2023-05-24T04:01:26.712817+0000","last_became_active":"2023-05-24T03:59:57.530734+0000","last_became_peered":"2023-05-24T03:59:57.530734+0000","last_unstale":"2023-05-24T04:01:26.712817+0000","last_undegraded":"2023-05-24T04:01:26.712817+0000","last_fullsized":"2023-05-24T04:01:26.712817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.712506+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.712506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:23:30.823750+0000","scrub_duration":0.0075320789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:23.403937+0000","last_change":"2023-05-24T04:01:23.403937+0000","last_active":"2023-05-24T04:01:23.403937+0000","last_peered":"2023-05-24T04:01:23.403937+0000","last_clean":"2023-05-24T04:01:23.403937+0000","last_became_active":"2023-05-24T03:59:53.897392+0000","last_became_peered":"2023-05-24T03:59:53.897392+0000","last_unstale":"2023-05-24T04:01:23.403937+0000","last_undegraded":"2023-05-24T04:01:23.403937+0000","last_fullsized":"2023-05-24T04:01:23.403937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:23.403578+0000","last_clean_scrub_stamp":"2023-05-24T04:01:23.403578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:34:05.102350+0000","scrub_duration":0.003686197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.541116+0000","last_change":"2023-05-24T04:01:53.541116+0000","last_active":"2023-05-24T04:01:53.541116+0000","last_peered":"2023-05-24T04:01:53.541116+0000","last_clean":"2023-05-24T04:01:53.541116+0000","last_became_active":"2023-05-24T04:00:01.995492+0000","last_became_peered":"2023-05-24T04:00:01.995492+0000","last_unstale":"2023-05-24T04:01:53.541116+0000","last_undegraded":"2023-05-24T04:01:53.541116+0000","last_fullsized":"2023-05-24T04:01:53.541116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:53.540576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:53.540576+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.540576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:29.763480+0000","scrub_duration":0.0040370190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.439708+0000","last_change":"2023-05-24T04:01:43.439708+0000","last_active":"2023-05-24T04:01:43.439708+0000","last_peered":"2023-05-24T04:01:43.439708+0000","last_clean":"2023-05-24T04:01:43.439708+0000","last_became_active":"2023-05-24T03:59:57.936492+0000","last_became_peered":"2023-05-24T03:59:57.936492+0000","last_unstale":"2023-05-24T04:01:43.439708+0000","last_undegraded":"2023-05-24T04:01:43.439708+0000","last_fullsized":"2023-05-24T04:01:43.439708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.439415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.439415+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.439415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:53.160692+0000","scrub_duration":0.0031035960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.426714+0000","last_change":"2023-05-24T04:01:28.426714+0000","last_active":"2023-05-24T04:01:28.426714+0000","last_peered":"2023-05-24T04:01:28.426714+0000","last_clean":"2023-05-24T04:01:28.426714+0000","last_became_active":"2023-05-24T03:59:57.564739+0000","last_became_peered":"2023-05-24T03:59:57.564739+0000","last_unstale":"2023-05-24T04:01:28.426714+0000","last_undegraded":"2023-05-24T04:01:28.426714+0000","last_fullsized":"2023-05-24T04:01:28.426714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.426401+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:31.486492+0000","scrub_duration":0.0036793720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.787411+0000","last_change":"2023-05-24T04:01:36.787411+0000","last_active":"2023-05-24T04:01:36.787411+0000","last_peered":"2023-05-24T04:01:36.787411+0000","last_clean":"2023-05-24T04:01:36.787411+0000","last_became_active":"2023-05-24T03:59:53.476240+0000","last_became_peered":"2023-05-24T03:59:53.476240+0000","last_unstale":"2023-05-24T04:01:36.787411+0000","last_undegraded":"2023-05-24T04:01:36.787411+0000","last_fullsized":"2023-05-24T04:01:36.787411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.787113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.787113+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.787113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:10.396118+0000","scrub_duration":0.0076298199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:16.538998+0000","last_change":"2023-05-24T04:02:16.539139+0000","last_active":"2023-05-24T04:02:16.538998+0000","last_peered":"2023-05-24T04:02:16.538998+0000","last_clean":"2023-05-24T04:02:16.538998+0000","last_became_active":"2023-05-24T04:00:01.979450+0000","last_became_peered":"2023-05-24T04:00:01.979450+0000","last_unstale":"2023-05-24T04:02:16.538998+0000","last_undegraded":"2023-05-24T04:02:16.538998+0000","last_fullsized":"2023-05-24T04:02:16.538998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:16.538761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:16.538761+0000","last_clean_scrub_stamp":"2023-05-24T04:02:16.538761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:44:10.957208+0000","scrub_duration":0.003811198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.619338+0000","last_change":"2023-05-24T04:01:30.619338+0000","last_active":"2023-05-24T04:01:30.619338+0000","last_peered":"2023-05-24T04:01:30.619338+0000","last_clean":"2023-05-24T04:01:30.619338+0000","last_became_active":"2023-05-24T03:59:57.933566+0000","last_became_peered":"2023-05-24T03:59:57.933566+0000","last_unstale":"2023-05-24T04:01:30.619338+0000","last_undegraded":"2023-05-24T04:01:30.619338+0000","last_fullsized":"2023-05-24T04:01:30.619338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.619015+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.619015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:36:30.639136+0000","scrub_duration":0.0034554199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.514932+0000","last_change":"2023-05-24T04:01:38.514932+0000","last_active":"2023-05-24T04:01:38.514932+0000","last_peered":"2023-05-24T04:01:38.514932+0000","last_clean":"2023-05-24T04:01:38.514932+0000","last_became_active":"2023-05-24T03:59:57.543663+0000","last_became_peered":"2023-05-24T03:59:57.543663+0000","last_unstale":"2023-05-24T04:01:38.514932+0000","last_undegraded":"2023-05-24T04:01:38.514932+0000","last_fullsized":"2023-05-24T04:01:38.514932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.514605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.514605+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.514605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:34.808247+0000","scrub_duration":0.0034984259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.340209+0000","last_change":"2023-05-24T04:01:38.340209+0000","last_active":"2023-05-24T04:01:38.340209+0000","last_peered":"2023-05-24T04:01:38.340209+0000","last_clean":"2023-05-24T04:01:38.340209+0000","last_became_active":"2023-05-24T03:59:53.473611+0000","last_became_peered":"2023-05-24T03:59:53.473611+0000","last_unstale":"2023-05-24T04:01:38.340209+0000","last_undegraded":"2023-05-24T04:01:38.340209+0000","last_fullsized":"2023-05-24T04:01:38.340209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.339881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.339881+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.339881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:34.145972+0000","scrub_duration":0.0037010139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.727356+0000","last_change":"2023-05-24T04:01:32.727356+0000","last_active":"2023-05-24T04:01:32.727356+0000","last_peered":"2023-05-24T04:01:32.727356+0000","last_clean":"2023-05-24T04:01:32.727356+0000","last_became_active":"2023-05-24T03:59:47.865110+0000","last_became_peered":"2023-05-24T03:59:47.865110+0000","last_unstale":"2023-05-24T04:01:32.727356+0000","last_undegraded":"2023-05-24T04:01:32.727356+0000","last_fullsized":"2023-05-24T04:01:32.727356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-05-24T04:01:32.727017+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.727017+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:35.787107+0000","scrub_duration":0.013968662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:30.235218+0000","last_change":"2023-05-24T04:02:30.235353+0000","last_active":"2023-05-24T04:02:30.235218+0000","last_peered":"2023-05-24T04:02:30.235218+0000","last_clean":"2023-05-24T04:02:30.235218+0000","last_became_active":"2023-05-24T04:00:01.994217+0000","last_became_peered":"2023-05-24T04:00:01.994217+0000","last_unstale":"2023-05-24T04:02:30.235218+0000","last_undegraded":"2023-05-24T04:02:30.235218+0000","last_fullsized":"2023-05-24T04:02:30.235218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:30.235004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:30.235004+0000","last_clean_scrub_stamp":"2023-05-24T04:02:30.235004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:20:18.425571+0000","scrub_duration":0.0038548979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:49.633595+0000","last_change":"2023-05-24T04:01:49.633595+0000","last_active":"2023-05-24T04:01:49.633595+0000","last_peered":"2023-05-24T04:01:49.633595+0000","last_clean":"2023-05-24T04:01:49.633595+0000","last_became_active":"2023-05-24T03:59:57.933180+0000","last_became_peered":"2023-05-24T03:59:57.933180+0000","last_unstale":"2023-05-24T04:01:49.633595+0000","last_undegraded":"2023-05-24T04:01:49.633595+0000","last_fullsized":"2023-05-24T04:01:49.633595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:49.633185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:49.633185+0000","last_clean_scrub_stamp":"2023-05-24T04:01:49.633185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:48.986898+0000","scrub_duration":0.0034477499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:32.583136+0000","last_change":"2023-05-24T04:01:32.583136+0000","last_active":"2023-05-24T04:01:32.583136+0000","last_peered":"2023-05-24T04:01:32.583136+0000","last_clean":"2023-05-24T04:01:32.583136+0000","last_became_active":"2023-05-24T03:59:57.536370+0000","last_became_peered":"2023-05-24T03:59:57.536370+0000","last_unstale":"2023-05-24T04:01:32.583136+0000","last_undegraded":"2023-05-24T04:01:32.583136+0000","last_fullsized":"2023-05-24T04:01:32.583136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:32.582758+0000","last_clean_scrub_stamp":"2023-05-24T04:01:32.582758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:28.388850+0000","scrub_duration":0.0033355210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:32.311114+0000","last_change":"2023-05-24T04:02:32.311243+0000","last_active":"2023-05-24T04:02:32.311114+0000","last_peered":"2023-05-24T04:02:32.311114+0000","last_clean":"2023-05-24T04:02:32.311114+0000","last_became_active":"2023-05-24T04:00:01.973848+0000","last_became_peered":"2023-05-24T04:00:01.973848+0000","last_unstale":"2023-05-24T04:02:32.311114+0000","last_undegraded":"2023-05-24T04:02:32.311114+0000","last_fullsized":"2023-05-24T04:02:32.311114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:32.310901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:32.310901+0000","last_clean_scrub_stamp":"2023-05-24T04:02:32.310901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:50:01.748677+0000","scrub_duration":0.0041114050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:21.224114+0000","last_change":"2023-05-24T04:01:21.224114+0000","last_active":"2023-05-24T04:01:21.224114+0000","last_peered":"2023-05-24T04:01:21.224114+0000","last_clean":"2023-05-24T04:01:21.224114+0000","last_became_active":"2023-05-24T03:59:57.924917+0000","last_became_peered":"2023-05-24T03:59:57.924917+0000","last_unstale":"2023-05-24T04:01:21.224114+0000","last_undegraded":"2023-05-24T04:01:21.224114+0000","last_fullsized":"2023-05-24T04:01:21.224114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:21.223826+0000","last_clean_scrub_stamp":"2023-05-24T04:01:21.223826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:20.577539+0000","scrub_duration":0.003384424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:43.418527+0000","last_change":"2023-05-24T04:01:43.418527+0000","last_active":"2023-05-24T04:01:43.418527+0000","last_peered":"2023-05-24T04:01:43.418527+0000","last_clean":"2023-05-24T04:01:43.418527+0000","last_became_active":"2023-05-24T03:59:57.543720+0000","last_became_peered":"2023-05-24T03:59:57.543720+0000","last_unstale":"2023-05-24T04:01:43.418527+0000","last_undegraded":"2023-05-24T04:01:43.418527+0000","last_fullsized":"2023-05-24T04:01:43.418527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:43.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:43.418236+0000","last_clean_scrub_stamp":"2023-05-24T04:01:43.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:31:45.503007+0000","scrub_duration":0.0037295280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:23.667747+0000","last_change":"2023-05-24T04:02:23.667931+0000","last_active":"2023-05-24T04:02:23.667747+0000","last_peered":"2023-05-24T04:02:23.667747+0000","last_clean":"2023-05-24T04:02:23.667747+0000","last_became_active":"2023-05-24T04:00:01.979708+0000","last_became_peered":"2023-05-24T04:00:01.979708+0000","last_unstale":"2023-05-24T04:02:23.667747+0000","last_undegraded":"2023-05-24T04:02:23.667747+0000","last_fullsized":"2023-05-24T04:02:23.667747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:23.667496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:23.667496+0000","last_clean_scrub_stamp":"2023-05-24T04:02:23.667496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:36.351096+0000","scrub_duration":0.0040085329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:22.182646+0000","last_change":"2023-05-24T04:01:22.182646+0000","last_active":"2023-05-24T04:01:22.182646+0000","last_peered":"2023-05-24T04:01:22.182646+0000","last_clean":"2023-05-24T04:01:22.182646+0000","last_became_active":"2023-05-24T03:59:57.922907+0000","last_became_peered":"2023-05-24T03:59:57.922907+0000","last_unstale":"2023-05-24T04:01:22.182646+0000","last_undegraded":"2023-05-24T04:01:22.182646+0000","last_fullsized":"2023-05-24T04:01:22.182646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:22.182299+0000","last_clean_scrub_stamp":"2023-05-24T04:01:22.182299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:31.903576+0000","scrub_duration":0.0036481510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.639425+0000","last_change":"2023-05-24T04:01:28.639425+0000","last_active":"2023-05-24T04:01:28.639425+0000","last_peered":"2023-05-24T04:01:28.639425+0000","last_clean":"2023-05-24T04:01:28.639425+0000","last_became_active":"2023-05-24T03:59:57.559464+0000","last_became_peered":"2023-05-24T03:59:57.559464+0000","last_unstale":"2023-05-24T04:01:28.639425+0000","last_undegraded":"2023-05-24T04:01:28.639425+0000","last_fullsized":"2023-05-24T04:01:28.639425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.639145+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.639145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:22:23.648965+0000","scrub_duration":0.0032025460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:56.659530+0000","last_change":"2023-05-24T04:01:56.659530+0000","last_active":"2023-05-24T04:01:56.659530+0000","last_peered":"2023-05-24T04:01:56.659530+0000","last_clean":"2023-05-24T04:01:56.659530+0000","last_became_active":"2023-05-24T04:00:01.976695+0000","last_became_peered":"2023-05-24T04:00:01.976695+0000","last_unstale":"2023-05-24T04:01:56.659530+0000","last_undegraded":"2023-05-24T04:01:56.659530+0000","last_fullsized":"2023-05-24T04:01:56.659530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:56.659187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:56.659187+0000","last_clean_scrub_stamp":"2023-05-24T04:01:56.659187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:41.462050+0000","scrub_duration":0.0037789669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:07.232603+0000","last_change":"2023-05-24T04:02:07.232603+0000","last_active":"2023-05-24T04:02:07.232603+0000","last_peered":"2023-05-24T04:02:07.232603+0000","last_clean":"2023-05-24T04:02:07.232603+0000","last_became_active":"2023-05-24T03:59:57.929962+0000","last_became_peered":"2023-05-24T03:59:57.929962+0000","last_unstale":"2023-05-24T04:02:07.232603+0000","last_undegraded":"2023-05-24T04:02:07.232603+0000","last_fullsized":"2023-05-24T04:02:07.232603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:07.232132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:07.232132+0000","last_clean_scrub_stamp":"2023-05-24T04:02:07.232132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:55.990002+0000","scrub_duration":0.0034619910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:45.466577+0000","last_change":"2023-05-24T04:01:45.466577+0000","last_active":"2023-05-24T04:01:45.466577+0000","last_peered":"2023-05-24T04:01:45.466577+0000","last_clean":"2023-05-24T04:01:45.466577+0000","last_became_active":"2023-05-24T03:59:57.544316+0000","last_became_peered":"2023-05-24T03:59:57.544316+0000","last_unstale":"2023-05-24T04:01:45.466577+0000","last_undegraded":"2023-05-24T04:01:45.466577+0000","last_fullsized":"2023-05-24T04:01:45.466577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:45.466250+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:45.466250+0000","last_clean_scrub_stamp":"2023-05-24T04:01:45.466250+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:23.952338+0000","scrub_duration":0.0064192219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:54.561285+0000","last_change":"2023-05-24T04:01:54.561285+0000","last_active":"2023-05-24T04:01:54.561285+0000","last_peered":"2023-05-24T04:01:54.561285+0000","last_clean":"2023-05-24T04:01:54.561285+0000","last_became_active":"2023-05-24T04:00:01.994297+0000","last_became_peered":"2023-05-24T04:00:01.994297+0000","last_unstale":"2023-05-24T04:01:54.561285+0000","last_undegraded":"2023-05-24T04:01:54.561285+0000","last_fullsized":"2023-05-24T04:01:54.561285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:54.560915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:54.560915+0000","last_clean_scrub_stamp":"2023-05-24T04:01:54.560915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:14:16.775744+0000","scrub_duration":0.0042359340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:18.500643+0000","last_change":"2023-05-24T04:01:18.500643+0000","last_active":"2023-05-24T04:01:18.500643+0000","last_peered":"2023-05-24T04:01:18.500643+0000","last_clean":"2023-05-24T04:01:18.500643+0000","last_became_active":"2023-05-24T03:59:57.933852+0000","last_became_peered":"2023-05-24T03:59:57.933852+0000","last_unstale":"2023-05-24T04:01:18.500643+0000","last_undegraded":"2023-05-24T04:01:18.500643+0000","last_fullsized":"2023-05-24T04:01:18.500643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:18.500449+0000","last_clean_scrub_stamp":"2023-05-24T04:01:18.500449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:29:56.026871+0000","scrub_duration":0.002394424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.398755+0000","last_change":"2023-05-24T04:01:44.398755+0000","last_active":"2023-05-24T04:01:44.398755+0000","last_peered":"2023-05-24T04:01:44.398755+0000","last_clean":"2023-05-24T04:01:44.398755+0000","last_became_active":"2023-05-24T03:59:57.546591+0000","last_became_peered":"2023-05-24T03:59:57.546591+0000","last_unstale":"2023-05-24T04:01:44.398755+0000","last_undegraded":"2023-05-24T04:01:44.398755+0000","last_fullsized":"2023-05-24T04:01:44.398755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.398442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.398442+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.398442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:40.692084+0000","scrub_duration":0.003757781,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:50.594674+0000","last_change":"2023-05-24T04:01:50.594674+0000","last_active":"2023-05-24T04:01:50.594674+0000","last_peered":"2023-05-24T04:01:50.594674+0000","last_clean":"2023-05-24T04:01:50.594674+0000","last_became_active":"2023-05-24T04:00:01.972265+0000","last_became_peered":"2023-05-24T04:00:01.972265+0000","last_unstale":"2023-05-24T04:01:50.594674+0000","last_undegraded":"2023-05-24T04:01:50.594674+0000","last_fullsized":"2023-05-24T04:01:50.594674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:50.594348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:50.594348+0000","last_clean_scrub_stamp":"2023-05-24T04:01:50.594348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:36:58.756373+0000","scrub_duration":0.003806481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.691478+0000","last_change":"2023-05-24T04:01:38.691478+0000","last_active":"2023-05-24T04:01:38.691478+0000","last_peered":"2023-05-24T04:01:38.691478+0000","last_clean":"2023-05-24T04:01:38.691478+0000","last_became_active":"2023-05-24T03:59:57.941302+0000","last_became_peered":"2023-05-24T03:59:57.941302+0000","last_unstale":"2023-05-24T04:01:38.691478+0000","last_undegraded":"2023-05-24T04:01:38.691478+0000","last_fullsized":"2023-05-24T04:01:38.691478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.691168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.691168+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.691168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:33:29.718005+0000","scrub_duration":0.0036320480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.926300+0000","last_change":"2023-05-24T04:01:48.926300+0000","last_active":"2023-05-24T04:01:48.926300+0000","last_peered":"2023-05-24T04:01:48.926300+0000","last_clean":"2023-05-24T04:01:48.926300+0000","last_became_active":"2023-05-24T03:59:57.551728+0000","last_became_peered":"2023-05-24T03:59:57.551728+0000","last_unstale":"2023-05-24T04:01:48.926300+0000","last_undegraded":"2023-05-24T04:01:48.926300+0000","last_fullsized":"2023-05-24T04:01:48.926300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:48.925963+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:48.925963+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.925963+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:58.647240+0000","scrub_duration":0.0065857550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:57.541361+0000","last_change":"2023-05-24T04:01:57.541361+0000","last_active":"2023-05-24T04:01:57.541361+0000","last_peered":"2023-05-24T04:01:57.541361+0000","last_clean":"2023-05-24T04:01:57.541361+0000","last_became_active":"2023-05-24T04:00:01.967450+0000","last_became_peered":"2023-05-24T04:00:01.967450+0000","last_unstale":"2023-05-24T04:01:57.541361+0000","last_undegraded":"2023-05-24T04:01:57.541361+0000","last_fullsized":"2023-05-24T04:01:57.541361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:57.540891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:57.540891+0000","last_clean_scrub_stamp":"2023-05-24T04:01:57.540891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:35.067313+0000","scrub_duration":0.0044948619999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:11.234556+0000","last_change":"2023-05-24T04:02:11.234556+0000","last_active":"2023-05-24T04:02:11.234556+0000","last_peered":"2023-05-24T04:02:11.234556+0000","last_clean":"2023-05-24T04:02:11.234556+0000","last_became_active":"2023-05-24T03:59:57.938738+0000","last_became_peered":"2023-05-24T03:59:57.938738+0000","last_unstale":"2023-05-24T04:02:11.234556+0000","last_undegraded":"2023-05-24T04:02:11.234556+0000","last_fullsized":"2023-05-24T04:02:11.234556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:11.234166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:11.234166+0000","last_clean_scrub_stamp":"2023-05-24T04:02:11.234166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:35:02.160810+0000","scrub_duration":0.0040227229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.682735+0000","last_change":"2023-05-24T04:01:28.682735+0000","last_active":"2023-05-24T04:01:28.682735+0000","last_peered":"2023-05-24T04:01:28.682735+0000","last_clean":"2023-05-24T04:01:28.682735+0000","last_became_active":"2023-05-24T03:59:57.565299+0000","last_became_peered":"2023-05-24T03:59:57.565299+0000","last_unstale":"2023-05-24T04:01:28.682735+0000","last_undegraded":"2023-05-24T04:01:28.682735+0000","last_fullsized":"2023-05-24T04:01:28.682735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-05-24T04:01:28.682312+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.682312+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:51.426096+0000","scrub_duration":0.0083039610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:52.564673+0000","last_change":"2023-05-24T04:01:52.564673+0000","last_active":"2023-05-24T04:01:52.564673+0000","last_peered":"2023-05-24T04:01:52.564673+0000","last_clean":"2023-05-24T04:01:52.564673+0000","last_became_active":"2023-05-24T04:00:01.964015+0000","last_became_peered":"2023-05-24T04:00:01.964015+0000","last_unstale":"2023-05-24T04:01:52.564673+0000","last_undegraded":"2023-05-24T04:01:52.564673+0000","last_fullsized":"2023-05-24T04:01:52.564673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:52.564264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:52.564264+0000","last_clean_scrub_stamp":"2023-05-24T04:01:52.564264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:02:28.767046+0000","scrub_duration":0.003889867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:32.670952+0000","last_change":"2023-05-24T04:02:32.671047+0000","last_active":"2023-05-24T04:02:32.670952+0000","last_peered":"2023-05-24T04:02:32.670952+0000","last_clean":"2023-05-24T04:02:32.670952+0000","last_became_active":"2023-05-24T03:59:57.923002+0000","last_became_peered":"2023-05-24T03:59:57.923002+0000","last_unstale":"2023-05-24T04:02:32.670952+0000","last_undegraded":"2023-05-24T04:02:32.670952+0000","last_fullsized":"2023-05-24T04:02:32.670952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:32.670701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:32.670701+0000","last_clean_scrub_stamp":"2023-05-24T04:02:32.670701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:33:21.428571+0000","scrub_duration":0.0034276150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:53.910386+0000","last_change":"2023-05-24T04:01:53.910386+0000","last_active":"2023-05-24T04:01:53.910386+0000","last_peered":"2023-05-24T04:01:53.910386+0000","last_clean":"2023-05-24T04:01:53.910386+0000","last_became_active":"2023-05-24T03:59:57.569814+0000","last_became_peered":"2023-05-24T03:59:57.569814+0000","last_unstale":"2023-05-24T04:01:53.910386+0000","last_undegraded":"2023-05-24T04:01:53.910386+0000","last_fullsized":"2023-05-24T04:01:53.910386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-05-24T04:01:53.910051+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-05-24T04:01:53.910051+0000","last_clean_scrub_stamp":"2023-05-24T04:01:53.910051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:32.396139+0000","scrub_duration":0.0071371179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:28.244022+0000","last_change":"2023-05-24T04:02:28.244199+0000","last_active":"2023-05-24T04:02:28.244022+0000","last_peered":"2023-05-24T04:02:28.244022+0000","last_clean":"2023-05-24T04:02:28.244022+0000","last_became_active":"2023-05-24T04:00:01.984731+0000","last_became_peered":"2023-05-24T04:00:01.984731+0000","last_unstale":"2023-05-24T04:02:28.244022+0000","last_undegraded":"2023-05-24T04:02:28.244022+0000","last_fullsized":"2023-05-24T04:02:28.244022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:28.243806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:28.243806+0000","last_clean_scrub_stamp":"2023-05-24T04:02:28.243806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:20:39.054292+0000","scrub_duration":0.0041559270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:29.661908+0000","last_change":"2023-05-24T04:02:29.662088+0000","last_active":"2023-05-24T04:02:29.661908+0000","last_peered":"2023-05-24T04:02:29.661908+0000","last_clean":"2023-05-24T04:02:29.661908+0000","last_became_active":"2023-05-24T04:00:01.958701+0000","last_became_peered":"2023-05-24T04:00:01.958701+0000","last_unstale":"2023-05-24T04:02:29.661908+0000","last_undegraded":"2023-05-24T04:02:29.661908+0000","last_fullsized":"2023-05-24T04:02:29.661908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:29.661677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:29.661677+0000","last_clean_scrub_stamp":"2023-05-24T04:02:29.661677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:49.920513+0000","scrub_duration":0.0039283039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'12","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.593566+0000","last_change":"2023-05-24T04:01:26.593566+0000","last_active":"2023-05-24T04:01:26.593566+0000","last_peered":"2023-05-24T04:01:26.593566+0000","last_clean":"2023-05-24T04:01:26.593566+0000","last_became_active":"2023-05-24T03:59:57.530144+0000","last_became_peered":"2023-05-24T03:59:57.530144+0000","last_unstale":"2023-05-24T04:01:26.593566+0000","last_undegraded":"2023-05-24T04:01:26.593566+0000","last_fullsized":"2023-05-24T04:01:26.593566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2023-05-24T04:01:26.593234+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.593234+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:45.271490+0000","scrub_duration":0.010776361999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:02.286068+0000","last_change":"2023-05-24T04:02:02.286068+0000","last_active":"2023-05-24T04:02:02.286068+0000","last_peered":"2023-05-24T04:02:02.286068+0000","last_clean":"2023-05-24T04:02:02.286068+0000","last_became_active":"2023-05-24T03:59:57.930758+0000","last_became_peered":"2023-05-24T03:59:57.930758+0000","last_unstale":"2023-05-24T04:02:02.286068+0000","last_undegraded":"2023-05-24T04:02:02.286068+0000","last_fullsized":"2023-05-24T04:02:02.286068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:02.285741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:02.285741+0000","last_clean_scrub_stamp":"2023-05-24T04:02:02.285741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:04.370512+0000","scrub_duration":0.0036832649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:22.341010+0000","last_change":"2023-05-24T04:02:22.341010+0000","last_active":"2023-05-24T04:02:22.341010+0000","last_peered":"2023-05-24T04:02:22.341010+0000","last_clean":"2023-05-24T04:02:22.341010+0000","last_became_active":"2023-05-24T04:00:01.984561+0000","last_became_peered":"2023-05-24T04:00:01.984561+0000","last_unstale":"2023-05-24T04:02:22.341010+0000","last_undegraded":"2023-05-24T04:02:22.341010+0000","last_fullsized":"2023-05-24T04:02:22.341010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:22.340829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:22.340829+0000","last_clean_scrub_stamp":"2023-05-24T04:02:22.340829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:50:40.492811+0000","scrub_duration":0.002961085,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:41.901166+0000","last_change":"2023-05-24T04:01:41.901166+0000","last_active":"2023-05-24T04:01:41.901166+0000","last_peered":"2023-05-24T04:01:41.901166+0000","last_clean":"2023-05-24T04:01:41.901166+0000","last_became_active":"2023-05-24T03:59:57.566994+0000","last_became_peered":"2023-05-24T03:59:57.566994+0000","last_unstale":"2023-05-24T04:01:41.901166+0000","last_undegraded":"2023-05-24T04:01:41.901166+0000","last_fullsized":"2023-05-24T04:01:41.901166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:41.900867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:41.900867+0000","last_clean_scrub_stamp":"2023-05-24T04:01:41.900867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:41.039500+0000","scrub_duration":0.0032151889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:58.377145+0000","last_change":"2023-05-24T04:01:58.377145+0000","last_active":"2023-05-24T04:01:58.377145+0000","last_peered":"2023-05-24T04:01:58.377145+0000","last_clean":"2023-05-24T04:01:58.377145+0000","last_became_active":"2023-05-24T03:59:57.914751+0000","last_became_peered":"2023-05-24T03:59:57.914751+0000","last_unstale":"2023-05-24T04:01:58.377145+0000","last_undegraded":"2023-05-24T04:01:58.377145+0000","last_fullsized":"2023-05-24T04:01:58.377145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:58.376848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:58.376848+0000","last_clean_scrub_stamp":"2023-05-24T04:01:58.376848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:51:08.891475+0000","scrub_duration":0.0034678589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:24.471496+0000","last_change":"2023-05-24T04:01:24.471496+0000","last_active":"2023-05-24T04:01:24.471496+0000","last_peered":"2023-05-24T04:01:24.471496+0000","last_clean":"2023-05-24T04:01:24.471496+0000","last_became_active":"2023-05-24T03:59:57.547377+0000","last_became_peered":"2023-05-24T03:59:57.547377+0000","last_unstale":"2023-05-24T04:01:24.471496+0000","last_undegraded":"2023-05-24T04:01:24.471496+0000","last_fullsized":"2023-05-24T04:01:24.471496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:24.471086+0000","last_clean_scrub_stamp":"2023-05-24T04:01:24.471086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:02.166879+0000","scrub_duration":0.003897663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.441761+0000","last_change":"2023-05-24T04:01:30.441761+0000","last_active":"2023-05-24T04:01:30.441761+0000","last_peered":"2023-05-24T04:01:30.441761+0000","last_clean":"2023-05-24T04:01:30.441761+0000","last_became_active":"2023-05-24T03:59:57.940423+0000","last_became_peered":"2023-05-24T03:59:57.940423+0000","last_unstale":"2023-05-24T04:01:30.441761+0000","last_undegraded":"2023-05-24T04:01:30.441761+0000","last_fullsized":"2023-05-24T04:01:30.441761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.441462+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.441462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:33.501553+0000","scrub_duration":0.0033727969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:16.338480+0000","last_change":"2023-05-24T04:02:16.338480+0000","last_active":"2023-05-24T04:02:16.338480+0000","last_peered":"2023-05-24T04:02:16.338480+0000","last_clean":"2023-05-24T04:02:16.338480+0000","last_became_active":"2023-05-24T04:00:01.983373+0000","last_became_peered":"2023-05-24T04:00:01.983373+0000","last_unstale":"2023-05-24T04:02:16.338480+0000","last_undegraded":"2023-05-24T04:02:16.338480+0000","last_fullsized":"2023-05-24T04:02:16.338480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:16.338109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:16.338109+0000","last_clean_scrub_stamp":"2023-05-24T04:02:16.338109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:20:04.528677+0000","scrub_duration":0.004010535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:47.968912+0000","last_change":"2023-05-24T04:01:47.968912+0000","last_active":"2023-05-24T04:01:47.968912+0000","last_peered":"2023-05-24T04:01:47.968912+0000","last_clean":"2023-05-24T04:01:47.968912+0000","last_became_active":"2023-05-24T03:59:57.566630+0000","last_became_peered":"2023-05-24T03:59:57.566630+0000","last_unstale":"2023-05-24T04:01:47.968912+0000","last_undegraded":"2023-05-24T04:01:47.968912+0000","last_fullsized":"2023-05-24T04:01:47.968912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-05-24T04:01:47.968582+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-05-24T04:01:47.968582+0000","last_clean_scrub_stamp":"2023-05-24T04:01:47.968582+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:47.322295+0000","scrub_duration":0.010408659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:19.660455+0000","last_change":"2023-05-24T04:01:19.660455+0000","last_active":"2023-05-24T04:01:19.660455+0000","last_peered":"2023-05-24T04:01:19.660455+0000","last_clean":"2023-05-24T04:01:19.660455+0000","last_became_active":"2023-05-24T03:59:57.937336+0000","last_became_peered":"2023-05-24T03:59:57.937336+0000","last_unstale":"2023-05-24T04:01:19.660455+0000","last_undegraded":"2023-05-24T04:01:19.660455+0000","last_fullsized":"2023-05-24T04:01:19.660455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:19.660252+0000","last_clean_scrub_stamp":"2023-05-24T04:01:19.660252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:22:10.528149+0000","scrub_duration":0.0021841819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:24.660817+0000","last_change":"2023-05-24T04:02:24.660817+0000","last_active":"2023-05-24T04:02:24.660817+0000","last_peered":"2023-05-24T04:02:24.660817+0000","last_clean":"2023-05-24T04:02:24.660817+0000","last_became_active":"2023-05-24T04:00:01.955275+0000","last_became_peered":"2023-05-24T04:00:01.955275+0000","last_unstale":"2023-05-24T04:02:24.660817+0000","last_undegraded":"2023-05-24T04:02:24.660817+0000","last_fullsized":"2023-05-24T04:02:24.660817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:24.660422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:24.660422+0000","last_clean_scrub_stamp":"2023-05-24T04:02:24.660422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:20:12.850989+0000","scrub_duration":0.0045920379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:37.715058+0000","last_change":"2023-05-24T04:01:37.715058+0000","last_active":"2023-05-24T04:01:37.715058+0000","last_peered":"2023-05-24T04:01:37.715058+0000","last_clean":"2023-05-24T04:01:37.715058+0000","last_became_active":"2023-05-24T03:59:57.918733+0000","last_became_peered":"2023-05-24T03:59:57.918733+0000","last_unstale":"2023-05-24T04:01:37.715058+0000","last_undegraded":"2023-05-24T04:01:37.715058+0000","last_fullsized":"2023-05-24T04:01:37.715058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:37.714599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:37.714599+0000","last_clean_scrub_stamp":"2023-05-24T04:01:37.714599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:10:58.960865+0000","scrub_duration":0.0035932920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:28.608543+0000","last_change":"2023-05-24T04:01:28.608543+0000","last_active":"2023-05-24T04:01:28.608543+0000","last_peered":"2023-05-24T04:01:28.608543+0000","last_clean":"2023-05-24T04:01:28.608543+0000","last_became_active":"2023-05-24T03:59:57.937317+0000","last_became_peered":"2023-05-24T03:59:57.937317+0000","last_unstale":"2023-05-24T04:01:28.608543+0000","last_undegraded":"2023-05-24T04:01:28.608543+0000","last_fullsized":"2023-05-24T04:01:28.608543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:28.608121+0000","last_clean_scrub_stamp":"2023-05-24T04:01:28.608121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:02.217126+0000","scrub_duration":0.003151638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:03.197202+0000","last_change":"2023-05-24T04:02:03.197202+0000","last_active":"2023-05-24T04:02:03.197202+0000","last_peered":"2023-05-24T04:02:03.197202+0000","last_clean":"2023-05-24T04:02:03.197202+0000","last_became_active":"2023-05-24T03:59:57.924151+0000","last_became_peered":"2023-05-24T03:59:57.924151+0000","last_unstale":"2023-05-24T04:02:03.197202+0000","last_undegraded":"2023-05-24T04:02:03.197202+0000","last_fullsized":"2023-05-24T04:02:03.197202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:03.196919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:03.196919+0000","last_clean_scrub_stamp":"2023-05-24T04:02:03.196919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:13:57.881045+0000","scrub_duration":0.0031955859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:57.366451+0000","last_change":"2023-05-24T04:01:57.366451+0000","last_active":"2023-05-24T04:01:57.366451+0000","last_peered":"2023-05-24T04:01:57.366451+0000","last_clean":"2023-05-24T04:01:57.366451+0000","last_became_active":"2023-05-24T03:59:57.930528+0000","last_became_peered":"2023-05-24T03:59:57.930528+0000","last_unstale":"2023-05-24T04:01:57.366451+0000","last_undegraded":"2023-05-24T04:01:57.366451+0000","last_fullsized":"2023-05-24T04:01:57.366451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:57.366142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:57.366142+0000","last_clean_scrub_stamp":"2023-05-24T04:01:57.366142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:44:40.431018+0000","scrub_duration":0.0038440430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:38.665712+0000","last_change":"2023-05-24T04:01:38.665712+0000","last_active":"2023-05-24T04:01:38.665712+0000","last_peered":"2023-05-24T04:01:38.665712+0000","last_clean":"2023-05-24T04:01:38.665712+0000","last_became_active":"2023-05-24T03:59:57.934297+0000","last_became_peered":"2023-05-24T03:59:57.934297+0000","last_unstale":"2023-05-24T04:01:38.665712+0000","last_undegraded":"2023-05-24T04:01:38.665712+0000","last_fullsized":"2023-05-24T04:01:38.665712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:38.665421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:38.665421+0000","last_clean_scrub_stamp":"2023-05-24T04:01:38.665421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:12.274426+0000","scrub_duration":0.0037066880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:01.429912+0000","last_change":"2023-05-24T04:02:01.429912+0000","last_active":"2023-05-24T04:02:01.429912+0000","last_peered":"2023-05-24T04:02:01.429912+0000","last_clean":"2023-05-24T04:02:01.429912+0000","last_became_active":"2023-05-24T03:59:57.932119+0000","last_became_peered":"2023-05-24T03:59:57.932119+0000","last_unstale":"2023-05-24T04:02:01.429912+0000","last_undegraded":"2023-05-24T04:02:01.429912+0000","last_fullsized":"2023-05-24T04:02:01.429912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:01.429604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:01.429604+0000","last_clean_scrub_stamp":"2023-05-24T04:02:01.429604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:07.404512+0000","scrub_duration":0.003172879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.670258+0000","last_change":"2023-05-24T04:01:34.670258+0000","last_active":"2023-05-24T04:01:34.670258+0000","last_peered":"2023-05-24T04:01:34.670258+0000","last_clean":"2023-05-24T04:01:34.670258+0000","last_became_active":"2023-05-24T03:59:57.932933+0000","last_became_peered":"2023-05-24T03:59:57.932933+0000","last_unstale":"2023-05-24T04:01:34.670258+0000","last_undegraded":"2023-05-24T04:01:34.670258+0000","last_fullsized":"2023-05-24T04:01:34.670258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.669939+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.669939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:37.730029+0000","scrub_duration":0.0034536499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.682421+0000","last_change":"2023-05-24T04:01:48.682421+0000","last_active":"2023-05-24T04:01:48.682421+0000","last_peered":"2023-05-24T04:01:48.682421+0000","last_clean":"2023-05-24T04:01:48.682421+0000","last_became_active":"2023-05-24T03:59:57.933625+0000","last_became_peered":"2023-05-24T03:59:57.933625+0000","last_unstale":"2023-05-24T04:01:48.682421+0000","last_undegraded":"2023-05-24T04:01:48.682421+0000","last_fullsized":"2023-05-24T04:01:48.682421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:48.682117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:48.682117+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.682117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:44.975759+0000","scrub_duration":0.0036825590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:06.007614+0000","last_change":"2023-05-24T04:02:06.007614+0000","last_active":"2023-05-24T04:02:06.007614+0000","last_peered":"2023-05-24T04:02:06.007614+0000","last_clean":"2023-05-24T04:02:06.007614+0000","last_became_active":"2023-05-24T03:59:57.930429+0000","last_became_peered":"2023-05-24T03:59:57.930429+0000","last_unstale":"2023-05-24T04:02:06.007614+0000","last_undegraded":"2023-05-24T04:02:06.007614+0000","last_fullsized":"2023-05-24T04:02:06.007614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:06.007306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:06.007306+0000","last_clean_scrub_stamp":"2023-05-24T04:02:06.007306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:49.275462+0000","scrub_duration":0.0037354580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:55.375016+0000","last_change":"2023-05-24T04:01:55.375016+0000","last_active":"2023-05-24T04:01:55.375016+0000","last_peered":"2023-05-24T04:01:55.375016+0000","last_clean":"2023-05-24T04:01:55.375016+0000","last_became_active":"2023-05-24T03:59:57.910669+0000","last_became_peered":"2023-05-24T03:59:57.910669+0000","last_unstale":"2023-05-24T04:01:55.375016+0000","last_undegraded":"2023-05-24T04:01:55.375016+0000","last_fullsized":"2023-05-24T04:01:55.375016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:55.374597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:55.374597+0000","last_clean_scrub_stamp":"2023-05-24T04:01:55.374597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:01.349504+0000","scrub_duration":0.0031554949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.398595+0000","last_change":"2023-05-24T04:01:36.398595+0000","last_active":"2023-05-24T04:01:36.398595+0000","last_peered":"2023-05-24T04:01:36.398595+0000","last_clean":"2023-05-24T04:01:36.398595+0000","last_became_active":"2023-05-24T03:59:57.936625+0000","last_became_peered":"2023-05-24T03:59:57.936625+0000","last_unstale":"2023-05-24T04:01:36.398595+0000","last_undegraded":"2023-05-24T04:01:36.398595+0000","last_fullsized":"2023-05-24T04:01:36.398595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.398288+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.398288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:56:35.536921+0000","scrub_duration":0.0033273310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:54.918914+0000","last_change":"2023-05-24T04:01:54.918914+0000","last_active":"2023-05-24T04:01:54.918914+0000","last_peered":"2023-05-24T04:01:54.918914+0000","last_clean":"2023-05-24T04:01:54.918914+0000","last_became_active":"2023-05-24T03:59:57.921804+0000","last_became_peered":"2023-05-24T03:59:57.921804+0000","last_unstale":"2023-05-24T04:01:54.918914+0000","last_undegraded":"2023-05-24T04:01:54.918914+0000","last_fullsized":"2023-05-24T04:01:54.918914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:54.918585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:54.918585+0000","last_clean_scrub_stamp":"2023-05-24T04:01:54.918585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:46:39.721448+0000","scrub_duration":0.0038101939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:29.131084+0000","last_change":"2023-05-24T04:01:29.131084+0000","last_active":"2023-05-24T04:01:29.131084+0000","last_peered":"2023-05-24T04:01:29.131084+0000","last_clean":"2023-05-24T04:01:29.131084+0000","last_became_active":"2023-05-24T03:59:57.930122+0000","last_became_peered":"2023-05-24T03:59:57.930122+0000","last_unstale":"2023-05-24T04:01:29.131084+0000","last_undegraded":"2023-05-24T04:01:29.131084+0000","last_fullsized":"2023-05-24T04:01:29.131084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:29.130752+0000","last_clean_scrub_stamp":"2023-05-24T04:01:29.130752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:36.271021+0000","scrub_duration":0.003228191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.339849+0000","last_change":"2023-05-24T04:01:26.339849+0000","last_active":"2023-05-24T04:01:26.339849+0000","last_peered":"2023-05-24T04:01:26.339849+0000","last_clean":"2023-05-24T04:01:26.339849+0000","last_became_active":"2023-05-24T03:59:57.916755+0000","last_became_peered":"2023-05-24T03:59:57.916755+0000","last_unstale":"2023-05-24T04:01:26.339849+0000","last_undegraded":"2023-05-24T04:01:26.339849+0000","last_fullsized":"2023-05-24T04:01:26.339849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.339543+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.339543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:20:58.800839+0000","scrub_duration":0.0038659369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:20.244112+0000","last_change":"2023-05-24T04:01:20.244112+0000","last_active":"2023-05-24T04:01:20.244112+0000","last_peered":"2023-05-24T04:01:20.244112+0000","last_clean":"2023-05-24T04:01:20.244112+0000","last_became_active":"2023-05-24T03:59:57.923505+0000","last_became_peered":"2023-05-24T03:59:57.923505+0000","last_unstale":"2023-05-24T04:01:20.244112+0000","last_undegraded":"2023-05-24T04:01:20.244112+0000","last_fullsized":"2023-05-24T04:01:20.244112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:20.243690+0000","last_clean_scrub_stamp":"2023-05-24T04:01:20.243690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:16.537332+0000","scrub_duration":0.0033338600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.419433+0000","last_change":"2023-05-24T04:01:42.419433+0000","last_active":"2023-05-24T04:01:42.419433+0000","last_peered":"2023-05-24T04:01:42.419433+0000","last_clean":"2023-05-24T04:01:42.419433+0000","last_became_active":"2023-05-24T03:59:57.914854+0000","last_became_peered":"2023-05-24T03:59:57.914854+0000","last_unstale":"2023-05-24T04:01:42.419433+0000","last_undegraded":"2023-05-24T04:01:42.419433+0000","last_fullsized":"2023-05-24T04:01:42.419433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.419129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.419129+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.419129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:03:41.772842+0000","scrub_duration":0.0031554510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:57.228627+0000","last_change":"2023-05-24T04:01:57.228627+0000","last_active":"2023-05-24T04:01:57.228627+0000","last_peered":"2023-05-24T04:01:57.228627+0000","last_clean":"2023-05-24T04:01:57.228627+0000","last_became_active":"2023-05-24T03:59:57.922731+0000","last_became_peered":"2023-05-24T03:59:57.922731+0000","last_unstale":"2023-05-24T04:01:57.228627+0000","last_undegraded":"2023-05-24T04:01:57.228627+0000","last_fullsized":"2023-05-24T04:01:57.228627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:57.228320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:57.228320+0000","last_clean_scrub_stamp":"2023-05-24T04:01:57.228320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:19:45.418887+0000","scrub_duration":0.0039390689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:04.028023+0000","last_change":"2023-05-24T04:02:04.028023+0000","last_active":"2023-05-24T04:02:04.028023+0000","last_peered":"2023-05-24T04:02:04.028023+0000","last_clean":"2023-05-24T04:02:04.028023+0000","last_became_active":"2023-05-24T03:59:57.937101+0000","last_became_peered":"2023-05-24T03:59:57.937101+0000","last_unstale":"2023-05-24T04:02:04.028023+0000","last_undegraded":"2023-05-24T04:02:04.028023+0000","last_fullsized":"2023-05-24T04:02:04.028023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:04.027738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:04.027738+0000","last_clean_scrub_stamp":"2023-05-24T04:02:04.027738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:24:10.002646+0000","scrub_duration":0.0036723709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:26.465383+0000","last_change":"2023-05-24T04:01:26.465383+0000","last_active":"2023-05-24T04:01:26.465383+0000","last_peered":"2023-05-24T04:01:26.465383+0000","last_clean":"2023-05-24T04:01:26.465383+0000","last_became_active":"2023-05-24T03:59:57.929105+0000","last_became_peered":"2023-05-24T03:59:57.929105+0000","last_unstale":"2023-05-24T04:01:26.465383+0000","last_undegraded":"2023-05-24T04:01:26.465383+0000","last_fullsized":"2023-05-24T04:01:26.465383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:26.464980+0000","last_clean_scrub_stamp":"2023-05-24T04:01:26.464980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:16:49.208763+0000","scrub_duration":0.003657731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:40.383667+0000","last_change":"2023-05-24T04:01:40.383667+0000","last_active":"2023-05-24T04:01:40.383667+0000","last_peered":"2023-05-24T04:01:40.383667+0000","last_clean":"2023-05-24T04:01:40.383667+0000","last_became_active":"2023-05-24T03:59:57.911562+0000","last_became_peered":"2023-05-24T03:59:57.911562+0000","last_unstale":"2023-05-24T04:01:40.383667+0000","last_undegraded":"2023-05-24T04:01:40.383667+0000","last_fullsized":"2023-05-24T04:01:40.383667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:40.383350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:40.383350+0000","last_clean_scrub_stamp":"2023-05-24T04:01:40.383350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:01:04.511715+0000","scrub_duration":0.0034523900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:44.449478+0000","last_change":"2023-05-24T04:01:44.449478+0000","last_active":"2023-05-24T04:01:44.449478+0000","last_peered":"2023-05-24T04:01:44.449478+0000","last_clean":"2023-05-24T04:01:44.449478+0000","last_became_active":"2023-05-24T03:59:57.931084+0000","last_became_peered":"2023-05-24T03:59:57.931084+0000","last_unstale":"2023-05-24T04:01:44.449478+0000","last_undegraded":"2023-05-24T04:01:44.449478+0000","last_fullsized":"2023-05-24T04:01:44.449478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:44.449173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:44.449173+0000","last_clean_scrub_stamp":"2023-05-24T04:01:44.449173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:11.033995+0000","scrub_duration":0.0038145229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:30.153492+0000","last_change":"2023-05-24T04:01:30.153492+0000","last_active":"2023-05-24T04:01:30.153492+0000","last_peered":"2023-05-24T04:01:30.153492+0000","last_clean":"2023-05-24T04:01:30.153492+0000","last_became_active":"2023-05-24T03:59:57.939027+0000","last_became_peered":"2023-05-24T03:59:57.939027+0000","last_unstale":"2023-05-24T04:01:30.153492+0000","last_undegraded":"2023-05-24T04:01:30.153492+0000","last_fullsized":"2023-05-24T04:01:30.153492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:30.153179+0000","last_clean_scrub_stamp":"2023-05-24T04:01:30.153179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:43:26.061011+0000","scrub_duration":0.0036045560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:03.404841+0000","last_change":"2023-05-24T04:02:03.404841+0000","last_active":"2023-05-24T04:02:03.404841+0000","last_peered":"2023-05-24T04:02:03.404841+0000","last_clean":"2023-05-24T04:02:03.404841+0000","last_became_active":"2023-05-24T03:59:57.928308+0000","last_became_peered":"2023-05-24T03:59:57.928308+0000","last_unstale":"2023-05-24T04:02:03.404841+0000","last_undegraded":"2023-05-24T04:02:03.404841+0000","last_fullsized":"2023-05-24T04:02:03.404841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:03.404530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:03.404530+0000","last_clean_scrub_stamp":"2023-05-24T04:02:03.404530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:16:46.672686+0000","scrub_duration":0.0034870420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:48.394790+0000","last_change":"2023-05-24T04:01:48.394790+0000","last_active":"2023-05-24T04:01:48.394790+0000","last_peered":"2023-05-24T04:01:48.394790+0000","last_clean":"2023-05-24T04:01:48.394790+0000","last_became_active":"2023-05-24T03:59:57.915502+0000","last_became_peered":"2023-05-24T03:59:57.915502+0000","last_unstale":"2023-05-24T04:01:48.394790+0000","last_undegraded":"2023-05-24T04:01:48.394790+0000","last_fullsized":"2023-05-24T04:01:48.394790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:48.394452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:48.394452+0000","last_clean_scrub_stamp":"2023-05-24T04:01:48.394452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:22:26.880540+0000","scrub_duration":0.0032445310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:34.394285+0000","last_change":"2023-05-24T04:01:34.394285+0000","last_active":"2023-05-24T04:01:34.394285+0000","last_peered":"2023-05-24T04:01:34.394285+0000","last_clean":"2023-05-24T04:01:34.394285+0000","last_became_active":"2023-05-24T03:59:57.929666+0000","last_became_peered":"2023-05-24T03:59:57.929666+0000","last_unstale":"2023-05-24T04:01:34.394285+0000","last_undegraded":"2023-05-24T04:01:34.394285+0000","last_fullsized":"2023-05-24T04:01:34.394285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:34.393879+0000","last_clean_scrub_stamp":"2023-05-24T04:01:34.393879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:08.002884+0000","scrub_duration":0.0036074449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:58.900981+0000","last_change":"2023-05-24T04:01:58.900981+0000","last_active":"2023-05-24T04:01:58.900981+0000","last_peered":"2023-05-24T04:01:58.900981+0000","last_clean":"2023-05-24T04:01:58.900981+0000","last_became_active":"2023-05-24T03:59:57.937489+0000","last_became_peered":"2023-05-24T03:59:57.937489+0000","last_unstale":"2023-05-24T04:01:58.900981+0000","last_undegraded":"2023-05-24T04:01:58.900981+0000","last_fullsized":"2023-05-24T04:01:58.900981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:58.900675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:58.900675+0000","last_clean_scrub_stamp":"2023-05-24T04:01:58.900675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:53:29.630229+0000","scrub_duration":0.0037702809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:35.166953+0000","last_change":"2023-05-24T04:01:35.166953+0000","last_active":"2023-05-24T04:01:35.166953+0000","last_peered":"2023-05-24T04:01:35.166953+0000","last_clean":"2023-05-24T04:01:35.166953+0000","last_became_active":"2023-05-24T03:59:57.922684+0000","last_became_peered":"2023-05-24T03:59:57.922684+0000","last_unstale":"2023-05-24T04:01:35.166953+0000","last_undegraded":"2023-05-24T04:01:35.166953+0000","last_fullsized":"2023-05-24T04:01:35.166953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:35.166621+0000","last_clean_scrub_stamp":"2023-05-24T04:01:35.166621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:50:45.681248+0000","scrub_duration":0.0037053350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:41.427551+0000","last_change":"2023-05-24T04:01:41.427551+0000","last_active":"2023-05-24T04:01:41.427551+0000","last_peered":"2023-05-24T04:01:41.427551+0000","last_clean":"2023-05-24T04:01:41.427551+0000","last_became_active":"2023-05-24T04:00:39.815917+0000","last_became_peered":"2023-05-24T04:00:39.815917+0000","last_unstale":"2023-05-24T04:01:41.427551+0000","last_undegraded":"2023-05-24T04:01:41.427551+0000","last_fullsized":"2023-05-24T04:01:41.427551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:41.427368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:41.427368+0000","last_clean_scrub_stamp":"2023-05-24T04:01:41.427368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:22:37.721011+0000","scrub_duration":0.0035447759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:42.653683+0000","last_change":"2023-05-24T04:01:42.653683+0000","last_active":"2023-05-24T04:01:42.653683+0000","last_peered":"2023-05-24T04:01:42.653683+0000","last_clean":"2023-05-24T04:01:42.653683+0000","last_became_active":"2023-05-24T03:59:57.917795+0000","last_became_peered":"2023-05-24T03:59:57.917795+0000","last_unstale":"2023-05-24T04:01:42.653683+0000","last_undegraded":"2023-05-24T04:01:42.653683+0000","last_fullsized":"2023-05-24T04:01:42.653683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:42.653385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:42.653385+0000","last_clean_scrub_stamp":"2023-05-24T04:01:42.653385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:36:50.815411+0000","scrub_duration":0.0038377929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:14.212883+0000","last_change":"2023-05-24T04:02:14.213000+0000","last_active":"2023-05-24T04:02:14.212883+0000","last_peered":"2023-05-24T04:02:14.212883+0000","last_clean":"2023-05-24T04:02:14.212883+0000","last_became_active":"2023-05-24T03:59:57.928528+0000","last_became_peered":"2023-05-24T03:59:57.928528+0000","last_unstale":"2023-05-24T04:02:14.212883+0000","last_undegraded":"2023-05-24T04:02:14.212883+0000","last_fullsized":"2023-05-24T04:02:14.212883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:14.212679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:14.212679+0000","last_clean_scrub_stamp":"2023-05-24T04:02:14.212679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:43:50.037098+0000","scrub_duration":0.0034665529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:02:10.516285+0000","last_change":"2023-05-24T04:02:10.516447+0000","last_active":"2023-05-24T04:02:10.516285+0000","last_peered":"2023-05-24T04:02:10.516285+0000","last_clean":"2023-05-24T04:02:10.516285+0000","last_became_active":"2023-05-24T03:59:57.940511+0000","last_became_peered":"2023-05-24T03:59:57.940511+0000","last_unstale":"2023-05-24T04:02:10.516285+0000","last_undegraded":"2023-05-24T04:02:10.516285+0000","last_fullsized":"2023-05-24T04:02:10.516285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:02:10.516032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:02:10.516032+0000","last_clean_scrub_stamp":"2023-05-24T04:02:10.516032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:12.600804+0000","scrub_duration":0.0040991619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-05-24T04:01:36.357015+0000","last_change":"2023-05-24T04:01:36.357015+0000","last_active":"2023-05-24T04:01:36.357015+0000","last_peered":"2023-05-24T04:01:36.357015+0000","last_clean":"2023-05-24T04:01:36.357015+0000","last_became_active":"2023-05-24T03:59:57.911233+0000","last_became_peered":"2023-05-24T03:59:57.911233+0000","last_unstale":"2023-05-24T04:01:36.357015+0000","last_undegraded":"2023-05-24T04:01:36.357015+0000","last_fullsized":"2023-05-24T04:01:36.357015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T04:01:36.356683+0000","last_clean_scrub_stamp":"2023-05-24T04:01:36.356683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:22:55.377329+0000","scrub_duration":0.0034088299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6382,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18848,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352992,"statfs":{"total":96636764160,"available":96617463808,"internally_reserved":0,"allocated":942080,"data_stored":730343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78700000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98099999999999998,"5min":1.355,"15min":1.355},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1459999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.88,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.169,"5min":1.266,"15min":1.266},"last":0.621},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.94399999999999995,"15min":0.95099999999999996},"min":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.258,"5min":1.28,"15min":1.28},"last":0.93000000000000005}]},{"osd":2,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94499999999999995,"15min":0.94299999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1739999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.075,"15min":1.0820000000000001},"min":{"1min":0.88700000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.2809999999999999,"5min":1.895,"15min":1.895},"last":0.95999999999999996}]},{"osd":3,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.016,"15min":1.026},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1930000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3360000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.095}]},{"osd":4,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96599999999999997,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.995},"min":{"1min":0.69399999999999995,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3169999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.224,"5min":1.528,"15min":1.528},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0960000000000001,"15min":1.1060000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.228,"5min":1.375,"15min":1.375},"last":1.2230000000000001}]},{"osd":6,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.196,"15min":1.204},"min":{"1min":0.98799999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.351,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1679999999999999,"15min":1.171},"min":{"1min":0.86499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.3680000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.161}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.874,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.85799999999999998},"min":{"1min":0.67400000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.65900000000000003}]},{"osd":1,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.133,"5min":1.25,"15min":1.25},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.78000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92400000000000004,"15min":0.92600000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1419999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1140000000000001}]},{"osd":3,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.98599999999999999,"15min":0.99399999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.165,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0600000000000001,"15min":1.0720000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1699999999999999,"5min":1.625,"15min":1.625},"last":1.0389999999999999}]},{"osd":4,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0629999999999999,"15min":1.071},"min":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3160000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2350000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1619999999999999}]},{"osd":5,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1850000000000001,"15min":1.2070000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.274,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.232},{"interface":"front","average":{"1min":1.069,"5min":1.1930000000000001,"15min":1.214},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.244,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed May 24 04:01:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":1.0669999999999999,"5min":1.014,"15min":1.014},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.284,"15min":1.302},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5409999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.075}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.96299999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.877,"15min":0.874},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91400000000000003,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3009999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.139}]},{"osd":2,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.68400000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2070000000000001,"5min":1.446,"15min":1.446},"last":1.107},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.046,"15min":1.0580000000000001},"min":{"1min":0.81499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.1559999999999999,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.94099999999999995}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0249999999999999,"15min":1.0369999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.343,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.079,"15min":1.083},"min":{"1min":0.875,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.2729999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.73599999999999999}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":0.97199999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.258,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.093,"5min":1.143,"15min":1.151},"min":{"1min":0.745,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4299999999999999,"5min":2.496,"15min":2.496},"last":1.0780000000000001}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.76800000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.476,"5min":1.927,"15min":1.927},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3879999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2310000000000001,"15min":1.2390000000000001},"min":{"1min":1.0169999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4810000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.2010000000000001,"15min":1.2090000000000001},"min":{"1min":0.85899999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3520000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.018}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18260,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353580,"statfs":{"total":96636764160,"available":96618065920,"internally_reserved":0,"allocated":339968,"data_stored":139815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.59099999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.169,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":1.484,"15min":1.484},"last":0.88200000000000001}]},{"osd":1,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.63200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.22,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.032},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.64500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.234,"5min":1.29,"15min":1.29},"last":0.81799999999999995}]},{"osd":2,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.64900000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.0920000000000001,"5min":1.542,"15min":1.542},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.68500000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2370000000000001,"5min":1.323,"15min":1.323},"last":1.1579999999999999}]},{"osd":3,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93899999999999995,"15min":0.94299999999999995},"min":{"1min":0.629,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1719999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72599999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.91400000000000003}]},{"osd":5,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.008,"15min":1.0109999999999999},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2569999999999999,"5min":1.407,"15min":1.407},"last":1.111},{"interface":"front","average":{"1min":1.014,"5min":0.99399999999999999,"15min":0.99099999999999999},"min":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.94599999999999995}]},{"osd":6,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0720000000000001,"15min":1.075},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5309999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.179,"5min":1.167,"15min":1.165},"min":{"1min":1.0289999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.429,"5min":1.587,"15min":1.587},"last":1.2}]},{"osd":7,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.155,"15min":1.165},"min":{"1min":0.79400000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3720000000000001,"5min":1.829,"15min":1.829},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.244,"15min":1.254},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.4390000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0940000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18240,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353600,"statfs":{"total":96636764160,"available":96618086400,"internally_reserved":0,"allocated":319488,"data_stored":134265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.89000000000000001,"5min":1.115,"15min":1.115},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.68400000000000005}]},{"osd":1,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93200000000000005,"5min":1.534,"15min":1.534},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.40500000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97499999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.99299999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1819999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.05}]},{"osd":5,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0720000000000001,"5min":1.798,"15min":1.798},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3120000000000001,"5min":1.895,"15min":1.895},"last":1.097}]},{"osd":6,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0589999999999999,"15min":1.073},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2769999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.258,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Wed May 24 04:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2390000000000001,"5min":1.734,"15min":1.734},"last":1.194},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.107,"15min":1.117},"min":{"1min":0.73099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2949999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.341}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.47599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.123,"15min":1.123},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":1.014}]},{"osd":1,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.026,"5min":1.056,"15min":1.056},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":2.246,"15min":2.246},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98599999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.071,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93899999999999995,"15min":0.93200000000000005},"min":{"1min":0.60699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.871},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95699999999999996,"15min":0.96199999999999997},"min":{"1min":0.67900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3169999999999999,"5min":1.542,"15min":1.542},"last":1.119}]},{"osd":5,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.98499999999999999,"15min":0.97599999999999998},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2729999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.97699999999999998},"min":{"1min":0.59499999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2250000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1990000000000001}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.747,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4530000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.212}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.046},"min":{"1min":0.73499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3240000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.238},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.129,"15min":1.131},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.395,"5min":1.879,"15min":1.879},"last":1.2749999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":315392,"data_stored":134175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0820000000000001,"5min":1.105,"15min":1.105},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96999999999999997,"5min":1.133,"15min":1.133},"last":0.91600000000000004}]},{"osd":3,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.03,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.70699999999999996}]},{"osd":4,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.98999999999999999,"15min":1.002},"min":{"1min":0.57799999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.228,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94399999999999995,"15min":0.94699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.258,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.88400000000000001}]},{"osd":5,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.63900000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0800000000000001,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4790000000000001,"5min":1.554,"15min":1.554},"last":1.1439999999999999}]},{"osd":6,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.069,"15min":1.073},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.626,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.365,"5min":1.379,"15min":1.379},"last":1.0860000000000001}]},{"osd":7,"last update":"Wed May 24 04:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.622,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.089,"15min":1.0920000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3089999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1120000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":913408,"data_stored":725125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.626}]},{"osd":2,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.53100000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.999,"5min":1.163,"15min":1.163},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.80700000000000005,"15min":0.78400000000000003},"min":{"1min":0.751,"5min":0.315,"15min":0.315},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.272,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.155,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.97899999999999998}]},{"osd":4,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.96699999999999997,"15min":0.94899999999999995},"min":{"1min":0.83699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.76900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.272,"5min":1.665,"15min":1.665},"last":1.089}]},{"osd":5,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.70399999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.45,"5min":1.609,"15min":1.609},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.94499999999999995,"15min":0.92700000000000005},"min":{"1min":0.71799999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.026,"15min":1.016},"min":{"1min":0.67300000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.393,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.173},"min":{"1min":0.88200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3129999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.175}]},{"osd":7,"last update":"Wed May 24 04:01:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0840000000000001,"15min":1.081},"min":{"1min":0.69999999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5289999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.091,"15min":1.0740000000000001},"min":{"1min":0.85199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6080000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.0229999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T04:02:42.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-05-24T04:02:43.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 Processor -- start 2023-05-24T04:02:43.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 -- start start 2023-05-24T04:02:43.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01d40714c0 0x7f01d414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f01d414b800 0x7f01d4155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d40bd750 con 0x7f01d40c0e20 2023-05-24T04:02:43.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d406fe00 con 0x7f01d40714c0 2023-05-24T04:02:43.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01dbffb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40a4800 con 0x7f01d414b800 2023-05-24T04:02:43.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01d40714c0 0x7f01d414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01d40714c0 0x7f01d414e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60944/0 (socket says 172.21.15.40:60944) 2023-05-24T04:02:43.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9596640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f01d40c0e20 0x7f01d414ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34902/0 (socket says 172.21.15.40:34902) 2023-05-24T04:02:43.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 -- 172.21.15.40:0/3205686835 learned_addr learned my addr 172.21.15.40:0/3205686835 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:43.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01da598640 1 --2- 172.21.15.40:0/3205686835 >> v2:172.21.15.67:3300/0 conn(0x7f01d414b800 0x7f01d4155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 -- 172.21.15.40:0/3205686835 >> v2:172.21.15.67:3300/0 conn(0x7f01d414b800 msgr2=0x7f01d4155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:43.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 --2- 172.21.15.40:0/3205686835 >> v2:172.21.15.67:3300/0 conn(0x7f01d414b800 0x7f01d4155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d8d95640 1 -- 172.21.15.40:0/3205686835 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432318307 0 0) 0x7f01d40bd750 con 0x7f01d40c0e20 2023-05-24T04:02:43.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 -- 172.21.15.40:0/3205686835 >> v1:172.21.15.40:6789/0 conn(0x7f01d40c0e20 legacy=0x7f01d414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01d9d97640 1 -- 172.21.15.40:0/3205686835 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40a4ae0 con 0x7f01d40714c0 2023-05-24T04:02:43.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.125+0000 7f01da598640 1 --2- 172.21.15.40:0/3205686835 >> v2:172.21.15.67:3300/0 conn(0x7f01d414b800 0x7f01d4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:43.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01d9d97640 1 --2- 172.21.15.40:0/3205686835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d40714c0 0x7f01d414e7d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f01d406b1d0 tx=0x7f01d001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e420a7d0a929bc server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01d8d95640 1 -- 172.21.15.40:0/3205686835 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00ab660 con 0x7f01d40714c0 2023-05-24T04:02:43.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01d8d95640 1 -- 172.21.15.40:0/3205686835 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d00ab7c0 con 0x7f01d40714c0 2023-05-24T04:02:43.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01d8d95640 1 -- 172.21.15.40:0/3205686835 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00abb50 con 0x7f01d40714c0 2023-05-24T04:02:43.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- 172.21.15.40:0/3205686835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d40714c0 msgr2=0x7f01d414e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3205686835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d40714c0 0x7f01d414e7d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f01d406b1d0 tx=0x7f01d001c440 comp rx=0 tx=0).stop 2023-05-24T04:02:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- 172.21.15.40:0/3205686835 shutdown_connections 2023-05-24T04:02:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3205686835 >> v2:172.21.15.67:3300/0 conn(0x7f01d414b800 0x7f01d4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3205686835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d40714c0 0x7f01d414e7d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- 172.21.15.40:0/3205686835 >> 172.21.15.40:0/3205686835 conn(0x7f01d40c0310 msgr2=0x7f01d40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- 172.21.15.40:0/3205686835 shutdown_connections 2023-05-24T04:02:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- 172.21.15.40:0/3205686835 wait complete. 2023-05-24T04:02:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 Processor -- start 2023-05-24T04:02:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- start start 2023-05-24T04:02:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40714c0 0x7f01d406c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40c0e20 0x7f01d4140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 0x7f01d41e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4152810 con 0x7f01d414b800 2023-05-24T04:02:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41e3d10 con 0x7f01d40c0e20 2023-05-24T04:02:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01dbffb640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41e7b20 con 0x7f01d40714c0 2023-05-24T04:02:43.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 0x7f01d41e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 0x7f01d41e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60958/0 (socket says 172.21.15.40:60958) 2023-05-24T04:02:43.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 -- 172.21.15.40:0/3183583288 learned_addr learned my addr 172.21.15.40:0/3183583288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:43.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01d9d97640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40714c0 0x7f01d406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 -- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40714c0 msgr2=0x7f01d406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40714c0 0x7f01d406c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01d9596640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40c0e20 0x7f01d4140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 -- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40c0e20 msgr2=0x7f01d4140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40c0e20 0x7f01d4140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 -- 172.21.15.40:0/3183583288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d00094d0 con 0x7f01d414b800 2023-05-24T04:02:43.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01da598640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 0x7f01d41e4120 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00cd80 tx=0x7f01cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.129+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00f680 con 0x7f01d414b800 2023-05-24T04:02:43.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00f800 con 0x7f01d414b800 2023-05-24T04:02:43.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00fbb0 con 0x7f01d414b800 2023-05-24T04:02:43.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d40a2e40 con 0x7f01d414b800 2023-05-24T04:02:43.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4071890 con 0x7f01d414b800 2023-05-24T04:02:43.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d40a2fd0 con 0x7f01d414b800 2023-05-24T04:02:43.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01cc00b040 con 0x7f01d414b800 2023-05-24T04:02:43.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01ca7fc640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f01b8066280 0x7f01b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f01cc084a80 con 0x7f01d414b800 2023-05-24T04:02:43.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01d9d97640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f01b8066280 0x7f01b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.133+0000 7f01d9d97640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f01b8066280 0x7f01b8068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01d00af000 tx=0x7f01d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.137+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f01d40a2fd0 con 0x7f01d414b800 2023-05-24T04:02:43.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.293+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f01d40a2fd0 con 0x7f01d414b800 2023-05-24T04:02:43.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.301+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01cc051bd0 con 0x7f01d414b800 2023-05-24T04:02:43.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.301+0000 7f01ca7fc640 1 -- 172.21.15.40:0/3183583288 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f01d40a2fd0 con 0x7f01d414b800 2023-05-24T04:02:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f01b8066280 msgr2=0x7f01b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f01b8066280 0x7f01b8068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01d00af000 tx=0x7f01d00a7000 comp rx=0 tx=0).stop 2023-05-24T04:02:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 msgr2=0x7f01d41e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 0x7f01d41e4120 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00cd80 tx=0x7f01cc00a650 comp rx=0 tx=0).stop 2023-05-24T04:02:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 shutdown_connections 2023-05-24T04:02:43.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f01b8066280 0x7f01b8068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01d414b800 0x7f01d41e4120 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40c0e20 0x7f01d4140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 --2- 172.21.15.40:0/3183583288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40714c0 0x7f01d406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 >> 172.21.15.40:0/3183583288 conn(0x7f01d40c0310 msgr2=0x7f01d414f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 shutdown_connections 2023-05-24T04:02:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.305+0000 7f01dbffb640 1 -- 172.21.15.40:0/3183583288 wait complete. 2023-05-24T04:02:43.326 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-24T04:02:43.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:02:43.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.437+0000 7f25a56ea640 1 Processor -- start 2023-05-24T04:02:43.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.437+0000 7f25a56ea640 1 -- start start 2023-05-24T04:02:43.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f25a56ea640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25a014fa70 0x7f25a006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f25a56ea640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a0070b20 0x7f25a006bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f25a56ea640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f25a006c000 0x7f25a0145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f25a56ea640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a006ea20 con 0x7f25a014fa70 2023-05-24T04:02:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f25a56ea640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a006ec70 con 0x7f25a006c000 2023-05-24T04:02:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f25a56ea640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0150230 con 0x7f25a0070b20 2023-05-24T04:02:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25a014fa70 0x7f25a006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25a014fa70 0x7f25a006fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60964/0 (socket says 172.21.15.40:60964) 2023-05-24T04:02:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 -- 172.21.15.40:0/2637190790 learned_addr learned my addr 172.21.15.40:0/2637190790 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259e7fc640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a0070b20 0x7f25a006bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 -- 172.21.15.40:0/2637190790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a0070b20 msgr2=0x7f25a006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259f7fe640 1 --2- 172.21.15.40:0/2637190790 >> v2:172.21.15.67:3300/0 conn(0x7f25a006c000 0x7f25a0145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a0070b20 0x7f25a006bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 -- 172.21.15.40:0/2637190790 >> v2:172.21.15.67:3300/0 conn(0x7f25a006c000 msgr2=0x7f25a0145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:43.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 --2- 172.21.15.40:0/2637190790 >> v2:172.21.15.67:3300/0 conn(0x7f25a006c000 0x7f25a0145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259effd640 1 -- 172.21.15.40:0/2637190790 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00c10d0 con 0x7f25a014fa70 2023-05-24T04:02:43.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.441+0000 7f259e7fc640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a0070b20 0x7f25a006bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:43.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259effd640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a014fa70 0x7f25a006fd50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f25a006d680 tx=0x7f258801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836dc734aaadc508 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259dffb640 1 -- 172.21.15.40:0/2637190790 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880a5650 con 0x7f25a014fa70 2023-05-24T04:02:43.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259dffb640 1 -- 172.21.15.40:0/2637190790 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f25880a57b0 con 0x7f25a014fa70 2023-05-24T04:02:43.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259dffb640 1 -- 172.21.15.40:0/2637190790 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880a5b60 con 0x7f25a014fa70 2023-05-24T04:02:43.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- 172.21.15.40:0/2637190790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a014fa70 msgr2=0x7f25a006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a014fa70 0x7f25a006fd50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f25a006d680 tx=0x7f258801c9d0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- 172.21.15.40:0/2637190790 shutdown_connections 2023-05-24T04:02:43.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- 172.21.15.40:0/2637190790 >> v2:172.21.15.67:3300/0 conn(0x7f25a006c000 0x7f25a0145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a0070b20 0x7f25a006bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- 172.21.15.40:0/2637190790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a014fa70 0x7f25a006fd50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- 172.21.15.40:0/2637190790 >> 172.21.15.40:0/2637190790 conn(0x7f25a00c0280 msgr2=0x7f25a00c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:43.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- 172.21.15.40:0/2637190790 shutdown_connections 2023-05-24T04:02:43.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- 172.21.15.40:0/2637190790 wait complete. 2023-05-24T04:02:43.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 Processor -- start 2023-05-24T04:02:43.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- start start 2023-05-24T04:02:43.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a006c000 0x7f25a0144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 0x7f25a00a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a014fa70 0x7f25a00a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0144a80 con 0x7f25a0070b20 2023-05-24T04:02:43.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00a4e30 con 0x7f25a006c000 2023-05-24T04:02:43.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f25a56ea640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00a3fc0 con 0x7f25a014fa70 2023-05-24T04:02:43.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 0x7f25a00a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259f7fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a014fa70 0x7f25a00a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 0x7f25a00a48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60980/0 (socket says 172.21.15.40:60980) 2023-05-24T04:02:43.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259e7fc640 1 -- 172.21.15.40:0/3406010339 learned_addr learned my addr 172.21.15.40:0/3406010339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:43.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.445+0000 7f259effd640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a006c000 0x7f25a0144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259e7fc640 1 -- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a014fa70 msgr2=0x7f25a00a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259e7fc640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a014fa70 0x7f25a00a3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259e7fc640 1 -- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a006c000 msgr2=0x7f25a0144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259e7fc640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a006c000 0x7f25a0144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259e7fc640 1 -- 172.21.15.40:0/3406010339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588009b30 con 0x7f25a0070b20 2023-05-24T04:02:43.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259effd640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a006c000 0x7f25a0144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T04:02:43.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259e7fc640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 0x7f25a00a48f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f259000c7c0 tx=0x7f259000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590007a30 con 0x7f25a0070b20 2023-05-24T04:02:43.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2590007b90 con 0x7f25a0070b20 2023-05-24T04:02:43.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a014ffd0 con 0x7f25a0070b20 2023-05-24T04:02:43.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000ce70 con 0x7f25a0070b20 2023-05-24T04:02:43.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a014fe40 con 0x7f25a0070b20 2023-05-24T04:02:43.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a014ca00 con 0x7f25a0070b20 2023-05-24T04:02:43.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25900193f0 con 0x7f25a0070b20 2023-05-24T04:02:43.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25977fe640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f25800662b0 0x7f2580068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f25900843a0 con 0x7f25a0070b20 2023-05-24T04:02:43.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259effd640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f25800662b0 0x7f2580068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.449+0000 7f259effd640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f25800662b0 0x7f2580068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25880ae000 tx=0x7f25880a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.453+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f25900515a0 con 0x7f25a0070b20 2023-05-24T04:02:43.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.641+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25a00a44c0 con 0x7f25a0070b20 2023-05-24T04:02:43.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.641+0000 7f25977fe640 1 -- 172.21.15.40:0/3406010339 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3291 (secure 0 0 0) 0x7f259001ecf0 con 0x7f25a0070b20 2023-05-24T04:02:43.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:02:43.652 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:19.661783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T04:02:43.654 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-05-24T04:02:43.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f25800662b0 msgr2=0x7f2580068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f25800662b0 0x7f2580068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25880ae000 tx=0x7f25880a7070 comp rx=0 tx=0).stop 2023-05-24T04:02:43.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 msgr2=0x7f25a00a48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 0x7f25a00a48f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f259000c7c0 tx=0x7f259000cc80 comp rx=0 tx=0).stop 2023-05-24T04:02:43.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 shutdown_connections 2023-05-24T04:02:43.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f25800662b0 0x7f2580068760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a014fa70 0x7f25a00a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25a0070b20 0x7f25a00a48f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 --2- 172.21.15.40:0/3406010339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a006c000 0x7f25a0144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 >> 172.21.15.40:0/3406010339 conn(0x7f25a00c0280 msgr2=0x7f25a00bcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:43.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 shutdown_connections 2023-05-24T04:02:43.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.645+0000 7f25a56ea640 1 -- 172.21.15.40:0/3406010339 wait complete. 2023-05-24T04:02:43.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T04:02:43.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.777+0000 7f045cac7640 1 Processor -- start 2023-05-24T04:02:43.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.777+0000 7f045cac7640 1 -- start start 2023-05-24T04:02:43.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045cac7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f045814a710 0x7f0458071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045cac7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04580bcb70 con 0x7f045814a340 2023-05-24T04:02:43.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045cac7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04580a4da0 con 0x7f04580a52f0 2023-05-24T04:02:43.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045cac7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045814ab90 con 0x7f045814a710 2023-05-24T04:02:43.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f045814a340 0x7f045806c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34912/0 (socket says 172.21.15.40:34912) 2023-05-24T04:02:43.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045659c640 1 -- 172.21.15.40:0/3033183326 learned_addr learned my addr 172.21.15.40:0/3033183326 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:02:43.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0456d9d640 1 --2- 172.21.15.40:0/3033183326 >> v2:172.21.15.67:3300/0 conn(0x7f045814a710 0x7f0458071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238902062 0 0) 0x7f04580bcb70 con 0x7f045814a340 2023-05-24T04:02:43.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0444003530 con 0x7f045814a340 2023-05-24T04:02:43.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 655320476 0 0) 0x7f0444003530 con 0x7f045814a340 2023-05-24T04:02:43.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 >> v2:172.21.15.67:3300/0 conn(0x7f045814a710 msgr2=0x7f0458071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:43.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 --2- 172.21.15.40:0/3033183326 >> v2:172.21.15.67:3300/0 conn(0x7f045814a710 0x7f0458071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 >> v1:172.21.15.67:6789/0 conn(0x7f04580a52f0 legacy=0x7f0458070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580bc800 con 0x7f045814a340 2023-05-24T04:02:43.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f0448001680 con 0x7f045814a340 2023-05-24T04:02:43.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 >> v1:172.21.15.40:6789/0 conn(0x7f045814a340 legacy=0x7f045806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0444003980 0x7f0444003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04440047d0 0x7f0444004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0444005180 0x7f044400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045814ab90 con 0x7f04440047d0 2023-05-24T04:02:43.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044400c090 con 0x7f0444005180 2023-05-24T04:02:43.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044400c250 con 0x7f0444003980 2023-05-24T04:02:43.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0455d9b640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04440047d0 0x7f0444004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0456d9d640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0444005180 0x7f044400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0455d9b640 1 -- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0444003980 msgr2=0x7f0444003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:43.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045659c640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0444003980 0x7f0444003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0455d9b640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0444003980 0x7f0444003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0455d9b640 1 -- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0444005180 msgr2=0x7f044400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:43.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0455d9b640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0444005180 0x7f044400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0455d9b640 1 -- 172.21.15.40:0/3033183326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444003530 con 0x7f04440047d0 2023-05-24T04:02:43.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0456d9d640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0444005180 0x7f044400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:43.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f0456d9d640 1 -- 172.21.15.40:0/3033183326 reap_dead start 2023-05-24T04:02:43.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.781+0000 7f045659c640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0444003980 0x7f0444003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:43.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0455d9b640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04440047d0 0x7f0444004c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0440001780 tx=0x7f044001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547a7d56998cdbc1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400052d0 con 0x7f04440047d0 2023-05-24T04:02:43.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f04400a7050 con 0x7f04440047d0 2023-05-24T04:02:43.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045559a640 1 -- 172.21.15.40:0/3033183326 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440003600 con 0x7f04440047d0 2023-05-24T04:02:43.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- 172.21.15.40:0/3033183326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04440047d0 msgr2=0x7f0444004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04440047d0 0x7f0444004c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0440001780 tx=0x7f044001c3e0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- 172.21.15.40:0/3033183326 shutdown_connections 2023-05-24T04:02:43.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 --2- 172.21.15.40:0/3033183326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04440047d0 0x7f0444004c40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- 172.21.15.40:0/3033183326 >> 172.21.15.40:0/3033183326 conn(0x7f04580c0280 msgr2=0x7f04580c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:43.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- 172.21.15.40:0/3033183326 shutdown_connections 2023-05-24T04:02:43.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- 172.21.15.40:0/3033183326 wait complete. 2023-05-24T04:02:43.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 Processor -- start 2023-05-24T04:02:43.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- start start 2023-05-24T04:02:43.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04440047d0 0x7f04581e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04580bb540 0x7f04581e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 0x7f04581d76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04581d8b10 con 0x7f04581d7260 2023-05-24T04:02:43.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04581d8680 con 0x7f04580bb540 2023-05-24T04:02:43.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045cac7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04581d9260 con 0x7f04440047d0 2023-05-24T04:02:43.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 0x7f04581d76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 0x7f04581d76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60990/0 (socket says 172.21.15.40:60990) 2023-05-24T04:02:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 -- 172.21.15.40:0/1782417221 learned_addr learned my addr 172.21.15.40:0/1782417221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0455d9b640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04580bb540 0x7f04581e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f045659c640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04440047d0 0x7f04581e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 -- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04440047d0 msgr2=0x7f04581e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04440047d0 0x7f04581e96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 -- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04580bb540 msgr2=0x7f04581e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04580bb540 0x7f04581e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.785+0000 7f0456d9d640 1 -- 172.21.15.40:0/1782417221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045806d1c0 con 0x7f04581d7260 2023-05-24T04:02:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f0456d9d640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 0x7f04581d76d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f04580a3160 tx=0x7f0450009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000f8d0 con 0x7f04581d7260 2023-05-24T04:02:43.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f045000fa30 con 0x7f04581d7260 2023-05-24T04:02:43.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045806d030 con 0x7f04581d7260 2023-05-24T04:02:43.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000fdc0 con 0x7f04581d7260 2023-05-24T04:02:43.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0458071440 con 0x7f04581d7260 2023-05-24T04:02:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04581d8830 con 0x7f04581d7260 2023-05-24T04:02:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0450020460 con 0x7f04581d7260 2023-05-24T04:02:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f044effd640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f045659c640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f04500848c0 con 0x7f04581d7260 2023-05-24T04:02:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.789+0000 7f045659c640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0438066280 0x7f0438068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04480017b0 tx=0x7f0448001480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:43.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.793+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f04581d8830 con 0x7f04581d7260 2023-05-24T04:02:43.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.973+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04581d8830 con 0x7f04581d7260 2023-05-24T04:02:43.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.973+0000 7f044effd640 1 -- 172.21.15.40:0/1782417221 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3291 (secure 0 0 0) 0x7f04581d8830 con 0x7f04581d7260 2023-05-24T04:02:43.979 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:02:43.980 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2024910276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2024910276},{"type":"v1","addr":"172.21.15.40:6835","nonce":2024910276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:59:57.892410+0000","modified":"2023-05-24T04:00:19.661783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6833/3554538206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3554538206},{"type":"v1","addr":"172.21.15.67:6833","nonce":3554538206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T04:02:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-05-24T04:02:43.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0438066280 msgr2=0x7f0438068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0438066280 0x7f0438068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04480017b0 tx=0x7f0448001480 comp rx=0 tx=0).stop 2023-05-24T04:02:43.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 msgr2=0x7f04581d76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:43.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 0x7f04581d76d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f04580a3160 tx=0x7f0450009f50 comp rx=0 tx=0).stop 2023-05-24T04:02:43.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 shutdown_connections 2023-05-24T04:02:43.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04581d7260 0x7f04581d76d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:43.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04580bb540 0x7f04581e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 --2- 172.21.15.40:0/1782417221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04440047d0 0x7f04581e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 >> 172.21.15.40:0/1782417221 conn(0x7f04580c0280 msgr2=0x7f045806e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:44.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 shutdown_connections 2023-05-24T04:02:44.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:43.977+0000 7f045cac7640 1 -- 172.21.15.40:0/1782417221 wait complete. 2023-05-24T04:02:44.004 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T04:02:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.121+0000 7efcacf32640 1 Processor -- start 2023-05-24T04:02:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.121+0000 7efcacf32640 1 -- start start 2023-05-24T04:02:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efcacf32640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efca814fa70 0x7efca806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efcacf32640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca8070b20 0x7efca806bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efcacf32640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca806ea20 con 0x7efca806c000 2023-05-24T04:02:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efcacf32640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca806ec70 con 0x7efca814fa70 2023-05-24T04:02:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efcacf32640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8150230 con 0x7efca8070b20 2023-05-24T04:02:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efca814fa70 0x7efca806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca6d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efca806c000 0x7efca8145df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34922/0 (socket says 172.21.15.40:34922) 2023-05-24T04:02:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca6d9d640 1 -- 172.21.15.40:0/1002708564 learned_addr learned my addr 172.21.15.40:0/1002708564 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:02:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca5d9b640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca8070b20 0x7efca806bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca659c640 1 -- 172.21.15.40:0/1002708564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca8070b20 msgr2=0x7efca806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca659c640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca8070b20 0x7efca806bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca659c640 1 -- 172.21.15.40:0/1002708564 >> v1:172.21.15.40:6789/0 conn(0x7efca806c000 legacy=0x7efca8145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca659c640 1 -- 172.21.15.40:0/1002708564 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80c10d0 con 0x7efca814fa70 2023-05-24T04:02:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca5d9b640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca8070b20 0x7efca806bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca659c640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca814fa70 0x7efca806fd50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc980097c0 tx=0x7efc9801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8b0701eec7d599 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca559a640 1 -- 172.21.15.40:0/1002708564 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980ab600 con 0x7efca814fa70 2023-05-24T04:02:44.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca559a640 1 -- 172.21.15.40:0/1002708564 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efc980a7050 con 0x7efca814fa70 2023-05-24T04:02:44.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.125+0000 7efca559a640 1 -- 172.21.15.40:0/1002708564 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980ab9a0 con 0x7efca814fa70 2023-05-24T04:02:44.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/1002708564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca814fa70 msgr2=0x7efca806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca814fa70 0x7efca806fd50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc980097c0 tx=0x7efc9801c480 comp rx=0 tx=0).stop 2023-05-24T04:02:44.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/1002708564 shutdown_connections 2023-05-24T04:02:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca8070b20 0x7efca806bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 --2- 172.21.15.40:0/1002708564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca814fa70 0x7efca806fd50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/1002708564 >> 172.21.15.40:0/1002708564 conn(0x7efca80c0280 msgr2=0x7efca80c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/1002708564 shutdown_connections 2023-05-24T04:02:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/1002708564 wait complete. 2023-05-24T04:02:44.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 Processor -- start 2023-05-24T04:02:44.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- start start 2023-05-24T04:02:44.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca806c000 0x7efca80bed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 0x7efca8154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca814fa70 0x7efca81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80a51a0 con 0x7efca8070b20 2023-05-24T04:02:44.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80a4080 con 0x7efca814fa70 2023-05-24T04:02:44.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80bf2c0 con 0x7efca806c000 2023-05-24T04:02:44.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 0x7efca8154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 0x7efca8154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32788/0 (socket says 172.21.15.40:32788) 2023-05-24T04:02:44.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 -- 172.21.15.40:0/600655142 learned_addr learned my addr 172.21.15.40:0/600655142 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:44.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca6d9d640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca814fa70 0x7efca81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca659c640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca806c000 0x7efca80bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 -- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca806c000 msgr2=0x7efca80bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca806c000 0x7efca80bed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 -- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca814fa70 msgr2=0x7efca81551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca814fa70 0x7efca81551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 -- 172.21.15.40:0/600655142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009420 con 0x7efca8070b20 2023-05-24T04:02:44.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca6d9d640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca814fa70 0x7efca81551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:44.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efca5d9b640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 0x7efca8154ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c7f0 tx=0x7efc9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00cea0 con 0x7efca8070b20 2023-05-24T04:02:44.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efc9c007a30 con 0x7efca8070b20 2023-05-24T04:02:44.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c007e00 con 0x7efca8070b20 2023-05-24T04:02:44.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca814ffd0 con 0x7efca8070b20 2023-05-24T04:02:44.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.129+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca814fe40 con 0x7efca8070b20 2023-05-24T04:02:44.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.133+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8146500 con 0x7efca8070b20 2023-05-24T04:02:44.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.133+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc9c0113f0 con 0x7efca8070b20 2023-05-24T04:02:44.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.133+0000 7efc96ffd640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efc88066280 0x7efc88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.133+0000 7efca659c640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efc88066280 0x7efc88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.133+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc9c084280 con 0x7efca8070b20 2023-05-24T04:02:44.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.133+0000 7efca659c640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efc88066280 0x7efc88068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efc980ad000 tx=0x7efc98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.137+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efc9c054dc0 con 0x7efca8070b20 2023-05-24T04:02:44.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.293+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca80a52e0 con 0x7efca8070b20 2023-05-24T04:02:44.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efc96ffd640 1 -- 172.21.15.40:0/600655142 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20167 (secure 0 0 0) 0x7efc9c054950 con 0x7efca8070b20 2023-05-24T04:02:44.302 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-24T04:02:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"b4b82cba-0383-492a-85bf-0de09746a380","created":"2023-05-24T03:59:33.876412+0000","modified":"2023-05-24T04:00:39.788373+0000","last_up_change":"2023-05-24T03:59:45.713455+0000","last_in_change":"2023-05-24T03:59:36.170396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:59:46.596983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:59:52.226202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:59:56.290859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:59:56.868620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:59:59.952259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"07f79ba9-4652-40ca-9fb6-e5c3594a9a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6808","nonce":2887735176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6811","nonce":2887735176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6815","nonce":2887735176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2887735176},{"type":"v1","addr":"172.21.15.40:6813","nonce":2887735176}]},"public_addr":"172.21.15.40:6808/2887735176","cluster_addr":"172.21.15.40:6811/2887735176","heartbeat_back_addr":"172.21.15.40:6815/2887735176","heartbeat_front_addr":"172.21.15.40:6813/2887735176","state":["exists","up"]},{"osd":1,"uuid":"88b786d3-420d-4f2a-a401-6ec91808f9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6801","nonce":2352123931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6803","nonce":2352123931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6809","nonce":2352123931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2352123931},{"type":"v1","addr":"172.21.15.40:6805","nonce":2352123931}]},"public_addr":"172.21.15.40:6801/2352123931","cluster_addr":"172.21.15.40:6803/2352123931","heartbeat_back_addr":"172.21.15.40:6809/2352123931","heartbeat_front_addr":"172.21.15.40:6805/2352123931","state":["exists","up"]},{"osd":2,"uuid":"d456057f-180d-405d-a43d-d38f2db0a0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6817","nonce":307115548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6819","nonce":307115548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6823","nonce":307115548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":307115548},{"type":"v1","addr":"172.21.15.40:6821","nonce":307115548}]},"public_addr":"172.21.15.40:6817/307115548","cluster_addr":"172.21.15.40:6819/307115548","heartbeat_back_addr":"172.21.15.40:6823/307115548","heartbeat_front_addr":"172.21.15.40:6821/307115548","state":["exists","up"]},{"osd":3,"uuid":"0fd91af4-47a7-49b0-88cf-a41728c7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6825","nonce":3065273304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6827","nonce":3065273304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6831","nonce":3065273304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3065273304},{"type":"v1","addr":"172.21.15.40:6829","nonce":3065273304}]},"public_addr":"172.21.15.40:6825/3065273304","cluster_addr":"172.21.15.40:6827/3065273304","heartbeat_back_addr":"172.21.15.40:6831/3065273304","heartbeat_front_addr":"172.21.15.40:6829/3065273304","state":["exists","up"]},{"osd":4,"uuid":"56383a5a-4fea-40d0-9db1-1e4e2eff987b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6801","nonce":3240304785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6803","nonce":3240304785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6807","nonce":3240304785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3240304785},{"type":"v1","addr":"172.21.15.67:6805","nonce":3240304785}]},"public_addr":"172.21.15.67:6801/3240304785","cluster_addr":"172.21.15.67:6803/3240304785","heartbeat_back_addr":"172.21.15.67:6807/3240304785","heartbeat_front_addr":"172.21.15.67:6805/3240304785","state":["exists","up"]},{"osd":5,"uuid":"1e1eb7a6-f682-4a7d-8806-dd6d7e004154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6825","nonce":4067900882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6827","nonce":4067900882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6831","nonce":4067900882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":4067900882},{"type":"v1","addr":"172.21.15.67:6829","nonce":4067900882}]},"public_addr":"172.21.15.67:6825/4067900882","cluster_addr":"172.21.15.67:6827/4067900882","heartbeat_back_addr":"172.21.15.67:6831/4067900882","heartbeat_front_addr":"172.21.15.67:6829/4067900882","state":["exists","up"]},{"osd":6,"uuid":"37eb089e-b7dc-4d84-99e2-4ad8bb6980b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6815","nonce":1569713889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6819","nonce":1569713889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6823","nonce":1569713889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1569713889},{"type":"v1","addr":"172.21.15.67:6821","nonce":1569713889}]},"public_addr":"172.21.15.67:6815/1569713889","cluster_addr":"172.21.15.67:6819/1569713889","heartbeat_back_addr":"172.21.15.67:6823/1569713889","heartbeat_front_addr":"172.21.15.67:6821/1569713889","state":["exists","up"]},{"osd":7,"uuid":"0050469b-fc36-4d96-a325-b961d01ebbe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6809","nonce":1243939275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6811","nonce":1243939275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6817","nonce":1243939275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1243939275},{"type":"v1","addr":"172.21.15.67:6814","nonce":1243939275}]},"public_addr":"172.21.15.67:6809/1243939275","cluster_addr":"172.21.15.67:6811/1243939275","heartbeat_back_addr":"172.21.15.67:6817/1243939275","heartbeat_front_addr":"172.21.15.67:6814/1243939275","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.628098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.598362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.830345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.702411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.757123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.803657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:59:41.787640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T04:02:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efc88066280 msgr2=0x7efc88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efc88066280 0x7efc88068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efc980ad000 tx=0x7efc98008040 comp rx=0 tx=0).stop 2023-05-24T04:02:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 msgr2=0x7efca8154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 0x7efca8154ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c7f0 tx=0x7efc9c00ccb0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 shutdown_connections 2023-05-24T04:02:44.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7efc88066280 0x7efc88068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca814fa70 0x7efca81551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca8070b20 0x7efca8154ca0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 --2- 172.21.15.40:0/600655142 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efca806c000 0x7efca80bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 >> 172.21.15.40:0/600655142 conn(0x7efca80c0280 msgr2=0x7efca81424f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:44.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 shutdown_connections 2023-05-24T04:02:44.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.297+0000 7efcacf32640 1 -- 172.21.15.40:0/600655142 wait complete. 2023-05-24T04:02:44.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-24T04:02:44.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 Processor -- start 2023-05-24T04:02:44.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 -- start start 2023-05-24T04:02:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980b68c0 0x7f1b98146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b98146550 0x7f1b9814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9814c2b0 con 0x7f1b980c1500 2023-05-24T04:02:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9814c580 con 0x7f1b98146550 2023-05-24T04:02:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9e80f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980b62b0 con 0x7f1b980b68c0 2023-05-24T04:02:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b98146550 0x7f1b9814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b98146550 0x7f1b9814ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32798/0 (socket says 172.21.15.40:32798) 2023-05-24T04:02:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 -- 172.21.15.40:0/587712756 learned_addr learned my addr 172.21.15.40:0/587712756 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b977fe640 1 --2- 172.21.15.40:0/587712756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980b68c0 0x7f1b98146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 -- 172.21.15.40:0/587712756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980b68c0 msgr2=0x7f1b98146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 --2- 172.21.15.40:0/587712756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980b68c0 0x7f1b98146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 -- 172.21.15.40:0/587712756 >> v1:172.21.15.67:6789/0 conn(0x7f1b980c1500 legacy=0x7f1b98150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.444+0000 7f1b9cdac640 1 -- 172.21.15.40:0/587712756 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980b94c0 con 0x7f1b98146550 2023-05-24T04:02:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9cdac640 1 --2- 172.21.15.40:0/587712756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b9814ca10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009e50 tx=0x7f1b9001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0aeea121459a1a0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b96ffd640 1 -- 172.21.15.40:0/587712756 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900a5900 con 0x7f1b98146550 2023-05-24T04:02:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b96ffd640 1 -- 172.21.15.40:0/587712756 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1b900a5a60 con 0x7f1b98146550 2023-05-24T04:02:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b96ffd640 1 -- 172.21.15.40:0/587712756 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900a5e10 con 0x7f1b98146550 2023-05-24T04:02:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 -- 172.21.15.40:0/587712756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 msgr2=0x7f1b9814ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/587712756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b9814ca10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009e50 tx=0x7f1b9001ca10 comp rx=0 tx=0).stop 2023-05-24T04:02:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 -- 172.21.15.40:0/587712756 shutdown_connections 2023-05-24T04:02:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/587712756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b9814ca10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/587712756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980b68c0 0x7f1b98146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 -- 172.21.15.40:0/587712756 >> 172.21.15.40:0/587712756 conn(0x7f1b9806a670 msgr2=0x7f1b980c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 -- 172.21.15.40:0/587712756 shutdown_connections 2023-05-24T04:02:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 -- 172.21.15.40:0/587712756 wait complete. 2023-05-24T04:02:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 Processor -- start 2023-05-24T04:02:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.448+0000 7f1b9e80f640 1 -- start start 2023-05-24T04:02:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b980b68c0 0x7f1b9813b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980c1500 0x7f1b98142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b981433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b981e85b0 con 0x7f1b98146550 2023-05-24T04:02:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b981e82a0 con 0x7f1b980b68c0 2023-05-24T04:02:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9813be90 con 0x7f1b980c1500 2023-05-24T04:02:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b981433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b981433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32814/0 (socket says 172.21.15.40:32814) 2023-05-24T04:02:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 -- 172.21.15.40:0/3912455406 learned_addr learned my addr 172.21.15.40:0/3912455406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b977fe640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980c1500 0x7f1b98142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b97fff640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b980b68c0 0x7f1b9813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 -- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980c1500 msgr2=0x7f1b98142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980c1500 0x7f1b98142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 -- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b980b68c0 msgr2=0x7f1b9813b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b980b68c0 0x7f1b9813b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 -- 172.21.15.40:0/3912455406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90009b30 con 0x7f1b98146550 2023-05-24T04:02:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9cdac640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b981433d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009e50 tx=0x7f1b900197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b8880 con 0x7f1b98146550 2023-05-24T04:02:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1b900b89e0 con 0x7f1b98146550 2023-05-24T04:02:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b8db0 con 0x7f1b98146550 2023-05-24T04:02:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b980b6e20 con 0x7f1b98146550 2023-05-24T04:02:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b980b6c90 con 0x7f1b98146550 2023-05-24T04:02:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b981594a0 con 0x7f1b98146550 2023-05-24T04:02:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b900c2410 con 0x7f1b98146550 2023-05-24T04:02:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b94ff9640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1b840662b0 0x7f1b84068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b9011f170 con 0x7f1b98146550 2023-05-24T04:02:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b97fff640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1b840662b0 0x7f1b84068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.452+0000 7f1b97fff640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1b840662b0 0x7f1b84068760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b880016a0 tx=0x7f1b88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.456+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1b900ec2d0 con 0x7f1b98146550 2023-05-24T04:02:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.644+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1b980674e0 con 0x7f1b98146550 2023-05-24T04:02:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.656+0000 7f1b94ff9640 1 -- 172.21.15.40:0/3912455406 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1b900ef8f0 con 0x7f1b98146550 2023-05-24T04:02:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-24T04:02:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1b840662b0 msgr2=0x7f1b84068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1b840662b0 0x7f1b84068760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b880016a0 tx=0x7f1b88009040 comp rx=0 tx=0).stop 2023-05-24T04:02:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 msgr2=0x7f1b981433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b981433d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009e50 tx=0x7f1b900197b0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 shutdown_connections 2023-05-24T04:02:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f1b840662b0 0x7f1b84068760 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b98146550 0x7f1b981433d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b980c1500 0x7f1b98142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 --2- 172.21.15.40:0/3912455406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b980b68c0 0x7f1b9813b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 >> 172.21.15.40:0/3912455406 conn(0x7f1b9806a670 msgr2=0x7f1b9813e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 shutdown_connections 2023-05-24T04:02:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.660+0000 7f1b9e80f640 1 -- 172.21.15.40:0/3912455406 wait complete. 2023-05-24T04:02:44.675 INFO:tasks.ceph.mds.b.smithi067.stderr: -6617> 2023-05-24T03:59:59.615+0000 7fdd4c45f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-24T04:02:44.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-24T04:02:44.748 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-05-24T04:02:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 Processor -- start 2023-05-24T04:02:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 -- start start 2023-05-24T04:02:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1c00bedc0 0x7fc1c00bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c4080 0x7fc1c00c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c00a3a90 con 0x7fc1c00c0e30 2023-05-24T04:02:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c00a37f0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c8739640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00aa610 con 0x7fc1c00c4080 2023-05-24T04:02:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c64d5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1c00bedc0 0x7fc1c00bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c64d5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1c00bedc0 0x7fc1c00bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32830/0 (socket says 172.21.15.40:32830) 2023-05-24T04:02:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.808+0000 7fc1c64d5640 1 -- 172.21.15.40:0/2120346839 learned_addr learned my addr 172.21.15.40:0/2120346839 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c5cd4640 1 --2- 172.21.15.40:0/2120346839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c4080 0x7fc1c00c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c64d5640 1 -- 172.21.15.40:0/2120346839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c4080 msgr2=0x7fc1c00c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c64d5640 1 --2- 172.21.15.40:0/2120346839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c4080 0x7fc1c00c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c64d5640 1 -- 172.21.15.40:0/2120346839 >> v1:172.21.15.67:6789/0 conn(0x7fc1c00c0e30 legacy=0x7fc1c006ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c64d5640 1 -- 172.21.15.40:0/2120346839 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00c44e0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c64d5640 1 --2- 172.21.15.40:0/2120346839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bf190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009870 tx=0x7fc1b001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c195a407883497ba server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c54d3640 1 -- 172.21.15.40:0/2120346839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00ab600 con 0x7fc1c00bedc0 2023-05-24T04:02:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c54d3640 1 -- 172.21.15.40:0/2120346839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1b00a7050 con 0x7fc1c00bedc0 2023-05-24T04:02:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c54d3640 1 -- 172.21.15.40:0/2120346839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00ab9a0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 -- 172.21.15.40:0/2120346839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 msgr2=0x7fc1c00bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 --2- 172.21.15.40:0/2120346839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bf190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009870 tx=0x7fc1b001c540 comp rx=0 tx=0).stop 2023-05-24T04:02:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 -- 172.21.15.40:0/2120346839 shutdown_connections 2023-05-24T04:02:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 --2- 172.21.15.40:0/2120346839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c4080 0x7fc1c00c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 --2- 172.21.15.40:0/2120346839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bf190 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 -- 172.21.15.40:0/2120346839 >> 172.21.15.40:0/2120346839 conn(0x7fc1c00a6340 msgr2=0x7fc1c00a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 -- 172.21.15.40:0/2120346839 shutdown_connections 2023-05-24T04:02:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.812+0000 7fc1c8739640 1 -- 172.21.15.40:0/2120346839 wait complete. 2023-05-24T04:02:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 Processor -- start 2023-05-24T04:02:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- start start 2023-05-24T04:02:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c0e30 0x7fc1c01e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c00c4080 0x7fc1c01566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00bc9b0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c01ea8a0 con 0x7fc1c00c4080 2023-05-24T04:02:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c01eab80 con 0x7fc1c00c0e30 2023-05-24T04:02:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32840/0 (socket says 172.21.15.40:32840) 2023-05-24T04:02:44.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 -- 172.21.15.40:0/388693001 learned_addr learned my addr 172.21.15.40:0/388693001 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:44.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c5cd4640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c0e30 0x7fc1c01e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c6cd6640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c00c4080 0x7fc1c01566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 -- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c0e30 msgr2=0x7fc1c01e9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c0e30 0x7fc1c01e9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 -- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c00c4080 msgr2=0x7fc1c01566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:44.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c00c4080 0x7fc1c01566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:44.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 -- 172.21.15.40:0/388693001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00094d0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c6cd6640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c00c4080 0x7fc1c01566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:44.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c64d5640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bce00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc1b001abf0 tx=0x7fc1b00192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00b4620 con 0x7fc1c00bedc0 2023-05-24T04:02:44.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1b00b47a0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c00a40f0 con 0x7fc1c00bedc0 2023-05-24T04:02:44.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00b4b70 con 0x7fc1c00bedc0 2023-05-24T04:02:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c00a3f60 con 0x7fc1c00bedc0 2023-05-24T04:02:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c015b400 con 0x7fc1c00bedc0 2023-05-24T04:02:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1b00b2070 con 0x7fc1c00bedc0 2023-05-24T04:02:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.816+0000 7fc1b6ffd640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc1a4066280 0x7fc1a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.820+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fc1b011dc90 con 0x7fc1c00bedc0 2023-05-24T04:02:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.820+0000 7fc1c5cd4640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc1a4066280 0x7fc1a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.820+0000 7fc1c5cd4640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc1a4066280 0x7fc1a4068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc003fd0 tx=0x7fc1bc0039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:44.824+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc1b00eae20 con 0x7fc1c00bedc0 2023-05-24T04:02:45.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.012+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc1c004ddd0 con 0x7fc1c00bedc0 2023-05-24T04:02:45.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.020+0000 7fc1b6ffd640 1 -- 172.21.15.40:0/388693001 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1b00ee440 con 0x7fc1c00bedc0 2023-05-24T04:02:45.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc1a4066280 msgr2=0x7fc1a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:45.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc1a4066280 0x7fc1a4068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc003fd0 tx=0x7fc1bc0039a0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 msgr2=0x7fc1c00bce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:45.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bce00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc1b001abf0 tx=0x7fc1b00192e0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 shutdown_connections 2023-05-24T04:02:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7fc1a4066280 0x7fc1a4068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c00c4080 0x7fc1c01566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c00c0e30 0x7fc1c01e9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 --2- 172.21.15.40:0/388693001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c00bedc0 0x7fc1c00bce00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 >> 172.21.15.40:0/388693001 conn(0x7fc1c00a6340 msgr2=0x7fc1c006ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 shutdown_connections 2023-05-24T04:02:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.024+0000 7fc1c8739640 1 -- 172.21.15.40:0/388693001 wait complete. 2023-05-24T04:02:45.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-24T04:02:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926ec0e640 1 Processor -- start 2023-05-24T04:02:45.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926ec0e640 1 -- start start 2023-05-24T04:02:45.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926ec0e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f926806fa50 0x7f92680a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:45.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926ec0e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926814e870 con 0x7f92680714c0 2023-05-24T04:02:45.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926ec0e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926814b360 con 0x7f926814a750 2023-05-24T04:02:45.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926ec0e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926814eb10 con 0x7f926806fa50 2023-05-24T04:02:45.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f9267fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f926806fa50 0x7f92680a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:45.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926c9aa640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92680714c0 0x7f9268071890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34926/0 (socket says 172.21.15.40:34926) 2023-05-24T04:02:45.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f926c9aa640 1 -- 172.21.15.40:0/2297293192 learned_addr learned my addr 172.21.15.40:0/2297293192 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:02:45.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f9267fff640 1 -- 172.21.15.40:0/2297293192 >> v1:172.21.15.67:6789/0 conn(0x7f926814a750 legacy=0x7f926814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:45.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f9267fff640 1 -- 172.21.15.40:0/2297293192 >> v1:172.21.15.40:6789/0 conn(0x7f92680714c0 legacy=0x7f9268071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:45.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.164+0000 7f9267fff640 1 -- 172.21.15.40:0/2297293192 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680a53d0 con 0x7f926806fa50 2023-05-24T04:02:45.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f9267fff640 1 --2- 172.21.15.40:0/2297293192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f926806fa50 0x7f92680a34a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9250009d90 tx=0x7f925001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921861af350b2afc server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f92677fe640 1 -- 172.21.15.40:0/2297293192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500a5850 con 0x7f926806fa50 2023-05-24T04:02:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f92677fe640 1 -- 172.21.15.40:0/2297293192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f92500a59b0 con 0x7f926806fa50 2023-05-24T04:02:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f92677fe640 1 -- 172.21.15.40:0/2297293192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500a5d60 con 0x7f926806fa50 2023-05-24T04:02:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 -- 172.21.15.40:0/2297293192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f926806fa50 msgr2=0x7f92680a34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2297293192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f926806fa50 0x7f92680a34a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9250009d90 tx=0x7f925001c880 comp rx=0 tx=0).stop 2023-05-24T04:02:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 -- 172.21.15.40:0/2297293192 shutdown_connections 2023-05-24T04:02:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2297293192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f926806fa50 0x7f92680a34a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 -- 172.21.15.40:0/2297293192 >> 172.21.15.40:0/2297293192 conn(0x7f92680c0300 msgr2=0x7f92680c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 -- 172.21.15.40:0/2297293192 shutdown_connections 2023-05-24T04:02:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 -- 172.21.15.40:0/2297293192 wait complete. 2023-05-24T04:02:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.168+0000 7f926ec0e640 1 Processor -- start 2023-05-24T04:02:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- start start 2023-05-24T04:02:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f926806fa50 0x7f92680a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 0x7f926813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f926814a750 0x7f9268140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:45.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926815a2e0 con 0x7f92680714c0 2023-05-24T04:02:45.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92681ee3d0 con 0x7f926806fa50 2023-05-24T04:02:45.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680bf560 con 0x7f926814a750 2023-05-24T04:02:45.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 0x7f926813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:45.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 0x7f926813fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32856/0 (socket says 172.21.15.40:32856) 2023-05-24T04:02:45.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 -- 172.21.15.40:0/2925065089 learned_addr learned my addr 172.21.15.40:0/2925065089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:45.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 -- 172.21.15.40:0/2925065089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f926814a750 msgr2=0x7f9268140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:45.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f926814a750 0x7f9268140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 -- 172.21.15.40:0/2925065089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f926806fa50 msgr2=0x7f92680a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:45.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f926806fa50 0x7f92680a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:45.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 -- 172.21.15.40:0/2925065089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009a70 con 0x7f92680714c0 2023-05-24T04:02:45.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f9267fff640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 0x7f926813fc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9250019490 tx=0x7f9250019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:45.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500adcd0 con 0x7f92680714c0 2023-05-24T04:02:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f92500ade30 con 0x7f92680714c0 2023-05-24T04:02:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926814c220 con 0x7f92680714c0 2023-05-24T04:02:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500b96b0 con 0x7f92680714c0 2023-05-24T04:02:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926814c090 con 0x7f92680714c0 2023-05-24T04:02:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92680a2980 con 0x7f92680714c0 2023-05-24T04:02:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92500039a0 con 0x7f92680714c0 2023-05-24T04:02:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f92657fa640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92480662b0 0x7f9248068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f925011f6f0 con 0x7f92680714c0 2023-05-24T04:02:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.172+0000 7f926c9aa640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92480662b0 0x7f9248068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.176+0000 7f926c9aa640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92480662b0 0x7f9248068760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f926815ab80 tx=0x7f9258007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.180+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f92500ec760 con 0x7f92680714c0 2023-05-24T04:02:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:45.332+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f92680a2980 con 0x7f92680714c0 2023-05-24T04:02:46.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.024+0000 7f92657fa640 1 -- 172.21.15.40:0/2925065089 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f92500efd80 con 0x7f92680714c0 2023-05-24T04:02:46.034 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-05-24T04:02:46.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92480662b0 msgr2=0x7f9248068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:46.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92480662b0 0x7f9248068760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f926815ab80 tx=0x7f9258007a50 comp rx=0 tx=0).stop 2023-05-24T04:02:46.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 msgr2=0x7f926813fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:46.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 0x7f926813fc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9250019490 tx=0x7f9250019620 comp rx=0 tx=0).stop 2023-05-24T04:02:46.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 shutdown_connections 2023-05-24T04:02:46.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f92480662b0 0x7f9248068760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f926814a750 0x7f9268140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92680714c0 0x7f926813fc00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 --2- 172.21.15.40:0/2925065089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f926806fa50 0x7f92680a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 >> 172.21.15.40:0/2925065089 conn(0x7f92680c0300 msgr2=0x7f926806e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:46.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 shutdown_connections 2023-05-24T04:02:46.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.032+0000 7f926ec0e640 1 -- 172.21.15.40:0/2925065089 wait complete. 2023-05-24T04:02:46.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-24T04:02:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 Processor -- start 2023-05-24T04:02:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 -- start start 2023-05-24T04:02:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2dcc06ea50 0x7f2dcc14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 0x7f2dcc06c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc150210 con 0x7f2dcc14f7f0 2023-05-24T04:02:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc1504f0 con 0x7f2dcc06ea50 2023-05-24T04:02:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd354b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc06efd0 con 0x7f2dcc070340 2023-05-24T04:02:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd12e7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2dcc14f7f0 0x7f2dcc06bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34930/0 (socket says 172.21.15.40:34930) 2023-05-24T04:02:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd12e7640 1 -- 172.21.15.40:0/4275711277 learned_addr learned my addr 172.21.15.40:0/4275711277 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:02:46.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd0ae6640 1 --2- 172.21.15.40:0/4275711277 >> v2:172.21.15.67:3300/0 conn(0x7f2dcc06ea50 0x7f2dcc14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd1ae8640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 0x7f2dcc06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702977980 0 0) 0x7f2dcc150210 con 0x7f2dcc14f7f0 2023-05-24T04:02:46.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db4003530 con 0x7f2dcc14f7f0 2023-05-24T04:02:46.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257244831 0 0) 0x7f2db4003530 con 0x7f2dcc14f7f0 2023-05-24T04:02:46.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 msgr2=0x7f2dcc06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 0x7f2dcc06c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 >> v2:172.21.15.67:3300/0 conn(0x7f2dcc06ea50 msgr2=0x7f2dcc14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:46.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/4275711277 >> v2:172.21.15.67:3300/0 conn(0x7f2dcc06ea50 0x7f2dcc14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc06d230 con 0x7f2dcc14f7f0 2023-05-24T04:02:46.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f2dc4001680 con 0x7f2dcc14f7f0 2023-05-24T04:02:46.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 >> v1:172.21.15.40:6789/0 conn(0x7f2dcc14f7f0 legacy=0x7f2dcc06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:46.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 0x7f2db4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4003f00 0x7f2db40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db4004d10 0x7f2db4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1504f0 con 0x7f2db4004d10 2023-05-24T04:02:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc06efd0 con 0x7f2db4003f00 2023-05-24T04:02:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db400b9c0 con 0x7f2dcc070340 2023-05-24T04:02:46.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.196+0000 7f2dd1ae8640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db4004d10 0x7f2db4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd12e7640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 0x7f2db4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd0ae6640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4003f00 0x7f2db40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 -- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 msgr2=0x7f2db4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:46.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc070340 0x7f2db4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 -- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4003f00 msgr2=0x7f2db40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:46.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4003f00 0x7f2db40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 -- 172.21.15.40:0/4275711277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4003530 con 0x7f2db4004d10 2023-05-24T04:02:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db4004d10 0x7f2db4005180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009f90 tx=0x7f2dbc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28da75471929e8ba server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0a5b20 con 0x7f2db4004d10 2023-05-24T04:02:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2dbc00f040 con 0x7f2db4004d10 2023-05-24T04:02:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dcbfff640 1 -- 172.21.15.40:0/4275711277 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0ad440 con 0x7f2db4004d10 2023-05-24T04:02:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd354b640 1 -- 172.21.15.40:0/4275711277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db4004d10 msgr2=0x7f2db4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd354b640 1 --2- 172.21.15.40:0/4275711277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db4004d10 0x7f2db4005180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009f90 tx=0x7f2dbc01cbc0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd1ae8640 1 -- 172.21.15.40:0/4275711277 reap_dead start 2023-05-24T04:02:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd354b640 1 -- 172.21.15.40:0/4275711277 shutdown_connections 2023-05-24T04:02:46.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd354b640 1 -- 172.21.15.40:0/4275711277 >> 172.21.15.40:0/4275711277 conn(0x7f2dcc0c0300 msgr2=0x7f2dcc0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:46.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd354b640 1 -- 172.21.15.40:0/4275711277 shutdown_connections 2023-05-24T04:02:46.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.200+0000 7f2dd354b640 1 -- 172.21.15.40:0/4275711277 wait complete. 2023-05-24T04:02:46.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 Processor -- start 2023-05-24T04:02:46.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- start start 2023-05-24T04:02:46.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4004d10 0x7f2dcc147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 0x7f2dcc0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc145430 0x7f2dcc1458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1492b0 con 0x7f2dcc148c80 2023-05-24T04:02:46.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc147e80 con 0x7f2db4004d10 2023-05-24T04:02:46.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc148570 con 0x7f2dcc145430 2023-05-24T04:02:46.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 0x7f2dcc0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 0x7f2dcc0b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32870/0 (socket says 172.21.15.40:32870) 2023-05-24T04:02:46.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 -- 172.21.15.40:0/1581497440 learned_addr learned my addr 172.21.15.40:0/1581497440 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:46.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd1ae8640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc145430 0x7f2dcc1458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd12e7640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4004d10 0x7f2dcc147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 -- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc145430 msgr2=0x7f2dcc1458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc145430 0x7f2dcc1458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 -- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4004d10 msgr2=0x7f2dcc147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4004d10 0x7f2dcc147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 -- 172.21.15.40:0/1581497440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc070a00 con 0x7f2dcc148c80 2023-05-24T04:02:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd12e7640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4004d10 0x7f2dcc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd0ae6640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 0x7f2dcc0b5a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0010900 tx=0x7f2dc0010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00096b0 con 0x7f2dcc148c80 2023-05-24T04:02:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2dc000ec20 con 0x7f2dcc148c80 2023-05-24T04:02:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc06d3e0 con 0x7f2dcc148c80 2023-05-24T04:02:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc001c400 con 0x7f2dcc148c80 2023-05-24T04:02:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc070b90 con 0x7f2dcc148c80 2023-05-24T04:02:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc148a50 con 0x7f2dcc148c80 2023-05-24T04:02:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2dc001c560 con 0x7f2dcc148c80 2023-05-24T04:02:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dc9ffb640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2db8066280 0x7f2db8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f2dc0084570 con 0x7f2dcc148c80 2023-05-24T04:02:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.204+0000 7f2dd12e7640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2db8066280 0x7f2db8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.208+0000 7f2dd12e7640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2db8066280 0x7f2db8068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4005440 tx=0x7f2dc40015b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.208+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2dc0051820 con 0x7f2dcc148c80 2023-05-24T04:02:46.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:46.364+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2dcc1486b0 con 0x7f2dcc148c80 2023-05-24T04:02:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.052+0000 7f2dc9ffb640 1 -- 172.21.15.40:0/1581497440 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2dcc1486b0 con 0x7f2dcc148c80 2023-05-24T04:02:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-05-24T04:02:47.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2db8066280 msgr2=0x7f2db8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2db8066280 0x7f2db8068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4005440 tx=0x7f2dc40015b0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 msgr2=0x7f2dcc0b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 0x7f2dcc0b5a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0010900 tx=0x7f2dc0010dc0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 shutdown_connections 2023-05-24T04:02:47.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f2db8066280 0x7f2db8068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dcc145430 0x7f2dcc1458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc148c80 0x7f2dcc0b5a40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 --2- 172.21.15.40:0/1581497440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db4004d10 0x7f2dcc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 >> 172.21.15.40:0/1581497440 conn(0x7f2dcc0c0300 msgr2=0x7f2dcc14cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:47.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 shutdown_connections 2023-05-24T04:02:47.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.056+0000 7f2dd354b640 1 -- 172.21.15.40:0/1581497440 wait complete. 2023-05-24T04:02:47.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-24T04:02:47.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009ab9e640 1 Processor -- start 2023-05-24T04:02:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009ab9e640 1 -- start start 2023-05-24T04:02:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009ab9e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 0x7f0094070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009ab9e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0094070830 con 0x7f009406f4a0 2023-05-24T04:02:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009ab9e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0094152440 con 0x7f009414b930 2023-05-24T04:02:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009ab9e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094152720 con 0x7f00940ba990 2023-05-24T04:02:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f009406f4a0 0x7f00940bbbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34932/0 (socket says 172.21.15.40:34932) 2023-05-24T04:02:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 -- 172.21.15.40:0/1708402161 learned_addr learned my addr 172.21.15.40:0/1708402161 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-24T04:02:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f0093fff640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 0x7f0094070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583862226 0 0) 0x7f0094070830 con 0x7f009406f4a0 2023-05-24T04:02:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f007c003530 con 0x7f009406f4a0 2023-05-24T04:02:47.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881657191 0 0) 0x7f007c003530 con 0x7f009406f4a0 2023-05-24T04:02:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 msgr2=0x7f0094070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 0x7f0094070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 >> v1:172.21.15.67:6789/0 conn(0x7f009414b930 legacy=0x7f0094151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094071620 con 0x7f009406f4a0 2023-05-24T04:02:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2957768953 0 0) 0x7f0084001a00 con 0x7f009406f4a0 2023-05-24T04:02:47.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 >> v1:172.21.15.40:6789/0 conn(0x7f009406f4a0 legacy=0x7f00940bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c0039b0 0x7f007c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 0x7f007c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f007c004d10 0x7f007c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094152720 con 0x7f007c004d10 2023-05-24T04:02:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c00baa0 con 0x7f007c0039b0 2023-05-24T04:02:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c00bc60 con 0x7f00940ba990 2023-05-24T04:02:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f007c004d10 0x7f007c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009893a640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c0039b0 0x7f007c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f0093fff640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 0x7f007c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 -- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 msgr2=0x7f007c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:47.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00940ba990 0x7f007c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 -- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c0039b0 msgr2=0x7f007c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T04:02:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c0039b0 0x7f007c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.212+0000 7f009913b640 1 -- 172.21.15.40:0/1708402161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c003530 con 0x7f007c004d10 2023-05-24T04:02:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009913b640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f007c004d10 0x7f007c005180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f008400a830 tx=0x7f008401faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a9e70bb659fd65 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840aa6d0 con 0x7f007c004d10 2023-05-24T04:02:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00840aa830 con 0x7f007c004d10 2023-05-24T04:02:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f00937fe640 1 -- 172.21.15.40:0/1708402161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840aac40 con 0x7f007c004d10 2023-05-24T04:02:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 -- 172.21.15.40:0/1708402161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f007c004d10 msgr2=0x7f007c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 --2- 172.21.15.40:0/1708402161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f007c004d10 0x7f007c005180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f008400a830 tx=0x7f008401faa0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009913b640 1 -- 172.21.15.40:0/1708402161 reap_dead start 2023-05-24T04:02:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 -- 172.21.15.40:0/1708402161 shutdown_connections 2023-05-24T04:02:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 -- 172.21.15.40:0/1708402161 >> 172.21.15.40:0/1708402161 conn(0x7f00940699e0 msgr2=0x7f0094069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 -- 172.21.15.40:0/1708402161 shutdown_connections 2023-05-24T04:02:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 -- 172.21.15.40:0/1708402161 wait complete. 2023-05-24T04:02:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 Processor -- start 2023-05-24T04:02:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.216+0000 7f009ab9e640 1 -- start start 2023-05-24T04:02:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c004d10 0x7f0094143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00941436b0 0x7f0094147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 0x7f009413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009413f2b0 con 0x7f009413e900 2023-05-24T04:02:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941430d0 con 0x7f007c004d10 2023-05-24T04:02:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094148420 con 0x7f00941436b0 2023-05-24T04:02:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 0x7f009413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 0x7f009413ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32884/0 (socket says 172.21.15.40:32884) 2023-05-24T04:02:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 -- 172.21.15.40:0/3270766671 learned_addr learned my addr 172.21.15.40:0/3270766671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-24T04:02:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009893a640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c004d10 0x7f0094143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f0093fff640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00941436b0 0x7f0094147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 -- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00941436b0 msgr2=0x7f0094147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00941436b0 0x7f0094147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 -- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c004d10 msgr2=0x7f0094143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c004d10 0x7f0094143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 -- 172.21.15.40:0/3270766671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00941520a0 con 0x7f009413e900 2023-05-24T04:02:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009893a640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c004d10 0x7f0094143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T04:02:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009913b640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 0x7f009413ed70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f008409c1e0 tx=0x7f007c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840aa6d0 con 0x7f009413e900 2023-05-24T04:02:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00840017c0 con 0x7f009413e900 2023-05-24T04:02:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840aa9a0 con 0x7f009413e900 2023-05-24T04:02:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009414bd00 con 0x7f009413e900 2023-05-24T04:02:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094070cf0 con 0x7f009413e900 2023-05-24T04:02:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00941428e0 con 0x7f009413e900 2023-05-24T04:02:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00840aab00 con 0x7f009413e900 2023-05-24T04:02:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f00917fa640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0080066280 0x7f0080068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T04:02:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009893a640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0080066280 0x7f0080068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T04:02:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f00840b9070 con 0x7f009413e900 2023-05-24T04:02:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.220+0000 7f009893a640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0080066280 0x7f0080068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f008c0016e0 tx=0x7f008c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T04:02:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.224+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f00941428e0 con 0x7f009413e900 2023-05-24T04:02:47.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:47.380+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00941428e0 con 0x7f009413e900 2023-05-24T04:02:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.056+0000 7f00917fa640 1 -- 172.21.15.40:0/3270766671 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f00941428e0 con 0x7f009413e900 2023-05-24T04:02:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' removed 2023-05-24T04:02:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0080066280 msgr2=0x7f0080068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0080066280 0x7f0080068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f008c0016e0 tx=0x7f008c009040 comp rx=0 tx=0).stop 2023-05-24T04:02:48.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 msgr2=0x7f009413ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T04:02:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 0x7f009413ed70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f008409c1e0 tx=0x7f007c005800 comp rx=0 tx=0).stop 2023-05-24T04:02:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 shutdown_connections 2023-05-24T04:02:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:6832/1050561817,v1:172.21.15.40:6833/1050561817] conn(0x7f0080066280 0x7f0080068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f009413e900 0x7f009413ed70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00941436b0 0x7f0094147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 --2- 172.21.15.40:0/3270766671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f007c004d10 0x7f0094143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T04:02:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 >> 172.21.15.40:0/3270766671 conn(0x7f00940699e0 msgr2=0x7f0094070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T04:02:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 shutdown_connections 2023-05-24T04:02:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-24T04:02:48.068+0000 7f009ab9e640 1 -- 172.21.15.40:0/3270766671 wait complete. 2023-05-24T04:02:48.098 INFO:teuthology.misc:Shutting down mds daemons... 2023-05-24T04:02:48.098 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-24T04:02:48.099 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:02:48.110 INFO:tasks.ceph.mds.a:Stopped 2023-05-24T04:02:48.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-24T04:02:48.111 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:02:48.124 INFO:tasks.ceph.mds.b:Stopped 2023-05-24T04:02:48.124 INFO:teuthology.misc:Shutting down osd daemons... 2023-05-24T04:02:48.125 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-05-24T04:02:48.125 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:02:52.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-05-24T04:02:53.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:53.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:53.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:53.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:53.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:02:54.226 INFO:tasks.ceph.osd.0:Stopped 2023-05-24T04:02:54.232 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-05-24T04:02:54.233 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:02:54.303 INFO:tasks.ceph.osd.1:Stopped 2023-05-24T04:02:54.304 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-05-24T04:02:54.304 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:02:54.401 INFO:tasks.ceph.osd.2:Stopped 2023-05-24T04:02:54.402 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-05-24T04:02:54.402 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:02:58.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-05-24T04:02:58.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-05-24T04:03:00.503 INFO:tasks.ceph.osd.3:Stopped 2023-05-24T04:03:00.504 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-05-24T04:03:00.505 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:00.564 INFO:tasks.ceph.osd.4:Stopped 2023-05-24T04:03:00.565 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-05-24T04:03:00.565 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:00.647 INFO:tasks.ceph.osd.5:Stopped 2023-05-24T04:03:00.647 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-05-24T04:03:00.648 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:03.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-05-24T04:03:03.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-05-24T04:03:06.749 INFO:tasks.ceph.osd.6:Stopped 2023-05-24T04:03:06.750 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-05-24T04:03:06.751 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:06.821 INFO:tasks.ceph.osd.7:Stopped 2023-05-24T04:03:06.822 INFO:teuthology.misc:Shutting down mgr daemons... 2023-05-24T04:03:06.822 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-05-24T04:03:06.823 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:06.852 INFO:tasks.ceph.mgr.y:Stopped 2023-05-24T04:03:06.853 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-05-24T04:03:06.853 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:06.881 INFO:tasks.ceph.mgr.x:Stopped 2023-05-24T04:03:06.882 INFO:teuthology.misc:Shutting down mon daemons... 2023-05-24T04:03:06.883 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-05-24T04:03:06.884 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:06.921 INFO:tasks.ceph.mon.a:Stopped 2023-05-24T04:03:06.922 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-05-24T04:03:06.922 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:06.939 INFO:tasks.ceph.mon.b:Stopped 2023-05-24T04:03:06.939 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-05-24T04:03:06.940 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T04:03:07.009 INFO:tasks.ceph.mon.c:Stopped 2023-05-24T04:03:07.010 INFO:tasks.ceph:Checking cluster log for badness... 2023-05-24T04:03:07.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-24T04:03:07.027 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T04:03:07.028 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-05-24T04:03:07.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T04:03:07.378 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-05-24T04:03:07.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T04:03:07.545 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-05-24T04:03:07.696 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T04:03:07.697 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-05-24T04:03:07.847 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T04:03:07.847 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-05-24T04:03:08.165 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T04:03:08.165 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-05-24T04:03:08.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T04:03:08.336 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-05-24T04:03:08.602 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T04:03:08.602 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-05-24T04:03:08.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-05-24T04:03:08.751 INFO:tasks.ceph:Archiving mon data... 2023-05-24T04:03:08.752 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/data/mon.a.tgz 2023-05-24T04:03:08.753 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-05-24T04:03:08.759 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.KHj1wilz2n 2023-05-24T04:03:08.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KHj1wilz2n 2023-05-24T04:03:08.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.KHj1wilz2n 2023-05-24T04:03:08.942 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.KHj1wilz2n is 302KB 2023-05-24T04:03:09.002 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.KHj1wilz2n 2023-05-24T04:03:09.008 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/data/mon.b.tgz 2023-05-24T04:03:09.009 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-05-24T04:03:09.015 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.R2UbKEKEjI 2023-05-24T04:03:09.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.R2UbKEKEjI 2023-05-24T04:03:09.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.R2UbKEKEjI 2023-05-24T04:03:09.236 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.R2UbKEKEjI is 402KB 2023-05-24T04:03:09.297 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.R2UbKEKEjI 2023-05-24T04:03:09.302 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/data/mon.c.tgz 2023-05-24T04:03:09.303 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-05-24T04:03:09.351 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.j0WbDi9xwZ 2023-05-24T04:03:09.352 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.j0WbDi9xwZ 2023-05-24T04:03:09.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.j0WbDi9xwZ 2023-05-24T04:03:09.556 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.j0WbDi9xwZ is 402KB 2023-05-24T04:03:09.634 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.j0WbDi9xwZ 2023-05-24T04:03:09.640 INFO:tasks.ceph:Cleaning ceph cluster... 2023-05-24T04:03:09.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T04:03:09.654 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T04:03:09.687 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T04:03:09.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T04:03:09.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T04:03:09.709 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-05-24T04:03:09.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T04:03:09.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T04:03:09.738 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T04:03:09.744 DEBUG:teuthology.orchestra.run.smithi121:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T04:03:09.751 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T04:03:09.754 DEBUG:teuthology.orchestra.run.smithi162:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T04:03:09.767 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T04:03:09.775 INFO:teuthology.orchestra.run.smithi121.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T04:03:09.777 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T04:03:09.873 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T04:03:09.877 INFO:tasks.ceph:Archiving crash dumps... 2023-05-24T04:03:09.886 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi040/crash 2023-05-24T04:03:09.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T04:03:09.903 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi067/crash 2023-05-24T04:03:09.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T04:03:09.920 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi121/crash 2023-05-24T04:03:09.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T04:03:09.936 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi155/crash 2023-05-24T04:03:09.937 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T04:03:09.950 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi162/crash 2023-05-24T04:03:09.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T04:03:09.969 INFO:tasks.ceph:Shutting down logrotate 2023-05-24T04:03:09.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:09.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:09.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:09.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:09.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:10.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:10.070 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:10.087 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:10.101 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:10.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T04:03:10.127 INFO:tasks.ceph:Compressing logs... 2023-05-24T04:03:10.128 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T04:03:10.131 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T04:03:10.136 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T04:03:10.144 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T04:03:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43357.log 2023-05-24T04:03:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47111.log 2023-05-24T04:03:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2023-05-24T04:03:10.152 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43357.log.gz 2023-05-24T04:03:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2023-05-24T04:03:10.153 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47111.log.gz 2023-05-24T04:03:10.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2023-05-24T04:03:10.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2023-05-24T04:03:10.167 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2023-05-24T04:03:10.168 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2023-05-24T04:03:10.168 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47002.log 2023-05-24T04:03:10.169 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45988.log: /var/log/ceph/ceph-client.admin.46846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45752.log 2023-05-24T04:03:10.169 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2023-05-24T04:03:10.170 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2023-05-24T04:03:10.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2023-05-24T04:03:10.170 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1%/var/log/ceph/ceph-client.admin.45752.log: -- replaced with /var/log/ceph/ceph-client.admin.47002.log.gz 2023-05-24T04:03:10.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2023-05-24T04:03:10.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45910.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45752.log.gz 2023-05-24T04:03:10.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2023-05-24T04:03:10.171 INFO:teuthology.orchestra.run.smithi040.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2023-05-24T04:03:10.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-05-24T04:03:10.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47142.log: /var/log/ceph/ceph-client.admin.43199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46898.log 2023-05-24T04:03:10.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2023-05-24T04:03:10.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2023-05-24T04:03:10.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46170.log 2023-05-24T04:03:10.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44087.log 2023-05-24T04:03:10.174 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46898.log.gz 2023-05-24T04:03:10.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 2023-05-24T04:03:10.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46170.log: /var/log/ceph/ceph-client.admin.44087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45387.log 2023-05-24T04:03:10.175 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46170.log.gz 2023-05-24T04:03:10.175 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44087.log.gz 2023-05-24T04:03:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2023-05-24T04:03:10.175 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2023-05-24T04:03:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46092.log 2023-05-24T04:03:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45387.log: /var/log/ceph/ceph-client.admin.47271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2023-05-24T04:03:10.176 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45387.log.gz 2023-05-24T04:03:10.176 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2023-05-24T04:03:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45622.log 2023-05-24T04:03:10.176 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46092.log.gz 2023-05-24T04:03:10.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43147.log 2023-05-24T04:03:10.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44947.log: /var/log/ceph/ceph-client.admin.45622.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-05-24T04:03:10.177 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2023-05-24T04:03:10.177 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45622.log.gz 2023-05-24T04:03:10.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2023-05-24T04:03:10.177 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43147.log.gz 2023-05-24T04:03:10.178 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2023-05-24T04:03:10.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.45103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43749.log 2023-05-24T04:03:10.178 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2023-05-24T04:03:10.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2023-05-24T04:03:10.178 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2023-05-24T04:03:10.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47085.log 2023-05-24T04:03:10.179 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43749.log.gz 2023-05-24T04:03:10.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44386.log 2023-05-24T04:03:10.179 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2023-05-24T04:03:10.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45233.log 2023-05-24T04:03:10.180 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47085.log.gz 2023-05-24T04:03:10.180 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2023-05-24T04:03:10.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2023-05-24T04:03:10.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45233.log: /var/log/ceph/ceph-client.admin.46690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44386.log.gz 2023-05-24T04:03:10.180 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43517.log 2023-05-24T04:03:10.181 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45233.log.gz 2023-05-24T04:03:10.181 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2023-05-24T04:03:10.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2023-05-24T04:03:10.181 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2023-05-24T04:03:10.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46950.log 2023-05-24T04:03:10.182 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2023-05-24T04:03:10.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45492.log 2023-05-24T04:03:10.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2023-05-24T04:03:10.182 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2023-05-24T04:03:10.182 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46950.log.gz 2023-05-24T04:03:10.182 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2023-05-24T04:03:10.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45492.log: /var/log/ceph/ceph-client.admin.43411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2023-05-24T04:03:10.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45596.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2023-05-24T04:03:10.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45492.log.gz 2023-05-24T04:03:10.183 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2023-05-24T04:03:10.183 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2023-05-24T04:03:10.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43697.log 2023-05-24T04:03:10.186 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T04:03:10.191 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32304.log 2023-05-24T04:03:10.192 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.32304.log: 91.8% -- replaced with /var/log/ceph/ceph-client.1.32304.log.gz 2023-05-24T04:03:10.192 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-05-24T04:03:10.193 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m0.022s 2023-05-24T04:03:10.193 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m0.021s 2023-05-24T04:03:10.194 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.002s 2023-05-24T04:03:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32525.log 2023-05-24T04:03:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32357.log 2023-05-24T04:03:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.32525.log: /var/log/ceph/ceph-client.admin.32357.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.32525.log.gz 2023-05-24T04:03:10.196 INFO:teuthology.orchestra.run.smithi121.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.32357.log.gz 2023-05-24T04:03:10.196 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-05-24T04:03:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m0.022s 2023-05-24T04:03:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m0.012s 2023-05-24T04:03:10.197 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.010s 2023-05-24T04:03:10.211 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.32313.log 2023-05-24T04:03:10.212 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.2.32313.log: 92.4% -- replaced with /var/log/ceph/ceph-client.2.32313.log.gz 2023-05-24T04:03:10.212 INFO:teuthology.orchestra.run.smithi162.stderr: 2023-05-24T04:03:10.212 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m0.015s 2023-05-24T04:03:10.212 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m0.015s 2023-05-24T04:03:10.213 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.005s 2023-05-24T04:03:10.232 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2023-05-24T04:03:10.233 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37300.log 2023-05-24T04:03:10.233 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37324.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-05-24T04:03:10.233 INFO:teuthology.orchestra.run.smithi067.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2023-05-24T04:03:10.234 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37300.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37300.log.gz 2023-05-24T04:03:10.234 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-05-24T04:03:10.234 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37180.log 2023-05-24T04:03:10.234 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37252.log 2023-05-24T04:03:10.234 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37180.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37180.log.gz 2023-05-24T04:03:10.235 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-05-24T04:03:10.235 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-05-24T04:03:10.235 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37252.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-05-24T04:03:10.235 INFO:teuthology.orchestra.run.smithi067.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37252.log.gz 2023-05-24T04:03:10.236 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-05-24T04:03:10.236 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.37156.log 2023-05-24T04:03:10.236 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-05-24T04:03:10.236 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37204.log 2023-05-24T04:03:10.236 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37156.log.gz 2023-05-24T04:03:10.237 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: 91.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-05-24T04:03:10.237 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37228.log 2023-05-24T04:03:10.237 INFO:teuthology.orchestra.run.smithi067.stderr: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-05-24T04:03:10.237 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37204.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-05-24T04:03:10.238 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-05-24T04:03:10.238 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37204.log.gz 2023-05-24T04:03:10.238 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37228.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-05-24T04:03:10.238 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.b.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37228.log.gz 2023-05-24T04:03:10.238 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37276.log 2023-05-24T04:03:10.239 INFO:teuthology.orchestra.run.smithi067.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-05-24T04:03:10.239 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.37276.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37276.log.gz 2023-05-24T04:03:10.248 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43303.log: /var/log/ceph/ceph-client.admin.43621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44165.log 2023-05-24T04:03:10.249 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43697.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2023-05-24T04:03:10.249 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2023-05-24T04:03:10.249 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44605.log 2023-05-24T04:03:10.250 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43697.log.gz 2023-05-24T04:03:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2023-05-24T04:03:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45285.log 2023-05-24T04:03:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44605.log: /var/log/ceph/ceph-client.admin.45648.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44165.log.gz 2023-05-24T04:03:10.251 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44605.log.gz 2023-05-24T04:03:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2023-05-24T04:03:10.251 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2023-05-24T04:03:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43385.log 2023-05-24T04:03:10.252 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2023-05-24T04:03:10.252 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2023-05-24T04:03:10.252 INFO:teuthology.orchestra.run.smithi040.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45285.log.gz 2023-05-24T04:03:10.252 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43385.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-05-24T04:03:10.253 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44217.log 2023-05-24T04:03:10.253 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43385.log.gz 2023-05-24T04:03:10.253 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2023-05-24T04:03:10.253 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44347.log 2023-05-24T04:03:10.254 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43465.log 2023-05-24T04:03:10.254 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44217.log: /var/log/ceph/ceph-client.admin.44347.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-05-24T04:03:10.254 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44217.log.gz 2023-05-24T04:03:10.254 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9%/var/log/ceph/ceph-client.admin.43465.log: -- replaced with /var/log/ceph/ceph-client.admin.44347.log.gz 2023-05-24T04:03:10.255 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2023-05-24T04:03:10.255 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.a.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43465.log.gz 2023-05-24T04:03:10.255 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46716.log 2023-05-24T04:03:10.256 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2023-05-24T04:03:10.256 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46508.log: /var/log/ceph/ceph-client.admin.46716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43879.log 2023-05-24T04:03:10.256 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2023-05-24T04:03:10.256 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46716.log.gz 2023-05-24T04:03:10.257 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44791.log 2023-05-24T04:03:10.257 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43437.log: /var/log/ceph/ceph-client.admin.43879.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2023-05-24T04:03:10.257 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2023-05-24T04:03:10.257 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43879.log.gz 2023-05-24T04:03:10.257 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46612.log 2023-05-24T04:03:10.258 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47028.log 2023-05-24T04:03:10.258 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44791.log.gz 2023-05-24T04:03:10.258 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46612.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2023-05-24T04:03:10.258 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2023-05-24T04:03:10.259 INFO:teuthology.orchestra.run.smithi040.stderr:gzip 88.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46612.log.gz -- 2023-05-24T04:03:10.259 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.44608.log 2023-05-24T04:03:10.259 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47028.log: /var/log/ceph/ceph-client.admin.44321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47166.log 2023-05-24T04:03:10.260 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47028.log.gz 2023-05-24T04:03:10.260 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz/var/log/ceph/ceph-client.admin.44608.log: 2023-05-24T04:03:10.260 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2023-05-24T04:03:10.260 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2023-05-24T04:03:10.261 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2023-05-24T04:03:10.261 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47166.log: /var/log/ceph/ceph-client.admin.43957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45726.log 2023-05-24T04:03:10.261 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47166.log.gz 2023-05-24T04:03:10.261 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%/var/log/ceph/ceph-client.admin.44388.log: -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2023-05-24T04:03:10.262 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43019.log 2023-05-24T04:03:10.262 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2023-05-24T04:03:10.262 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44398.log 2023-05-24T04:03:10.262 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2023-05-24T04:03:10.262 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43019.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45726.log.gz 2023-05-24T04:03:10.263 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44035.log 2023-05-24T04:03:10.263 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43019.log.gz 2023-05-24T04:03:10.263 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45962.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44398.log.gz 2023-05-24T04:03:10.263 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44400.log 2023-05-24T04:03:10.263 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2023-05-24T04:03:10.264 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2023-05-24T04:03:10.264 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42952.log 2023-05-24T04:03:10.264 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44400.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44035.log.gz 2023-05-24T04:03:10.264 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2023-05-24T04:03:10.264 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44400.log.gz 2023-05-24T04:03:10.265 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2023-05-24T04:03:10.265 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2023-05-24T04:03:10.265 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42952.log: /var/log/ceph/ceph-client.admin.43491.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42952.log.gz 2023-05-24T04:03:10.265 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2023-05-24T04:03:10.265 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45361.log 2023-05-24T04:03:10.266 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2023-05-24T04:03:10.266 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46378.log: /var/log/ceph/ceph-client.admin.47323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46820.log 2023-05-24T04:03:10.266 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2023-05-24T04:03:10.266 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2023-05-24T04:03:10.267 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2023-05-24T04:03:10.267 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45361.log: /var/log/ceph/ceph-client.admin.46820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2023-05-24T04:03:10.267 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45361.log.gz 2023-05-24T04:03:10.267 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46820.log.gz 2023-05-24T04:03:10.267 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-05-24T04:03:10.267 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2023-05-24T04:03:10.268 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 2023-05-24T04:03:10.268 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45259.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45414.log 2023-05-24T04:03:10.268 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2023-05-24T04:03:10.268 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46534.log 2023-05-24T04:03:10.268 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2023-05-24T04:03:10.269 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2023-05-24T04:03:10.269 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45414.log.gz 2023-05-24T04:03:10.269 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46586.log 2023-05-24T04:03:10.269 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9%/var/log/ceph/ceph-client.admin.45780.log: -- replaced with /var/log/ceph/ceph-client.admin.46534.log.gz 2023-05-24T04:03:10.270 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45858.log 2023-05-24T04:03:10.270 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2023-05-24T04:03:10.271 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46586.log.gz 2023-05-24T04:03:10.271 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46118.log 2023-05-24T04:03:10.271 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46144.log 2023-05-24T04:03:10.272 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46118.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45858.log.gz 2023-05-24T04:03:10.272 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43072.log 2023-05-24T04:03:10.273 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46118.log.gz 2023-05-24T04:03:10.273 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2023-05-24T04:03:10.273 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46144.log: /var/log/ceph/ceph-client.admin.43072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46144.log.gz 2023-05-24T04:03:10.274 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43072.log.gz 2023-05-24T04:03:10.274 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43775.log 2023-05-24T04:03:10.274 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43225.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-05-24T04:03:10.274 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%/var/log/ceph/ceph-client.admin.43775.log: -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2023-05-24T04:03:10.275 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-05-24T04:03:10.275 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43775.log.gz 2023-05-24T04:03:10.275 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46456.log 2023-05-24T04:03:10.275 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45570.log 2023-05-24T04:03:10.276 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45077.log: /var/log/ceph/ceph-client.admin.46456.log: 88.2% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46456.log.gz 2023-05-24T04:03:10.276 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2023-05-24T04:03:10.276 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2023-05-24T04:03:10.277 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2023-05-24T04:03:10.277 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46482.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45570.log.gz 2023-05-24T04:03:10.277 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2023-05-24T04:03:10.277 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2023-05-24T04:03:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2023-05-24T04:03:10.278 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4%/var/log/ceph/ceph-client.admin.45155.log: -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2023-05-24T04:03:10.278 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2023-05-24T04:03:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46040.log 2023-05-24T04:03:10.279 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43543.log 2023-05-24T04:03:10.279 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2023-05-24T04:03:10.279 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46040.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32140.log 2023-05-24T04:03:10.280 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46040.log.gz 2023-05-24T04:03:10.280 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46014.log 2023-05-24T04:03:10.280 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43543.log.gz 2023-05-24T04:03:10.280 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.tmp-client.admin.32140.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32140.log.gz 2023-05-24T04:03:10.281 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45207.log 2023-05-24T04:03:10.281 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45181.log 2023-05-24T04:03:10.281 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46014.log.gz 2023-05-24T04:03:10.282 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44243.log 2023-05-24T04:03:10.282 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45207.log.gz 2023-05-24T04:03:10.282 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44061.log 2023-05-24T04:03:10.283 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45181.log.gz 2023-05-24T04:03:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2023-05-24T04:03:10.284 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44061.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gz 2023-05-24T04:03:10.285 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46326.log 2023-05-24T04:03:10.285 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44061.log.gz 2023-05-24T04:03:10.285 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44895.log 2023-05-24T04:03:10.286 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46326.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2023-05-24T04:03:10.286 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2023-05-24T04:03:10.287 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46326.log.gz 2023-05-24T04:03:10.287 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45051.log 2023-05-24T04:03:10.288 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44895.log: /var/log/ceph/ceph-client.admin.44009.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44895.log.gz 2023-05-24T04:03:10.288 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2023-05-24T04:03:10.288 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44139.log 2023-05-24T04:03:10.289 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43801.log 2023-05-24T04:03:10.289 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45051.log: /var/log/ceph/ceph-client.admin.44139.log: 89.1% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45051.log.gz 2023-05-24T04:03:10.290 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44139.log.gz 2023-05-24T04:03:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2023-05-24T04:03:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2023-05-24T04:03:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43801.log: /var/log/ceph/ceph-client.admin.43251.log: 91.6% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43801.log.gz 2023-05-24T04:03:10.293 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2023-05-24T04:03:10.294 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-05-24T04:03:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2023-05-24T04:03:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45466.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-05-24T04:03:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43595.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2023-05-24T04:03:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45674.log 2023-05-24T04:03:10.298 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2023-05-24T04:03:10.298 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2023-05-24T04:03:10.298 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45674.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45674.log.gz 2023-05-24T04:03:10.299 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44843.log 2023-05-24T04:03:10.299 INFO:teuthology.orchestra.run.smithi040.stderr: 84.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-05-24T04:03:10.300 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2023-05-24T04:03:10.300 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4%/var/log/ceph/ceph-client.admin.44843.log: -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2023-05-24T04:03:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44973.log 2023-05-24T04:03:10.302 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44843.log.gz 2023-05-24T04:03:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2023-05-24T04:03:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44599.log: /var/log/ceph/ceph-client.admin.44973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2023-05-24T04:03:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45544.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2023-05-24T04:03:10.304 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44973.log.gz 2023-05-24T04:03:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45025.log 2023-05-24T04:03:10.305 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2023-05-24T04:03:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2023-05-24T04:03:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45025.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2023-05-24T04:03:10.307 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2023-05-24T04:03:10.307 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45025.log.gz 2023-05-24T04:03:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45936.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2023-05-24T04:03:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44269.log 2023-05-24T04:03:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45440.log 2023-05-24T04:03:10.310 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2023-05-24T04:03:10.310 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz 2023-05-24T04:03:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44269.log: /var/log/ceph/ceph-client.admin.45440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-05-24T04:03:10.311 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44269.log.gz 2023-05-24T04:03:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45806.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45440.log.gz 2023-05-24T04:03:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46274.log 2023-05-24T04:03:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2023-05-24T04:03:10.314 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2023-05-24T04:03:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47219.log: /var/log/ceph/ceph-client.admin.46274.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44817.log 2023-05-24T04:03:10.315 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46274.log.gz 2023-05-24T04:03:10.315 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-05-24T04:03:10.315 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36907.log 2023-05-24T04:03:10.316 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2023-05-24T04:03:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44600.log 2023-05-24T04:03:10.317 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2023-05-24T04:03:10.317 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44817.log.gz 2023-05-24T04:03:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36907.log: /var/log/ceph/ceph-client.admin.44600.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44600.log.gz 2023-05-24T04:03:10.318 INFO:teuthology.orchestra.run.smithi040.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.36907.log.gz 2023-05-24T04:03:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43277.log 2023-05-24T04:03:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2023-05-24T04:03:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43277.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2023-05-24T04:03:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46196.log 2023-05-24T04:03:10.320 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45518.log 2023-05-24T04:03:10.320 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43277.log.gz 2023-05-24T04:03:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46300.log: /var/log/ceph/ceph-client.admin.46196.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2023-05-24T04:03:10.321 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46196.log.gz 2023-05-24T04:03:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-05-24T04:03:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2023-05-24T04:03:10.322 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.45518.log.gzgzip 2023-05-24T04:03:10.323 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2023-05-24T04:03:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47056.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2023-05-24T04:03:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43101.log 2023-05-24T04:03:10.324 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-05-24T04:03:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47297.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-05-24T04:03:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43101.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2023-05-24T04:03:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37016.log 2023-05-24T04:03:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44401.log 2023-05-24T04:03:10.326 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.43101.log.gz 2023-05-24T04:03:10.327 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.37016.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37016.log.gz 2023-05-24T04:03:10.327 INFO:teuthology.orchestra.run.smithi040.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-05-24T04:03:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2023-05-24T04:03:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2023-05-24T04:03:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46248.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44401.log.gz 2023-05-24T04:03:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46066.log 2023-05-24T04:03:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz --verbose 2023-05-24T04:03:10.331 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.46976.log 2023-05-24T04:03:10.332 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46066.log: /var/log/ceph/ceph-client.admin.43044.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46066.log.gz 2023-05-24T04:03:10.332 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2023-05-24T04:03:10.332 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44597.log 2023-05-24T04:03:10.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46924.log 2023-05-24T04:03:10.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44597.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46976.log.gz 2023-05-24T04:03:10.333 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43173.log 2023-05-24T04:03:10.333 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45832.log 2023-05-24T04:03:10.334 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44597.log.gz 2023-05-24T04:03:10.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46924.log: /var/log/ceph/ceph-client.admin.43173.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43173.log.gz 2023-05-24T04:03:10.334 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46924.log.gz 2023-05-24T04:03:10.334 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44999.log 2023-05-24T04:03:10.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2023-05-24T04:03:10.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44999.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2023-05-24T04:03:10.335 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45832.log.gz 2023-05-24T04:03:10.335 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44999.log.gz 2023-05-24T04:03:10.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43329.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2023-05-24T04:03:10.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44391.log 2023-05-24T04:03:10.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2023-05-24T04:03:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44391.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz --verbose 2023-05-24T04:03:10.337 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.46664.log 2023-05-24T04:03:10.337 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44391.log.gz 2023-05-24T04:03:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44395.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2023-05-24T04:03:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2023-05-24T04:03:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2023-05-24T04:03:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46664.log.gz -- 2023-05-24T04:03:10.339 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.46872.log 2023-05-24T04:03:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46794.log: /var/log/ceph/ceph-client.admin.47193.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2023-05-24T04:03:10.339 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2023-05-24T04:03:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2023-05-24T04:03:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46638.log 2023-05-24T04:03:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46404.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46768.log 2023-05-24T04:03:10.341 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46872.log.gz 2023-05-24T04:03:10.341 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2023-05-24T04:03:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46638.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2023-05-24T04:03:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43569.log 2023-05-24T04:03:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2023-05-24T04:03:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43569.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46768.log.gz 2023-05-24T04:03:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43723.log 2023-05-24T04:03:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47375.log 2023-05-24T04:03:10.344 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43569.log.gz 2023-05-24T04:03:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44607.log: /var/log/ceph/ceph-client.admin.43723.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2023-05-24T04:03:10.345 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43723.log.gz 2023-05-24T04:03:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43827.log 2023-05-24T04:03:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2023-05-24T04:03:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43827.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46560.log 2023-05-24T04:03:10.346 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47375.log.gz 2023-05-24T04:03:10.346 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43827.log.gz 2023-05-24T04:03:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2023-05-24T04:03:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2023-05-24T04:03:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46560.log: /var/log/ceph/ceph-client.admin.46352.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46560.log.gz 2023-05-24T04:03:10.347 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2023-05-24T04:03:10.347 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-05-24T04:03:10.348 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-05-24T04:03:10.352 INFO:teuthology.orchestra.run.smithi067.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-05-24T04:03:10.468 INFO:teuthology.orchestra.run.smithi040.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-05-24T04:03:10.879 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-05-24T04:03:10.887 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-05-24T04:03:10.889 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-05-24T04:03:10.899 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-05-24T04:03:10.907 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-05-24T04:03:10.908 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-05-24T04:03:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m0.775s 2023-05-24T04:03:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m3.296s 2023-05-24T04:03:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.181s 2023-05-24T04:03:10.934 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-05-24T04:03:10.976 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-05-24T04:03:11.003 INFO:teuthology.orchestra.run.smithi067.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-05-24T04:03:11.006 INFO:teuthology.orchestra.run.smithi067.stderr: 2023-05-24T04:03:11.006 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m0.866s 2023-05-24T04:03:11.006 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m3.044s 2023-05-24T04:03:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.165s 2023-05-24T04:03:11.015 INFO:tasks.ceph:Archiving logs... 2023-05-24T04:03:11.016 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi040/log 2023-05-24T04:03:11.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T04:03:11.565 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi067/log 2023-05-24T04:03:11.566 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T04:03:11.936 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi121/log 2023-05-24T04:03:11.937 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T04:03:11.978 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi155/log 2023-05-24T04:03:11.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T04:03:12.013 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi162/log 2023-05-24T04:03:12.015 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T04:03:12.032 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-05-24T04:03:12.045 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-05-24T04:03:12.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T04:03:12.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T04:03:12.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T04:03:12.065 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T04:03:12.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T04:03:12.228 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-05-24T04:03:12.242 INFO:teuthology.task.clock:Checking final clock skew... 2023-05-24T04:03:12.243 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T04:03:12.246 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T04:03:12.249 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T04:03:12.252 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T04:03:12.255 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T04:03:12.256 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T04:03:12.257 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2023-05-24T04:03:12.257 INFO:teuthology.orchestra.run.smithi040.stdout:*hv01.front.sepi 44.4.53.2 2 u 36 64 177 0.103 +3.714 1.872 2023-05-24T04:03:12.257 INFO:teuthology.orchestra.run.smithi040.stdout:+hv02.front.sepi 63.231.80.2 3 u 33 64 177 0.107 -0.226 1.829 2023-05-24T04:03:12.257 INFO:teuthology.orchestra.run.smithi040.stdout:+hv03.front.sepi 74.6.168.72 3 u 33 64 177 0.118 -0.596 1.897 2023-05-24T04:03:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T04:03:12.270 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T04:03:12.271 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2023-05-24T04:03:12.271 INFO:teuthology.orchestra.run.smithi155.stdout:*hv01.front.sepi 44.4.53.2 2 u 32 64 177 0.108 +1.312 0.871 2023-05-24T04:03:12.271 INFO:teuthology.orchestra.run.smithi155.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 177 0.144 -0.422 0.860 2023-05-24T04:03:12.271 INFO:teuthology.orchestra.run.smithi155.stdout:+hv03.front.sepi 74.6.168.72 3 u 35 64 177 0.127 -3.039 1.023 2023-05-24T04:03:12.272 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T04:03:12.272 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T04:03:12.272 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2023-05-24T04:03:12.273 INFO:teuthology.orchestra.run.smithi121.stdout:*hv01.front.sepi 44.4.53.2 2 u 36 64 177 0.090 +1.684 1.622 2023-05-24T04:03:12.273 INFO:teuthology.orchestra.run.smithi121.stdout:+hv02.front.sepi 63.231.80.2 3 u 39 64 177 0.069 +0.458 1.935 2023-05-24T04:03:12.273 INFO:teuthology.orchestra.run.smithi121.stdout:+hv03.front.sepi 74.6.168.72 3 u 39 64 177 0.069 -2.293 1.848 2023-05-24T04:03:12.274 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T04:03:12.274 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T04:03:12.275 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2023-05-24T04:03:12.275 INFO:teuthology.orchestra.run.smithi067.stdout:*hv01.front.sepi 44.4.53.2 2 u 34 64 177 0.095 +3.465 2.340 2023-05-24T04:03:12.275 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi 63.231.80.2 3 u 33 64 177 0.099 +0.791 1.714 2023-05-24T04:03:12.275 INFO:teuthology.orchestra.run.smithi067.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 177 0.090 -2.784 1.287 2023-05-24T04:03:12.275 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T04:03:12.276 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2023-05-24T04:03:12.277 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2023-05-24T04:03:12.277 INFO:teuthology.orchestra.run.smithi162.stdout:+hv01.front.sepi 44.4.53.2 2 u 33 64 177 0.099 -0.118 2.094 2023-05-24T04:03:12.278 INFO:teuthology.orchestra.run.smithi162.stdout:*hv02.front.sepi 63.231.80.2 3 u 35 64 177 0.079 +1.053 2.016 2023-05-24T04:03:12.278 INFO:teuthology.orchestra.run.smithi162.stdout:+hv03.front.sepi 74.6.168.72 3 u 32 64 177 0.105 -3.435 1.480 2023-05-24T04:03:12.278 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-24T04:03:12.279 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-05-24T04:03:12.294 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-05-24T04:03:12.295 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-05-24T04:03:12.305 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-05-24T04:03:12.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-05-24T04:03:12.333 INFO:teuthology.task.internal:Duration was 906.256314 seconds 2023-05-24T04:03:12.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-05-24T04:03:12.374 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-05-24T04:03:12.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T04:03:12.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T04:03:12.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T04:03:12.382 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T04:03:12.386 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T04:03:12.483 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-05-24T04:03:12.483 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-05-24T04:03:12.484 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T04:03:12.493 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2023-05-24T04:03:12.494 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T04:03:12.505 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2023-05-24T04:03:12.505 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T04:03:12.516 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-05-24T04:03:12.539 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T04:03:12.553 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2023-05-24T04:03:12.555 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T04:03:12.568 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-05-24T04:03:12.569 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T04:03:12.572 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T04:03:12.575 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T04:03:12.578 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T04:03:12.602 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T04:03:12.632 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-05-24T04:03:12.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T04:03:12.637 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T04:03:12.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T04:03:12.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T04:03:12.666 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T04:03:12.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-05-24T04:03:12.760 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-05-24T04:03:12.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T04:03:12.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T04:03:12.789 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T04:03:12.804 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T04:03:12.818 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T04:03:12.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-05-24T04:03:12.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.848 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.851 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.854 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.858 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-05-24T04:03:12.861 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2023-05-24T04:03:12.862 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.864 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2023-05-24T04:03:12.871 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-05-24T04:03:12.886 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2023-05-24T04:03:12.907 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:03:12.930 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:03:12.955 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:03:12.960 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:03:12.967 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T04:03:12.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:03:12.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-05-24T04:03:12.984 INFO:teuthology.task.internal:Transferring archived files... 2023-05-24T04:03:12.985 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi040 2023-05-24T04:03:12.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T04:03:13.008 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi067 2023-05-24T04:03:13.009 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T04:03:13.028 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi121 2023-05-24T04:03:13.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T04:03:13.047 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi155 2023-05-24T04:03:13.047 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T04:03:13.074 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314/remote/smithi162 2023-05-24T04:03:13.086 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T04:03:13.115 INFO:teuthology.task.internal:Removing archive directory... 2023-05-24T04:03:13.116 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T04:03:13.118 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T04:03:13.121 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T04:03:13.123 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T04:03:13.126 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T04:03:13.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-05-24T04:03:13.164 INFO:teuthology.task.internal:Not uploading archives. 2023-05-24T04:03:13.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-05-24T04:03:13.252 INFO:teuthology.task.internal:Tidying up after the test... 2023-05-24T04:03:13.253 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T04:03:13.256 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T04:03:13.259 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T04:03:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 24 04:03 /home/ubuntu/cephtest 2023-05-24T04:03:13.263 INFO:teuthology.orchestra.run.smithi067.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 24 04:03 /home/ubuntu/cephtest 2023-05-24T04:03:13.264 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T04:03:13.268 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T04:03:13.269 INFO:teuthology.orchestra.run.smithi121.stdout: 655472 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 24 04:03 /home/ubuntu/cephtest 2023-05-24T04:03:13.270 INFO:teuthology.orchestra.run.smithi121.stdout: 673531 804 -rw-rw-r-- 1 ubuntu ubuntu 819271 Jan 8 2013 /home/ubuntu/cephtest/ior.tbz2 2023-05-24T04:03:13.270 INFO:teuthology.orchestra.run.smithi121.stdout: 673532 4 drwxr-xr-x 9 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior 2023-05-24T04:03:13.270 INFO:teuthology.orchestra.run.smithi121.stdout: 676897 36 -rwxrwxr-x 1 ubuntu ubuntu 34739 May 24 04:00 /home/ubuntu/cephtest/ior/config.status 2023-05-24T04:03:13.271 INFO:teuthology.orchestra.run.smithi121.stdout: 676845 4 drwxrwxr-x 4 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/src 2023-05-24T04:03:13.271 INFO:teuthology.orchestra.run.smithi121.stdout: 676861 8 -rw-rw-r-- 1 ubuntu ubuntu 7616 Nov 14 2012 /home/ubuntu/cephtest/ior/src/iordef.h 2023-05-24T04:03:13.271 INFO:teuthology.orchestra.run.smithi121.stdout: 676893 408 -rw-rw-r-- 1 ubuntu ubuntu 415232 May 24 04:00 /home/ubuntu/cephtest/ior/src/ior.o 2023-05-24T04:03:13.271 INFO:teuthology.orchestra.run.smithi121.stdout: 676856 104 -rw-rw-r-- 1 ubuntu ubuntu 102750 Nov 14 2012 /home/ubuntu/cephtest/ior/src/ior.c 2023-05-24T04:03:13.272 INFO:teuthology.orchestra.run.smithi121.stdout: 676848 20 -rw-rw-r-- 1 ubuntu ubuntu 18449 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-MPIIO.c 2023-05-24T04:03:13.272 INFO:teuthology.orchestra.run.smithi121.stdout: 676869 4 -rw-rw-r-- 1 ubuntu ubuntu 501 Nov 14 2012 /home/ubuntu/cephtest/ior/src/Makefile.am 2023-05-24T04:03:13.272 INFO:teuthology.orchestra.run.smithi121.stdout: 676852 20 -rw-rw-r-- 1 ubuntu ubuntu 17668 Nov 14 2012 /home/ubuntu/cephtest/ior/src/Makefile.in 2023-05-24T04:03:13.272 INFO:teuthology.orchestra.run.smithi121.stdout: 676854 52 -rw-rw-r-- 1 ubuntu ubuntu 52400 May 24 04:00 /home/ubuntu/cephtest/ior/src/aiori-POSIX.o 2023-05-24T04:03:13.273 INFO:teuthology.orchestra.run.smithi121.stdout: 676858 4 -rw-rw-r-- 1 ubuntu ubuntu 1010 Nov 14 2012 /home/ubuntu/cephtest/ior/src/utilities.h 2023-05-24T04:03:13.273 INFO:teuthology.orchestra.run.smithi121.stdout: 673534 20 -rw-rw-r-- 1 ubuntu ubuntu 16828 May 24 04:00 /home/ubuntu/cephtest/ior/src/Makefile 2023-05-24T04:03:13.273 INFO:teuthology.orchestra.run.smithi121.stdout: 677994 8 -rw-rw-r-- 1 ubuntu ubuntu 4716 May 24 04:00 /home/ubuntu/cephtest/ior/src/config.h 2023-05-24T04:03:13.273 INFO:teuthology.orchestra.run.smithi121.stdout: 676868 24 -rw-rw-r-- 1 ubuntu ubuntu 23290 Nov 14 2012 /home/ubuntu/cephtest/ior/src/parse_options.c 2023-05-24T04:03:13.274 INFO:teuthology.orchestra.run.smithi121.stdout: 676886 16 -rw-rw-r-- 1 ubuntu ubuntu 14528 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-NCMPI.c 2023-05-24T04:03:13.274 INFO:teuthology.orchestra.run.smithi121.stdout: 676851 4 -rw-rw-r-- 1 ubuntu ubuntu 788 Nov 14 2012 /home/ubuntu/cephtest/ior/src/parse_options.h 2023-05-24T04:03:13.274 INFO:teuthology.orchestra.run.smithi121.stdout: 676846 16 -rw-rw-r-- 1 ubuntu ubuntu 14651 Nov 14 2012 /home/ubuntu/cephtest/ior/src/utilities.c 2023-05-24T04:03:13.274 INFO:teuthology.orchestra.run.smithi121.stdout: 676866 68 -rw-rw-r-- 1 ubuntu ubuntu 66392 May 24 04:00 /home/ubuntu/cephtest/ior/src/utilities.o 2023-05-24T04:03:13.275 INFO:teuthology.orchestra.run.smithi121.stdout: 676867 96 -rw-rw-r-- 1 ubuntu ubuntu 96568 May 24 04:00 /home/ubuntu/cephtest/ior/src/parse_options.o 2023-05-24T04:03:13.275 INFO:teuthology.orchestra.run.smithi121.stdout: 676883 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win 2023-05-24T04:03:13.275 INFO:teuthology.orchestra.run.smithi121.stdout: 676885 40 -rw-rw-r-- 1 ubuntu ubuntu 38845 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win/getopt.c 2023-05-24T04:03:13.275 INFO:teuthology.orchestra.run.smithi121.stdout: 676884 8 -rw-rw-r-- 1 ubuntu ubuntu 6783 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win/getopt.h 2023-05-24T04:03:13.275 INFO:teuthology.orchestra.run.smithi121.stdout: 676849 4 -rw-rw-r-- 1 ubuntu ubuntu 27 May 24 04:00 /home/ubuntu/cephtest/ior/src/stamp-h1 2023-05-24T04:03:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: 676882 24 -rw-rw-r-- 1 ubuntu ubuntu 23136 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-HDF5.c 2023-05-24T04:03:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: 676850 16 -rw-rw-r-- 1 ubuntu ubuntu 13065 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-POSIX.c 2023-05-24T04:03:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: 676859 8 -rw-rw-r-- 1 ubuntu ubuntu 7357 Nov 14 2012 /home/ubuntu/cephtest/ior/src/ior.h 2023-05-24T04:03:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: 676870 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps 2023-05-24T04:03:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: 676879 12 -rw-rw-r-- 1 ubuntu ubuntu 11771 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/aiori-MPIIO.Po 2023-05-24T04:03:13.277 INFO:teuthology.orchestra.run.smithi121.stdout: 676877 4 -rw-rw-r-- 1 ubuntu ubuntu 8 Nov 14 2012 /home/ubuntu/cephtest/ior/src/.deps/aiori-NCMPI.Po 2023-05-24T04:03:13.277 INFO:teuthology.orchestra.run.smithi121.stdout: 676878 16 -rw-rw-r-- 1 ubuntu ubuntu 13048 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/aiori-POSIX.Po 2023-05-24T04:03:13.277 INFO:teuthology.orchestra.run.smithi121.stdout: 676857 16 -rw-rw-r-- 1 ubuntu ubuntu 13298 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/ior.Po 2023-05-24T04:03:13.277 INFO:teuthology.orchestra.run.smithi121.stdout: 676881 12 -rw-rw-r-- 1 ubuntu ubuntu 11547 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/parse_options.Po 2023-05-24T04:03:13.278 INFO:teuthology.orchestra.run.smithi121.stdout: 676871 4 -rw-rw-r-- 1 ubuntu ubuntu 8 Nov 14 2012 /home/ubuntu/cephtest/ior/src/.deps/aiori-HDF5.Po 2023-05-24T04:03:13.278 INFO:teuthology.orchestra.run.smithi121.stdout: 676880 16 -rw-rw-r-- 1 ubuntu ubuntu 13558 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/utilities.Po 2023-05-24T04:03:13.278 INFO:teuthology.orchestra.run.smithi121.stdout: 676860 68 -rw-rw-r-- 1 ubuntu ubuntu 67760 May 24 04:00 /home/ubuntu/cephtest/ior/src/aiori-MPIIO.o 2023-05-24T04:03:13.278 INFO:teuthology.orchestra.run.smithi121.stdout: 676853 8 -rw-rw-r-- 1 ubuntu ubuntu 4404 Nov 14 2012 /home/ubuntu/cephtest/ior/src/config.h.in 2023-05-24T04:03:13.279 INFO:teuthology.orchestra.run.smithi121.stdout: 676887 4 -rw-rw-r-- 1 ubuntu ubuntu 3099 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori.h 2023-05-24T04:03:13.279 INFO:teuthology.orchestra.run.smithi121.stdout: 676895 4 -rw-rw-r-- 1 ubuntu ubuntu 542 Nov 14 2012 /home/ubuntu/cephtest/ior/README 2023-05-24T04:03:13.279 INFO:teuthology.orchestra.run.smithi121.stdout: 676839 188 -rwxrwxr-x 1 ubuntu ubuntu 189589 Nov 14 2012 /home/ubuntu/cephtest/ior/configure 2023-05-24T04:03:13.280 INFO:teuthology.orchestra.run.smithi121.stdout: 676844 8 -rw-rw-r-- 1 ubuntu ubuntu 7084 Nov 14 2012 /home/ubuntu/cephtest/ior/ChangeLog 2023-05-24T04:03:13.280 INFO:teuthology.orchestra.run.smithi121.stdout: 676896 4 -rw-rw-r-- 1 ubuntu ubuntu 71 Nov 14 2012 /home/ubuntu/cephtest/ior/Makefile.am 2023-05-24T04:03:13.280 INFO:teuthology.orchestra.run.smithi121.stdout: 676840 24 -rw-rw-r-- 1 ubuntu ubuntu 22560 Nov 14 2012 /home/ubuntu/cephtest/ior/Makefile.in 2023-05-24T04:03:13.281 INFO:teuthology.orchestra.run.smithi121.stdout: 676894 60 -rw-rw-r-- 1 ubuntu ubuntu 61408 May 24 04:00 /home/ubuntu/cephtest/ior/config.log 2023-05-24T04:03:13.281 INFO:teuthology.orchestra.run.smithi121.stdout: 677992 4 -rw-rw-r-- 1 ubuntu ubuntu 39 Nov 14 2012 /home/ubuntu/cephtest/ior/META 2023-05-24T04:03:13.281 INFO:teuthology.orchestra.run.smithi121.stdout: 676817 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/testing 2023-05-24T04:03:13.281 INFO:teuthology.orchestra.run.smithi121.stdout: 676819 4 -rw-rw-r-- 1 ubuntu ubuntu 75 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/hintsFile 2023-05-24T04:03:13.282 INFO:teuthology.orchestra.run.smithi121.stdout: 676820 48 -rwxrwxr-x 1 ubuntu ubuntu 45738 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/IOR-tester.py 2023-05-24T04:03:13.282 INFO:teuthology.orchestra.run.smithi121.stdout: 676818 4 -rw-rw-r-- 1 ubuntu ubuntu 1681 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/IOR-tester.README 2023-05-24T04:03:13.282 INFO:teuthology.orchestra.run.smithi121.stdout: 678003 24 -rw-rw-r-- 1 ubuntu ubuntu 22561 May 24 04:00 /home/ubuntu/cephtest/ior/Makefile 2023-05-24T04:03:13.282 INFO:teuthology.orchestra.run.smithi121.stdout: 676841 16 -rw-rw-r-- 1 ubuntu ubuntu 14585 Nov 14 2012 /home/ubuntu/cephtest/ior/COPYRIGHT 2023-05-24T04:03:13.283 INFO:teuthology.orchestra.run.smithi121.stdout: 676822 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/config 2023-05-24T04:03:13.283 INFO:teuthology.orchestra.run.smithi121.stdout: 676823 44 -rwxr-xr-x 1 ubuntu ubuntu 44826 Nov 14 2012 /home/ubuntu/cephtest/ior/config/config.guess 2023-05-24T04:03:13.283 INFO:teuthology.orchestra.run.smithi121.stdout: 676834 16 -rwxr-xr-x 1 ubuntu ubuntu 13998 Nov 14 2012 /home/ubuntu/cephtest/ior/config/install-sh 2023-05-24T04:03:13.283 INFO:teuthology.orchestra.run.smithi121.stdout: 676832 12 -rwxr-xr-x 1 ubuntu ubuntu 10346 Nov 14 2012 /home/ubuntu/cephtest/ior/config/missing 2023-05-24T04:03:13.284 INFO:teuthology.orchestra.run.smithi121.stdout: 676829 8 -rw-rw-r-- 1 ubuntu ubuntu 6153 Nov 14 2012 /home/ubuntu/cephtest/ior/config/ax_prog_cc_mpi.m4 2023-05-24T04:03:13.284 INFO:teuthology.orchestra.run.smithi121.stdout: 676830 4 -rw-rw-r-- 1 ubuntu ubuntu 3545 Nov 14 2012 /home/ubuntu/cephtest/ior/config/x_ac_meta.m4 2023-05-24T04:03:13.284 INFO:teuthology.orchestra.run.smithi121.stdout: 676833 20 -rwxr-xr-x 1 ubuntu ubuntu 20334 Nov 14 2012 /home/ubuntu/cephtest/ior/config/depcomp 2023-05-24T04:03:13.284 INFO:teuthology.orchestra.run.smithi121.stdout: 676831 36 -rwxr-xr-x 1 ubuntu ubuntu 35454 Nov 14 2012 /home/ubuntu/cephtest/ior/config/config.sub 2023-05-24T04:03:13.285 INFO:teuthology.orchestra.run.smithi121.stdout: 677993 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/doc 2023-05-24T04:03:13.285 INFO:teuthology.orchestra.run.smithi121.stdout: 677997 4 -rw-rw-r-- 1 ubuntu ubuntu 28 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/Makefile.am 2023-05-24T04:03:13.285 INFO:teuthology.orchestra.run.smithi121.stdout: 677995 12 -rw-rw-r-- 1 ubuntu ubuntu 11651 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/Makefile.in 2023-05-24T04:03:13.285 INFO:teuthology.orchestra.run.smithi121.stdout: 676899 12 -rw-rw-r-- 1 ubuntu ubuntu 11669 May 24 04:00 /home/ubuntu/cephtest/ior/doc/Makefile 2023-05-24T04:03:13.286 INFO:teuthology.orchestra.run.smithi121.stdout: 677996 32 -rw-rw-r-- 1 ubuntu ubuntu 28938 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/USER_GUIDE 2023-05-24T04:03:13.286 INFO:teuthology.orchestra.run.smithi121.stdout: 676842 4 -rw-rw-r-- 1 ubuntu ubuntu 3326 Nov 14 2012 /home/ubuntu/cephtest/ior/configure.ac 2023-05-24T04:03:13.286 INFO:teuthology.orchestra.run.smithi121.stdout: 676843 4 -rwxrwxr-x 1 ubuntu ubuntu 281 Nov 14 2012 /home/ubuntu/cephtest/ior/bootstrap 2023-05-24T04:03:13.286 INFO:teuthology.orchestra.run.smithi121.stdout: 676907 4 drwxrwxr-x 8 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git 2023-05-24T04:03:13.287 INFO:teuthology.orchestra.run.smithi121.stdout: 676945 4 drwxrwxr-x 4 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects 2023-05-24T04:03:13.287 INFO:teuthology.orchestra.run.smithi121.stdout: 676946 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/info 2023-05-24T04:03:13.287 INFO:teuthology.orchestra.run.smithi121.stdout: 676965 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack 2023-05-24T04:03:13.287 INFO:teuthology.orchestra.run.smithi121.stdout: 676966 276 -r--r--r-- 1 ubuntu ubuntu 279020 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.pack 2023-05-24T04:03:13.289 INFO:teuthology.orchestra.run.smithi121.stdout: 677989 16 -r--r--r-- 1 ubuntu ubuntu 15436 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.idx 2023-05-24T04:03:13.290 INFO:teuthology.orchestra.run.smithi121.stdout: 677990 4 -rw-rw-r-- 1 ubuntu ubuntu 73 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/description 2023-05-24T04:03:13.290 INFO:teuthology.orchestra.run.smithi121.stdout: 676908 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/branches 2023-05-24T04:03:13.290 INFO:teuthology.orchestra.run.smithi121.stdout: 676936 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks 2023-05-24T04:03:13.291 INFO:teuthology.orchestra.run.smithi121.stdout: 676941 4 -rwxrwxr-x 1 ubuntu ubuntu 896 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/commit-msg.sample 2023-05-24T04:03:13.291 INFO:teuthology.orchestra.run.smithi121.stdout: 676939 4 -rwxrwxr-x 1 ubuntu ubuntu 189 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/post-update.sample 2023-05-24T04:03:13.291 INFO:teuthology.orchestra.run.smithi121.stdout: 676938 8 -rwxrwxr-x 1 ubuntu ubuntu 4898 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-rebase.sample 2023-05-24T04:03:13.292 INFO:teuthology.orchestra.run.smithi121.stdout: 676943 4 -rwxrwxr-x 1 ubuntu ubuntu 1239 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/prepare-commit-msg.sample 2023-05-24T04:03:13.292 INFO:teuthology.orchestra.run.smithi121.stdout: 676937 4 -rwxrwxr-x 1 ubuntu ubuntu 1704 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-commit.sample 2023-05-24T04:03:13.292 INFO:teuthology.orchestra.run.smithi121.stdout: 676944 4 -rwxrwxr-x 1 ubuntu ubuntu 3611 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/update.sample 2023-05-24T04:03:13.293 INFO:teuthology.orchestra.run.smithi121.stdout: 676940 4 -rwxrwxr-x 1 ubuntu ubuntu 398 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-applypatch.sample 2023-05-24T04:03:13.293 INFO:teuthology.orchestra.run.smithi121.stdout: 676942 4 -rwxrwxr-x 1 ubuntu ubuntu 452 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/applypatch-msg.sample 2023-05-24T04:03:13.294 INFO:teuthology.orchestra.run.smithi121.stdout: 676909 4 -rw-rw-r-- 1 ubuntu ubuntu 23 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/HEAD 2023-05-24T04:03:13.294 INFO:teuthology.orchestra.run.smithi121.stdout: 677991 4 -rw-rw-r-- 1 ubuntu ubuntu 2776 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/index 2023-05-24T04:03:13.294 INFO:teuthology.orchestra.run.smithi121.stdout: 676930 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs 2023-05-24T04:03:13.294 INFO:teuthology.orchestra.run.smithi121.stdout: 676931 4 -rw-rw-r-- 1 ubuntu ubuntu 176 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/HEAD 2023-05-24T04:03:13.294 INFO:teuthology.orchestra.run.smithi121.stdout: 676932 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs 2023-05-24T04:03:13.295 INFO:teuthology.orchestra.run.smithi121.stdout: 676933 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs/heads 2023-05-24T04:03:13.295 INFO:teuthology.orchestra.run.smithi121.stdout: 676934 4 -rw-rw-r-- 1 ubuntu ubuntu 176 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs/heads/master 2023-05-24T04:03:13.295 INFO:teuthology.orchestra.run.smithi121.stdout: 676929 4 -rw-rw-r-- 1 ubuntu ubuntu 257 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/config 2023-05-24T04:03:13.295 INFO:teuthology.orchestra.run.smithi121.stdout: 676910 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/info 2023-05-24T04:03:13.296 INFO:teuthology.orchestra.run.smithi121.stdout: 676911 4 -rw-rw-r-- 1 ubuntu ubuntu 240 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/info/exclude 2023-05-24T04:03:13.297 INFO:teuthology.orchestra.run.smithi121.stdout: 676935 4 -rw-rw-r-- 1 ubuntu ubuntu 798 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/packed-refs 2023-05-24T04:03:13.297 INFO:teuthology.orchestra.run.smithi121.stdout: 676912 4 drwxrwxr-x 5 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs 2023-05-24T04:03:13.297 INFO:teuthology.orchestra.run.smithi121.stdout: 676913 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/tags 2023-05-24T04:03:13.298 INFO:teuthology.orchestra.run.smithi121.stdout: 676916 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes 2023-05-24T04:03:13.298 INFO:teuthology.orchestra.run.smithi121.stdout: 676917 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes/origin 2023-05-24T04:03:13.298 INFO:teuthology.orchestra.run.smithi121.stdout: 676918 4 -rw-rw-r-- 1 ubuntu ubuntu 32 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes/origin/HEAD 2023-05-24T04:03:13.298 INFO:teuthology.orchestra.run.smithi121.stdout: 676914 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/heads 2023-05-24T04:03:13.298 INFO:teuthology.orchestra.run.smithi121.stdout: 676915 4 -rw-rw-r-- 1 ubuntu ubuntu 41 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/heads/master 2023-05-24T04:03:13.299 INFO:teuthology.orchestra.run.smithi121.stdout: 676835 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts 2023-05-24T04:03:13.299 INFO:teuthology.orchestra.run.smithi121.stdout: 676837 4 -rw-rw-r-- 1 ubuntu ubuntu 3361 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/run_script.linux 2023-05-24T04:03:13.300 INFO:teuthology.orchestra.run.smithi121.stdout: 676838 4 -rw-rw-r-- 1 ubuntu ubuntu 371 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/exampleScript 2023-05-24T04:03:13.301 INFO:teuthology.orchestra.run.smithi121.stdout: 676836 4 -rw-rw-r-- 1 ubuntu ubuntu 3360 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/run_script.cnl 2023-05-24T04:03:13.301 INFO:teuthology.orchestra.run.smithi121.stdout: 676898 4 drwxrwxr-x 3 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/contrib 2023-05-24T04:03:13.301 INFO:teuthology.orchestra.run.smithi121.stdout: 676901 32 -rw-rw-r-- 1 ubuntu ubuntu 29056 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/cbif.o 2023-05-24T04:03:13.302 INFO:teuthology.orchestra.run.smithi121.stdout: 676902 24 -rwxrwxr-x 1 ubuntu ubuntu 23627 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/cbif 2023-05-24T04:03:13.302 INFO:teuthology.orchestra.run.smithi121.stdout: 676903 8 -rw-rw-r-- 1 ubuntu ubuntu 4506 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/cbif.c 2023-05-24T04:03:13.302 INFO:teuthology.orchestra.run.smithi121.stdout: 676904 4 -rw-rw-r-- 1 ubuntu ubuntu 45 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/Makefile.am 2023-05-24T04:03:13.302 INFO:teuthology.orchestra.run.smithi121.stdout: 676900 16 -rw-rw-r-- 1 ubuntu ubuntu 13136 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/Makefile.in 2023-05-24T04:03:13.302 INFO:teuthology.orchestra.run.smithi121.stdout: 676847 16 -rw-rw-r-- 1 ubuntu ubuntu 12808 May 24 04:00 /home/ubuntu/cephtest/ior/contrib/Makefile 2023-05-24T04:03:13.303 INFO:teuthology.orchestra.run.smithi121.stdout: 676905 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/.deps 2023-05-24T04:03:13.303 INFO:teuthology.orchestra.run.smithi121.stdout: 676906 8 -rw-rw-r-- 1 ubuntu ubuntu 4565 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/.deps/cbif.Po 2023-05-24T04:03:13.304 INFO:teuthology.orchestra.run.smithi121.stdout: 673533 40 -rw-rw-r-- 1 ubuntu ubuntu 37808 Nov 14 2012 /home/ubuntu/cephtest/ior/aclocal.m4 2023-05-24T04:03:13.304 INFO:teuthology.orchestra.run.smithi121.stdout: 676821 4 -rw-rw-r-- 1 ubuntu ubuntu 6 Nov 14 2012 /home/ubuntu/cephtest/ior/hosts 2023-05-24T04:03:13.305 INFO:teuthology.orchestra.run.smithi155.stdout: 655476 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 24 04:03 /home/ubuntu/cephtest 2023-05-24T04:03:13.306 INFO:teuthology.orchestra.run.smithi155.stdout: 663657 804 -rw-rw-r-- 1 ubuntu ubuntu 819271 Jan 8 2013 /home/ubuntu/cephtest/ior.tbz2 2023-05-24T04:03:13.306 INFO:teuthology.orchestra.run.smithi155.stdout: 798872 4 drwxr-xr-x 9 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior 2023-05-24T04:03:13.306 INFO:teuthology.orchestra.run.smithi155.stdout: 802053 36 -rwxrwxr-x 1 ubuntu ubuntu 34739 May 24 04:00 /home/ubuntu/cephtest/ior/config.status 2023-05-24T04:03:13.307 INFO:teuthology.orchestra.run.smithi155.stdout: 802006 4 drwxrwxr-x 4 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/src 2023-05-24T04:03:13.307 INFO:teuthology.orchestra.run.smithi155.stdout: 802022 8 -rw-rw-r-- 1 ubuntu ubuntu 7616 Nov 14 2012 /home/ubuntu/cephtest/ior/src/iordef.h 2023-05-24T04:03:13.308 INFO:teuthology.orchestra.run.smithi155.stdout: 802049 408 -rw-rw-r-- 1 ubuntu ubuntu 415232 May 24 04:00 /home/ubuntu/cephtest/ior/src/ior.o 2023-05-24T04:03:13.308 INFO:teuthology.orchestra.run.smithi155.stdout: 802017 104 -rw-rw-r-- 1 ubuntu ubuntu 102750 Nov 14 2012 /home/ubuntu/cephtest/ior/src/ior.c 2023-05-24T04:03:13.308 INFO:teuthology.orchestra.run.smithi155.stdout: 802009 20 -rw-rw-r-- 1 ubuntu ubuntu 18449 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-MPIIO.c 2023-05-24T04:03:13.309 INFO:teuthology.orchestra.run.smithi155.stdout: 802026 4 -rw-rw-r-- 1 ubuntu ubuntu 501 Nov 14 2012 /home/ubuntu/cephtest/ior/src/Makefile.am 2023-05-24T04:03:13.309 INFO:teuthology.orchestra.run.smithi155.stdout: 802013 20 -rw-rw-r-- 1 ubuntu ubuntu 17668 Nov 14 2012 /home/ubuntu/cephtest/ior/src/Makefile.in 2023-05-24T04:03:13.310 INFO:teuthology.orchestra.run.smithi155.stdout: 802015 52 -rw-rw-r-- 1 ubuntu ubuntu 52400 May 24 04:00 /home/ubuntu/cephtest/ior/src/aiori-POSIX.o 2023-05-24T04:03:13.310 INFO:teuthology.orchestra.run.smithi155.stdout: 802019 4 -rw-rw-r-- 1 ubuntu ubuntu 1010 Nov 14 2012 /home/ubuntu/cephtest/ior/src/utilities.h 2023-05-24T04:03:13.312 INFO:teuthology.orchestra.run.smithi155.stdout: 798874 20 -rw-rw-r-- 1 ubuntu ubuntu 16828 May 24 04:00 /home/ubuntu/cephtest/ior/src/Makefile 2023-05-24T04:03:13.312 INFO:teuthology.orchestra.run.smithi155.stdout: 802133 8 -rw-rw-r-- 1 ubuntu ubuntu 4716 May 24 04:00 /home/ubuntu/cephtest/ior/src/config.h 2023-05-24T04:03:13.312 INFO:teuthology.orchestra.run.smithi155.stdout: 802025 24 -rw-rw-r-- 1 ubuntu ubuntu 23290 Nov 14 2012 /home/ubuntu/cephtest/ior/src/parse_options.c 2023-05-24T04:03:13.313 INFO:teuthology.orchestra.run.smithi155.stdout: 802047 16 -rw-rw-r-- 1 ubuntu ubuntu 14528 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-NCMPI.c 2023-05-24T04:03:13.313 INFO:teuthology.orchestra.run.smithi155.stdout: 802012 4 -rw-rw-r-- 1 ubuntu ubuntu 788 Nov 14 2012 /home/ubuntu/cephtest/ior/src/parse_options.h 2023-05-24T04:03:13.313 INFO:teuthology.orchestra.run.smithi155.stdout: 802007 16 -rw-rw-r-- 1 ubuntu ubuntu 14651 Nov 14 2012 /home/ubuntu/cephtest/ior/src/utilities.c 2023-05-24T04:03:13.313 INFO:teuthology.orchestra.run.smithi155.stdout: 802023 68 -rw-rw-r-- 1 ubuntu ubuntu 66392 May 24 04:00 /home/ubuntu/cephtest/ior/src/utilities.o 2023-05-24T04:03:13.314 INFO:teuthology.orchestra.run.smithi155.stdout: 802024 96 -rw-rw-r-- 1 ubuntu ubuntu 96568 May 24 04:00 /home/ubuntu/cephtest/ior/src/parse_options.o 2023-05-24T04:03:13.314 INFO:teuthology.orchestra.run.smithi155.stdout: 802044 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win 2023-05-24T04:03:13.314 INFO:teuthology.orchestra.run.smithi155.stdout: 802046 40 -rw-rw-r-- 1 ubuntu ubuntu 38845 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win/getopt.c 2023-05-24T04:03:13.314 INFO:teuthology.orchestra.run.smithi155.stdout: 802045 8 -rw-rw-r-- 1 ubuntu ubuntu 6783 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win/getopt.h 2023-05-24T04:03:13.315 INFO:teuthology.orchestra.run.smithi155.stdout: 802010 4 -rw-rw-r-- 1 ubuntu ubuntu 27 May 24 04:00 /home/ubuntu/cephtest/ior/src/stamp-h1 2023-05-24T04:03:13.315 INFO:teuthology.orchestra.run.smithi155.stdout: 802043 24 -rw-rw-r-- 1 ubuntu ubuntu 23136 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-HDF5.c 2023-05-24T04:03:13.315 INFO:teuthology.orchestra.run.smithi155.stdout: 802011 16 -rw-rw-r-- 1 ubuntu ubuntu 13065 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-POSIX.c 2023-05-24T04:03:13.316 INFO:teuthology.orchestra.run.smithi155.stdout: 802020 8 -rw-rw-r-- 1 ubuntu ubuntu 7357 Nov 14 2012 /home/ubuntu/cephtest/ior/src/ior.h 2023-05-24T04:03:13.316 INFO:teuthology.orchestra.run.smithi155.stdout: 802027 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps 2023-05-24T04:03:13.317 INFO:teuthology.orchestra.run.smithi155.stdout: 802036 12 -rw-rw-r-- 1 ubuntu ubuntu 11771 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/aiori-MPIIO.Po 2023-05-24T04:03:13.317 INFO:teuthology.orchestra.run.smithi155.stdout: 802034 4 -rw-rw-r-- 1 ubuntu ubuntu 8 Nov 14 2012 /home/ubuntu/cephtest/ior/src/.deps/aiori-NCMPI.Po 2023-05-24T04:03:13.317 INFO:teuthology.orchestra.run.smithi155.stdout: 802035 16 -rw-rw-r-- 1 ubuntu ubuntu 13048 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/aiori-POSIX.Po 2023-05-24T04:03:13.317 INFO:teuthology.orchestra.run.smithi155.stdout: 802018 16 -rw-rw-r-- 1 ubuntu ubuntu 13298 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/ior.Po 2023-05-24T04:03:13.318 INFO:teuthology.orchestra.run.smithi155.stdout: 802038 12 -rw-rw-r-- 1 ubuntu ubuntu 11547 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/parse_options.Po 2023-05-24T04:03:13.318 INFO:teuthology.orchestra.run.smithi155.stdout: 802028 4 -rw-rw-r-- 1 ubuntu ubuntu 8 Nov 14 2012 /home/ubuntu/cephtest/ior/src/.deps/aiori-HDF5.Po 2023-05-24T04:03:13.318 INFO:teuthology.orchestra.run.smithi155.stdout: 802037 16 -rw-rw-r-- 1 ubuntu ubuntu 13558 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/utilities.Po 2023-05-24T04:03:13.318 INFO:teuthology.orchestra.run.smithi155.stdout: 802021 68 -rw-rw-r-- 1 ubuntu ubuntu 67760 May 24 04:00 /home/ubuntu/cephtest/ior/src/aiori-MPIIO.o 2023-05-24T04:03:13.319 INFO:teuthology.orchestra.run.smithi155.stdout: 802014 8 -rw-rw-r-- 1 ubuntu ubuntu 4404 Nov 14 2012 /home/ubuntu/cephtest/ior/src/config.h.in 2023-05-24T04:03:13.319 INFO:teuthology.orchestra.run.smithi155.stdout: 802048 4 -rw-rw-r-- 1 ubuntu ubuntu 3099 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori.h 2023-05-24T04:03:13.319 INFO:teuthology.orchestra.run.smithi155.stdout: 802051 4 -rw-rw-r-- 1 ubuntu ubuntu 542 Nov 14 2012 /home/ubuntu/cephtest/ior/README 2023-05-24T04:03:13.320 INFO:teuthology.orchestra.run.smithi155.stdout: 802000 188 -rwxrwxr-x 1 ubuntu ubuntu 189589 Nov 14 2012 /home/ubuntu/cephtest/ior/configure 2023-05-24T04:03:13.320 INFO:teuthology.orchestra.run.smithi155.stdout: 802005 8 -rw-rw-r-- 1 ubuntu ubuntu 7084 Nov 14 2012 /home/ubuntu/cephtest/ior/ChangeLog 2023-05-24T04:03:13.320 INFO:teuthology.orchestra.run.smithi155.stdout: 802052 4 -rw-rw-r-- 1 ubuntu ubuntu 71 Nov 14 2012 /home/ubuntu/cephtest/ior/Makefile.am 2023-05-24T04:03:13.321 INFO:teuthology.orchestra.run.smithi155.stdout: 802001 24 -rw-rw-r-- 1 ubuntu ubuntu 22560 Nov 14 2012 /home/ubuntu/cephtest/ior/Makefile.in 2023-05-24T04:03:13.321 INFO:teuthology.orchestra.run.smithi155.stdout: 802050 60 -rw-rw-r-- 1 ubuntu ubuntu 61408 May 24 04:00 /home/ubuntu/cephtest/ior/config.log 2023-05-24T04:03:13.321 INFO:teuthology.orchestra.run.smithi155.stdout: 802113 4 -rw-rw-r-- 1 ubuntu ubuntu 39 Nov 14 2012 /home/ubuntu/cephtest/ior/META 2023-05-24T04:03:13.322 INFO:teuthology.orchestra.run.smithi155.stdout: 798883 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/testing 2023-05-24T04:03:13.322 INFO:teuthology.orchestra.run.smithi155.stdout: 798886 4 -rw-rw-r-- 1 ubuntu ubuntu 75 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/hintsFile 2023-05-24T04:03:13.322 INFO:teuthology.orchestra.run.smithi155.stdout: 798887 48 -rwxrwxr-x 1 ubuntu ubuntu 45738 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/IOR-tester.py 2023-05-24T04:03:13.322 INFO:teuthology.orchestra.run.smithi155.stdout: 798885 4 -rw-rw-r-- 1 ubuntu ubuntu 1681 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/IOR-tester.README 2023-05-24T04:03:13.323 INFO:teuthology.orchestra.run.smithi155.stdout: 803164 24 -rw-rw-r-- 1 ubuntu ubuntu 22561 May 24 04:00 /home/ubuntu/cephtest/ior/Makefile 2023-05-24T04:03:13.323 INFO:teuthology.orchestra.run.smithi155.stdout: 802002 16 -rw-rw-r-- 1 ubuntu ubuntu 14585 Nov 14 2012 /home/ubuntu/cephtest/ior/COPYRIGHT 2023-05-24T04:03:13.323 INFO:teuthology.orchestra.run.smithi155.stdout: 798889 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/config 2023-05-24T04:03:13.323 INFO:teuthology.orchestra.run.smithi155.stdout: 801984 44 -rwxr-xr-x 1 ubuntu ubuntu 44826 Nov 14 2012 /home/ubuntu/cephtest/ior/config/config.guess 2023-05-24T04:03:13.323 INFO:teuthology.orchestra.run.smithi155.stdout: 801990 16 -rwxr-xr-x 1 ubuntu ubuntu 13998 Nov 14 2012 /home/ubuntu/cephtest/ior/config/install-sh 2023-05-24T04:03:13.324 INFO:teuthology.orchestra.run.smithi155.stdout: 801988 12 -rwxr-xr-x 1 ubuntu ubuntu 10346 Nov 14 2012 /home/ubuntu/cephtest/ior/config/missing 2023-05-24T04:03:13.324 INFO:teuthology.orchestra.run.smithi155.stdout: 801985 8 -rw-rw-r-- 1 ubuntu ubuntu 6153 Nov 14 2012 /home/ubuntu/cephtest/ior/config/ax_prog_cc_mpi.m4 2023-05-24T04:03:13.324 INFO:teuthology.orchestra.run.smithi155.stdout: 801986 4 -rw-rw-r-- 1 ubuntu ubuntu 3545 Nov 14 2012 /home/ubuntu/cephtest/ior/config/x_ac_meta.m4 2023-05-24T04:03:13.325 INFO:teuthology.orchestra.run.smithi155.stdout: 801989 20 -rwxr-xr-x 1 ubuntu ubuntu 20334 Nov 14 2012 /home/ubuntu/cephtest/ior/config/depcomp 2023-05-24T04:03:13.325 INFO:teuthology.orchestra.run.smithi155.stdout: 801987 36 -rwxr-xr-x 1 ubuntu ubuntu 35454 Nov 14 2012 /home/ubuntu/cephtest/ior/config/config.sub 2023-05-24T04:03:13.326 INFO:teuthology.orchestra.run.smithi155.stdout: 802132 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/doc 2023-05-24T04:03:13.326 INFO:teuthology.orchestra.run.smithi155.stdout: 803158 4 -rw-rw-r-- 1 ubuntu ubuntu 28 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/Makefile.am 2023-05-24T04:03:13.326 INFO:teuthology.orchestra.run.smithi155.stdout: 803156 12 -rw-rw-r-- 1 ubuntu ubuntu 11651 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/Makefile.in 2023-05-24T04:03:13.326 INFO:teuthology.orchestra.run.smithi155.stdout: 802060 12 -rw-rw-r-- 1 ubuntu ubuntu 11669 May 24 04:00 /home/ubuntu/cephtest/ior/doc/Makefile 2023-05-24T04:03:13.326 INFO:teuthology.orchestra.run.smithi155.stdout: 803157 32 -rw-rw-r-- 1 ubuntu ubuntu 28938 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/USER_GUIDE 2023-05-24T04:03:13.327 INFO:teuthology.orchestra.run.smithi155.stdout: 802003 4 -rw-rw-r-- 1 ubuntu ubuntu 3326 Nov 14 2012 /home/ubuntu/cephtest/ior/configure.ac 2023-05-24T04:03:13.327 INFO:teuthology.orchestra.run.smithi155.stdout: 802004 4 -rwxrwxr-x 1 ubuntu ubuntu 281 Nov 14 2012 /home/ubuntu/cephtest/ior/bootstrap 2023-05-24T04:03:13.328 INFO:teuthology.orchestra.run.smithi155.stdout: 802068 4 drwxrwxr-x 8 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git 2023-05-24T04:03:13.328 INFO:teuthology.orchestra.run.smithi155.stdout: 802106 4 drwxrwxr-x 4 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects 2023-05-24T04:03:13.328 INFO:teuthology.orchestra.run.smithi155.stdout: 802107 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/info 2023-05-24T04:03:13.328 INFO:teuthology.orchestra.run.smithi155.stdout: 802108 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack 2023-05-24T04:03:13.329 INFO:teuthology.orchestra.run.smithi155.stdout: 802109 276 -r--r--r-- 1 ubuntu ubuntu 279020 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.pack 2023-05-24T04:03:13.329 INFO:teuthology.orchestra.run.smithi155.stdout: 802110 16 -r--r--r-- 1 ubuntu ubuntu 15436 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.idx 2023-05-24T04:03:13.329 INFO:teuthology.orchestra.run.smithi155.stdout: 802111 4 -rw-rw-r-- 1 ubuntu ubuntu 73 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/description 2023-05-24T04:03:13.329 INFO:teuthology.orchestra.run.smithi155.stdout: 802069 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/branches 2023-05-24T04:03:13.330 INFO:teuthology.orchestra.run.smithi155.stdout: 802097 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks 2023-05-24T04:03:13.330 INFO:teuthology.orchestra.run.smithi155.stdout: 802102 4 -rwxrwxr-x 1 ubuntu ubuntu 896 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/commit-msg.sample 2023-05-24T04:03:13.330 INFO:teuthology.orchestra.run.smithi155.stdout: 802100 4 -rwxrwxr-x 1 ubuntu ubuntu 189 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/post-update.sample 2023-05-24T04:03:13.330 INFO:teuthology.orchestra.run.smithi155.stdout: 802099 8 -rwxrwxr-x 1 ubuntu ubuntu 4898 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-rebase.sample 2023-05-24T04:03:13.330 INFO:teuthology.orchestra.run.smithi155.stdout: 802104 4 -rwxrwxr-x 1 ubuntu ubuntu 1239 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/prepare-commit-msg.sample 2023-05-24T04:03:13.330 INFO:teuthology.orchestra.run.smithi155.stdout: 802098 4 -rwxrwxr-x 1 ubuntu ubuntu 1704 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-commit.sample 2023-05-24T04:03:13.331 INFO:teuthology.orchestra.run.smithi155.stdout: 802105 4 -rwxrwxr-x 1 ubuntu ubuntu 3611 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/update.sample 2023-05-24T04:03:13.331 INFO:teuthology.orchestra.run.smithi155.stdout: 802101 4 -rwxrwxr-x 1 ubuntu ubuntu 398 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-applypatch.sample 2023-05-24T04:03:13.331 INFO:teuthology.orchestra.run.smithi155.stdout: 802103 4 -rwxrwxr-x 1 ubuntu ubuntu 452 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/applypatch-msg.sample 2023-05-24T04:03:13.331 INFO:teuthology.orchestra.run.smithi155.stdout: 802070 4 -rw-rw-r-- 1 ubuntu ubuntu 23 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/HEAD 2023-05-24T04:03:13.332 INFO:teuthology.orchestra.run.smithi155.stdout: 802112 4 -rw-rw-r-- 1 ubuntu ubuntu 2776 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/index 2023-05-24T04:03:13.332 INFO:teuthology.orchestra.run.smithi155.stdout: 802081 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs 2023-05-24T04:03:13.332 INFO:teuthology.orchestra.run.smithi155.stdout: 802082 4 -rw-rw-r-- 1 ubuntu ubuntu 176 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/HEAD 2023-05-24T04:03:13.332 INFO:teuthology.orchestra.run.smithi155.stdout: 802083 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs 2023-05-24T04:03:13.333 INFO:teuthology.orchestra.run.smithi155.stdout: 802084 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs/heads 2023-05-24T04:03:13.333 INFO:teuthology.orchestra.run.smithi155.stdout: 802085 4 -rw-rw-r-- 1 ubuntu ubuntu 176 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs/heads/master 2023-05-24T04:03:13.333 INFO:teuthology.orchestra.run.smithi155.stdout: 802080 4 -rw-rw-r-- 1 ubuntu ubuntu 257 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/config 2023-05-24T04:03:13.333 INFO:teuthology.orchestra.run.smithi155.stdout: 802071 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/info 2023-05-24T04:03:13.333 INFO:teuthology.orchestra.run.smithi155.stdout: 802072 4 -rw-rw-r-- 1 ubuntu ubuntu 240 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/info/exclude 2023-05-24T04:03:13.334 INFO:teuthology.orchestra.run.smithi155.stdout: 802096 4 -rw-rw-r-- 1 ubuntu ubuntu 798 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/packed-refs 2023-05-24T04:03:13.334 INFO:teuthology.orchestra.run.smithi155.stdout: 802073 4 drwxrwxr-x 5 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs 2023-05-24T04:03:13.334 INFO:teuthology.orchestra.run.smithi155.stdout: 802074 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/tags 2023-05-24T04:03:13.334 INFO:teuthology.orchestra.run.smithi155.stdout: 802077 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes 2023-05-24T04:03:13.334 INFO:teuthology.orchestra.run.smithi155.stdout: 802078 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes/origin 2023-05-24T04:03:13.335 INFO:teuthology.orchestra.run.smithi155.stdout: 802079 4 -rw-rw-r-- 1 ubuntu ubuntu 32 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes/origin/HEAD 2023-05-24T04:03:13.335 INFO:teuthology.orchestra.run.smithi155.stdout: 802075 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/heads 2023-05-24T04:03:13.335 INFO:teuthology.orchestra.run.smithi155.stdout: 802076 4 -rw-rw-r-- 1 ubuntu ubuntu 41 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/heads/master 2023-05-24T04:03:13.335 INFO:teuthology.orchestra.run.smithi155.stdout: 801996 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts 2023-05-24T04:03:13.336 INFO:teuthology.orchestra.run.smithi155.stdout: 801998 4 -rw-rw-r-- 1 ubuntu ubuntu 3361 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/run_script.linux 2023-05-24T04:03:13.336 INFO:teuthology.orchestra.run.smithi155.stdout: 801999 4 -rw-rw-r-- 1 ubuntu ubuntu 371 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/exampleScript 2023-05-24T04:03:13.336 INFO:teuthology.orchestra.run.smithi155.stdout: 801997 4 -rw-rw-r-- 1 ubuntu ubuntu 3360 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/run_script.cnl 2023-05-24T04:03:13.336 INFO:teuthology.orchestra.run.smithi155.stdout: 802054 4 drwxrwxr-x 3 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/contrib 2023-05-24T04:03:13.337 INFO:teuthology.orchestra.run.smithi155.stdout: 802062 32 -rw-rw-r-- 1 ubuntu ubuntu 29056 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/cbif.o 2023-05-24T04:03:13.337 INFO:teuthology.orchestra.run.smithi155.stdout: 802063 24 -rwxrwxr-x 1 ubuntu ubuntu 23627 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/cbif 2023-05-24T04:03:13.337 INFO:teuthology.orchestra.run.smithi155.stdout: 802064 8 -rw-rw-r-- 1 ubuntu ubuntu 4506 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/cbif.c 2023-05-24T04:03:13.337 INFO:teuthology.orchestra.run.smithi155.stdout: 802065 4 -rw-rw-r-- 1 ubuntu ubuntu 45 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/Makefile.am 2023-05-24T04:03:13.338 INFO:teuthology.orchestra.run.smithi155.stdout: 802061 16 -rw-rw-r-- 1 ubuntu ubuntu 13136 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/Makefile.in 2023-05-24T04:03:13.338 INFO:teuthology.orchestra.run.smithi155.stdout: 802008 16 -rw-rw-r-- 1 ubuntu ubuntu 12808 May 24 04:00 /home/ubuntu/cephtest/ior/contrib/Makefile 2023-05-24T04:03:13.338 INFO:teuthology.orchestra.run.smithi155.stdout: 802066 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/.deps 2023-05-24T04:03:13.338 INFO:teuthology.orchestra.run.smithi155.stdout: 802067 8 -rw-rw-r-- 1 ubuntu ubuntu 4565 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/.deps/cbif.Po 2023-05-24T04:03:13.339 INFO:teuthology.orchestra.run.smithi155.stdout: 798873 40 -rw-rw-r-- 1 ubuntu ubuntu 37808 Nov 14 2012 /home/ubuntu/cephtest/ior/aclocal.m4 2023-05-24T04:03:13.339 INFO:teuthology.orchestra.run.smithi155.stdout: 798888 4 -rw-rw-r-- 1 ubuntu ubuntu 6 Nov 14 2012 /home/ubuntu/cephtest/ior/hosts 2023-05-24T04:03:13.340 INFO:teuthology.orchestra.run.smithi121.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-05-24T04:03:13.340 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-05-24T04:03:13.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T04:03:13.342 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi121 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-05-24T04:03:13.350 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-05-24T04:03:13.368 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-05-24T04:03:13.380 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi121 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-05-24T04:03:13.381 INFO:teuthology.nuke:Checking targets against current locks 2023-05-24T04:03:13.386 INFO:teuthology.orchestra.run.smithi162.stdout: 655472 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 24 04:03 /home/ubuntu/cephtest 2023-05-24T04:03:13.386 INFO:teuthology.orchestra.run.smithi162.stdout: 668860 804 -rw-rw-r-- 1 ubuntu ubuntu 819271 Jan 8 2013 /home/ubuntu/cephtest/ior.tbz2 2023-05-24T04:03:13.386 INFO:teuthology.orchestra.run.smithi162.stdout: 793490 4 drwxr-xr-x 9 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior 2023-05-24T04:03:13.387 INFO:teuthology.orchestra.run.smithi162.stdout: 796682 36 -rwxrwxr-x 1 ubuntu ubuntu 34739 May 24 04:00 /home/ubuntu/cephtest/ior/config.status 2023-05-24T04:03:13.441 INFO:teuthology.orchestra.run.smithi162.stdout: 796635 4 drwxrwxr-x 4 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/src 2023-05-24T04:03:13.441 INFO:teuthology.orchestra.run.smithi162.stdout: 796651 8 -rw-rw-r-- 1 ubuntu ubuntu 7616 Nov 14 2012 /home/ubuntu/cephtest/ior/src/iordef.h 2023-05-24T04:03:13.442 INFO:teuthology.orchestra.run.smithi162.stdout: 796678 408 -rw-rw-r-- 1 ubuntu ubuntu 415232 May 24 04:00 /home/ubuntu/cephtest/ior/src/ior.o 2023-05-24T04:03:13.442 INFO:teuthology.orchestra.run.smithi162.stdout: 796646 104 -rw-rw-r-- 1 ubuntu ubuntu 102750 Nov 14 2012 /home/ubuntu/cephtest/ior/src/ior.c 2023-05-24T04:03:13.442 INFO:teuthology.orchestra.run.smithi162.stdout: 796638 20 -rw-rw-r-- 1 ubuntu ubuntu 18449 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-MPIIO.c 2023-05-24T04:03:13.442 INFO:teuthology.orchestra.run.smithi162.stdout: 796655 4 -rw-rw-r-- 1 ubuntu ubuntu 501 Nov 14 2012 /home/ubuntu/cephtest/ior/src/Makefile.am 2023-05-24T04:03:13.443 INFO:teuthology.orchestra.run.smithi162.stdout: 796642 20 -rw-rw-r-- 1 ubuntu ubuntu 17668 Nov 14 2012 /home/ubuntu/cephtest/ior/src/Makefile.in 2023-05-24T04:03:13.443 INFO:teuthology.orchestra.run.smithi162.stdout: 796644 52 -rw-rw-r-- 1 ubuntu ubuntu 52400 May 24 04:00 /home/ubuntu/cephtest/ior/src/aiori-POSIX.o 2023-05-24T04:03:13.443 INFO:teuthology.orchestra.run.smithi162.stdout: 796648 4 -rw-rw-r-- 1 ubuntu ubuntu 1010 Nov 14 2012 /home/ubuntu/cephtest/ior/src/utilities.h 2023-05-24T04:03:13.443 INFO:teuthology.orchestra.run.smithi162.stdout: 793498 20 -rw-rw-r-- 1 ubuntu ubuntu 16828 May 24 04:00 /home/ubuntu/cephtest/ior/src/Makefile 2023-05-24T04:03:13.443 INFO:teuthology.orchestra.run.smithi162.stdout: 796744 8 -rw-rw-r-- 1 ubuntu ubuntu 4716 May 24 04:00 /home/ubuntu/cephtest/ior/src/config.h 2023-05-24T04:03:13.443 INFO:teuthology.orchestra.run.smithi162.stdout: 796654 24 -rw-rw-r-- 1 ubuntu ubuntu 23290 Nov 14 2012 /home/ubuntu/cephtest/ior/src/parse_options.c 2023-05-24T04:03:13.444 INFO:teuthology.orchestra.run.smithi162.stdout: 796676 16 -rw-rw-r-- 1 ubuntu ubuntu 14528 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-NCMPI.c 2023-05-24T04:03:13.444 INFO:teuthology.orchestra.run.smithi162.stdout: 796641 4 -rw-rw-r-- 1 ubuntu ubuntu 788 Nov 14 2012 /home/ubuntu/cephtest/ior/src/parse_options.h 2023-05-24T04:03:13.444 INFO:teuthology.orchestra.run.smithi162.stdout: 796636 16 -rw-rw-r-- 1 ubuntu ubuntu 14651 Nov 14 2012 /home/ubuntu/cephtest/ior/src/utilities.c 2023-05-24T04:03:13.444 INFO:teuthology.orchestra.run.smithi162.stdout: 796652 68 -rw-rw-r-- 1 ubuntu ubuntu 66392 May 24 04:00 /home/ubuntu/cephtest/ior/src/utilities.o 2023-05-24T04:03:13.445 INFO:teuthology.orchestra.run.smithi162.stdout: 796653 96 -rw-rw-r-- 1 ubuntu ubuntu 96568 May 24 04:00 /home/ubuntu/cephtest/ior/src/parse_options.o 2023-05-24T04:03:13.445 INFO:teuthology.orchestra.run.smithi162.stdout: 796669 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win 2023-05-24T04:03:13.445 INFO:teuthology.orchestra.run.smithi162.stdout: 796671 40 -rw-rw-r-- 1 ubuntu ubuntu 38845 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win/getopt.c 2023-05-24T04:03:13.445 INFO:teuthology.orchestra.run.smithi162.stdout: 796670 8 -rw-rw-r-- 1 ubuntu ubuntu 6783 Nov 14 2012 /home/ubuntu/cephtest/ior/src/win/getopt.h 2023-05-24T04:03:13.445 INFO:teuthology.orchestra.run.smithi162.stdout: 796639 4 -rw-rw-r-- 1 ubuntu ubuntu 27 May 24 04:00 /home/ubuntu/cephtest/ior/src/stamp-h1 2023-05-24T04:03:13.445 INFO:teuthology.orchestra.run.smithi162.stdout: 796668 24 -rw-rw-r-- 1 ubuntu ubuntu 23136 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-HDF5.c 2023-05-24T04:03:13.446 INFO:teuthology.orchestra.run.smithi162.stdout: 796640 16 -rw-rw-r-- 1 ubuntu ubuntu 13065 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori-POSIX.c 2023-05-24T04:03:13.446 INFO:teuthology.orchestra.run.smithi162.stdout: 796649 8 -rw-rw-r-- 1 ubuntu ubuntu 7357 Nov 14 2012 /home/ubuntu/cephtest/ior/src/ior.h 2023-05-24T04:03:13.446 INFO:teuthology.orchestra.run.smithi162.stdout: 796656 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps 2023-05-24T04:03:13.446 INFO:teuthology.orchestra.run.smithi162.stdout: 796661 12 -rw-rw-r-- 1 ubuntu ubuntu 11771 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/aiori-MPIIO.Po 2023-05-24T04:03:13.446 INFO:teuthology.orchestra.run.smithi162.stdout: 796659 4 -rw-rw-r-- 1 ubuntu ubuntu 8 Nov 14 2012 /home/ubuntu/cephtest/ior/src/.deps/aiori-NCMPI.Po 2023-05-24T04:03:13.447 INFO:teuthology.orchestra.run.smithi162.stdout: 796660 16 -rw-rw-r-- 1 ubuntu ubuntu 13048 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/aiori-POSIX.Po 2023-05-24T04:03:13.447 INFO:teuthology.orchestra.run.smithi162.stdout: 796647 16 -rw-rw-r-- 1 ubuntu ubuntu 13298 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/ior.Po 2023-05-24T04:03:13.447 INFO:teuthology.orchestra.run.smithi162.stdout: 796667 12 -rw-rw-r-- 1 ubuntu ubuntu 11547 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/parse_options.Po 2023-05-24T04:03:13.447 INFO:teuthology.orchestra.run.smithi162.stdout: 796657 4 -rw-rw-r-- 1 ubuntu ubuntu 8 Nov 14 2012 /home/ubuntu/cephtest/ior/src/.deps/aiori-HDF5.Po 2023-05-24T04:03:13.447 INFO:teuthology.orchestra.run.smithi162.stdout: 796666 16 -rw-rw-r-- 1 ubuntu ubuntu 13558 May 24 04:00 /home/ubuntu/cephtest/ior/src/.deps/utilities.Po 2023-05-24T04:03:13.448 INFO:teuthology.orchestra.run.smithi162.stdout: 796650 68 -rw-rw-r-- 1 ubuntu ubuntu 67760 May 24 04:00 /home/ubuntu/cephtest/ior/src/aiori-MPIIO.o 2023-05-24T04:03:13.448 INFO:teuthology.orchestra.run.smithi162.stdout: 796643 8 -rw-rw-r-- 1 ubuntu ubuntu 4404 Nov 14 2012 /home/ubuntu/cephtest/ior/src/config.h.in 2023-05-24T04:03:13.448 INFO:teuthology.orchestra.run.smithi162.stdout: 796677 4 -rw-rw-r-- 1 ubuntu ubuntu 3099 Nov 14 2012 /home/ubuntu/cephtest/ior/src/aiori.h 2023-05-24T04:03:13.448 INFO:teuthology.orchestra.run.smithi162.stdout: 796680 4 -rw-rw-r-- 1 ubuntu ubuntu 542 Nov 14 2012 /home/ubuntu/cephtest/ior/README 2023-05-24T04:03:13.448 INFO:teuthology.orchestra.run.smithi162.stdout: 796629 188 -rwxrwxr-x 1 ubuntu ubuntu 189589 Nov 14 2012 /home/ubuntu/cephtest/ior/configure 2023-05-24T04:03:13.449 INFO:teuthology.orchestra.run.smithi162.stdout: 796634 8 -rw-rw-r-- 1 ubuntu ubuntu 7084 Nov 14 2012 /home/ubuntu/cephtest/ior/ChangeLog 2023-05-24T04:03:13.449 INFO:teuthology.orchestra.run.smithi162.stdout: 796681 4 -rw-rw-r-- 1 ubuntu ubuntu 71 Nov 14 2012 /home/ubuntu/cephtest/ior/Makefile.am 2023-05-24T04:03:13.449 INFO:teuthology.orchestra.run.smithi162.stdout: 796630 24 -rw-rw-r-- 1 ubuntu ubuntu 22560 Nov 14 2012 /home/ubuntu/cephtest/ior/Makefile.in 2023-05-24T04:03:13.449 INFO:teuthology.orchestra.run.smithi162.stdout: 796679 60 -rw-rw-r-- 1 ubuntu ubuntu 61408 May 24 04:00 /home/ubuntu/cephtest/ior/config.log 2023-05-24T04:03:13.449 INFO:teuthology.orchestra.run.smithi162.stdout: 796742 4 -rw-rw-r-- 1 ubuntu ubuntu 39 Nov 14 2012 /home/ubuntu/cephtest/ior/META 2023-05-24T04:03:13.450 INFO:teuthology.orchestra.run.smithi162.stdout: 793506 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/testing 2023-05-24T04:03:13.450 INFO:teuthology.orchestra.run.smithi162.stdout: 793508 4 -rw-rw-r-- 1 ubuntu ubuntu 75 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/hintsFile 2023-05-24T04:03:13.450 INFO:teuthology.orchestra.run.smithi162.stdout: 793509 48 -rwxrwxr-x 1 ubuntu ubuntu 45738 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/IOR-tester.py 2023-05-24T04:03:13.450 INFO:teuthology.orchestra.run.smithi162.stdout: 793507 4 -rw-rw-r-- 1 ubuntu ubuntu 1681 Nov 14 2012 /home/ubuntu/cephtest/ior/testing/IOR-tester.README 2023-05-24T04:03:13.450 INFO:teuthology.orchestra.run.smithi162.stdout: 797794 24 -rw-rw-r-- 1 ubuntu ubuntu 22561 May 24 04:00 /home/ubuntu/cephtest/ior/Makefile 2023-05-24T04:03:13.451 INFO:teuthology.orchestra.run.smithi162.stdout: 796631 16 -rw-rw-r-- 1 ubuntu ubuntu 14585 Nov 14 2012 /home/ubuntu/cephtest/ior/COPYRIGHT 2023-05-24T04:03:13.451 INFO:teuthology.orchestra.run.smithi162.stdout: 793520 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/config 2023-05-24T04:03:13.451 INFO:teuthology.orchestra.run.smithi162.stdout: 793521 44 -rwxr-xr-x 1 ubuntu ubuntu 44826 Nov 14 2012 /home/ubuntu/cephtest/ior/config/config.guess 2023-05-24T04:03:13.451 INFO:teuthology.orchestra.run.smithi162.stdout: 796619 16 -rwxr-xr-x 1 ubuntu ubuntu 13998 Nov 14 2012 /home/ubuntu/cephtest/ior/config/install-sh 2023-05-24T04:03:13.451 INFO:teuthology.orchestra.run.smithi162.stdout: 796617 12 -rwxr-xr-x 1 ubuntu ubuntu 10346 Nov 14 2012 /home/ubuntu/cephtest/ior/config/missing 2023-05-24T04:03:13.452 INFO:teuthology.orchestra.run.smithi162.stdout: 793522 8 -rw-rw-r-- 1 ubuntu ubuntu 6153 Nov 14 2012 /home/ubuntu/cephtest/ior/config/ax_prog_cc_mpi.m4 2023-05-24T04:03:13.452 INFO:teuthology.orchestra.run.smithi162.stdout: 793523 4 -rw-rw-r-- 1 ubuntu ubuntu 3545 Nov 14 2012 /home/ubuntu/cephtest/ior/config/x_ac_meta.m4 2023-05-24T04:03:13.452 INFO:teuthology.orchestra.run.smithi162.stdout: 796618 20 -rwxr-xr-x 1 ubuntu ubuntu 20334 Nov 14 2012 /home/ubuntu/cephtest/ior/config/depcomp 2023-05-24T04:03:13.452 INFO:teuthology.orchestra.run.smithi162.stdout: 793524 36 -rwxr-xr-x 1 ubuntu ubuntu 35454 Nov 14 2012 /home/ubuntu/cephtest/ior/config/config.sub 2023-05-24T04:03:13.452 INFO:teuthology.orchestra.run.smithi162.stdout: 796743 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/doc 2023-05-24T04:03:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: 796766 4 -rw-rw-r-- 1 ubuntu ubuntu 28 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/Makefile.am 2023-05-24T04:03:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: 796745 12 -rw-rw-r-- 1 ubuntu ubuntu 11651 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/Makefile.in 2023-05-24T04:03:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: 796684 12 -rw-rw-r-- 1 ubuntu ubuntu 11669 May 24 04:00 /home/ubuntu/cephtest/ior/doc/Makefile 2023-05-24T04:03:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: 796746 32 -rw-rw-r-- 1 ubuntu ubuntu 28938 Nov 14 2012 /home/ubuntu/cephtest/ior/doc/USER_GUIDE 2023-05-24T04:03:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: 796632 4 -rw-rw-r-- 1 ubuntu ubuntu 3326 Nov 14 2012 /home/ubuntu/cephtest/ior/configure.ac 2023-05-24T04:03:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: 796633 4 -rwxrwxr-x 1 ubuntu ubuntu 281 Nov 14 2012 /home/ubuntu/cephtest/ior/bootstrap 2023-05-24T04:03:13.454 INFO:teuthology.orchestra.run.smithi162.stdout: 796697 4 drwxrwxr-x 8 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git 2023-05-24T04:03:13.454 INFO:teuthology.orchestra.run.smithi162.stdout: 796735 4 drwxrwxr-x 4 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects 2023-05-24T04:03:13.454 INFO:teuthology.orchestra.run.smithi162.stdout: 796736 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/info 2023-05-24T04:03:13.454 INFO:teuthology.orchestra.run.smithi162.stdout: 796737 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack 2023-05-24T04:03:13.454 INFO:teuthology.orchestra.run.smithi162.stdout: 796738 276 -r--r--r-- 1 ubuntu ubuntu 279020 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.pack 2023-05-24T04:03:13.455 INFO:teuthology.orchestra.run.smithi162.stdout: 796739 16 -r--r--r-- 1 ubuntu ubuntu 15436 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/objects/pack/pack-63e5ce1a9a3dfb586833d8c295d17418061a46f7.idx 2023-05-24T04:03:13.455 INFO:teuthology.orchestra.run.smithi162.stdout: 796740 4 -rw-rw-r-- 1 ubuntu ubuntu 73 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/description 2023-05-24T04:03:13.455 INFO:teuthology.orchestra.run.smithi162.stdout: 796698 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/branches 2023-05-24T04:03:13.455 INFO:teuthology.orchestra.run.smithi162.stdout: 796716 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks 2023-05-24T04:03:13.455 INFO:teuthology.orchestra.run.smithi162.stdout: 796731 4 -rwxrwxr-x 1 ubuntu ubuntu 896 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/commit-msg.sample 2023-05-24T04:03:13.456 INFO:teuthology.orchestra.run.smithi162.stdout: 796729 4 -rwxrwxr-x 1 ubuntu ubuntu 189 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/post-update.sample 2023-05-24T04:03:13.456 INFO:teuthology.orchestra.run.smithi162.stdout: 796718 8 -rwxrwxr-x 1 ubuntu ubuntu 4898 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-rebase.sample 2023-05-24T04:03:13.456 INFO:teuthology.orchestra.run.smithi162.stdout: 796733 4 -rwxrwxr-x 1 ubuntu ubuntu 1239 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/prepare-commit-msg.sample 2023-05-24T04:03:13.456 INFO:teuthology.orchestra.run.smithi162.stdout: 796717 4 -rwxrwxr-x 1 ubuntu ubuntu 1704 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-commit.sample 2023-05-24T04:03:13.456 INFO:teuthology.orchestra.run.smithi162.stdout: 796734 4 -rwxrwxr-x 1 ubuntu ubuntu 3611 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/update.sample 2023-05-24T04:03:13.457 INFO:teuthology.orchestra.run.smithi162.stdout: 796730 4 -rwxrwxr-x 1 ubuntu ubuntu 398 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/pre-applypatch.sample 2023-05-24T04:03:13.457 INFO:teuthology.orchestra.run.smithi162.stdout: 796732 4 -rwxrwxr-x 1 ubuntu ubuntu 452 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/hooks/applypatch-msg.sample 2023-05-24T04:03:13.457 INFO:teuthology.orchestra.run.smithi162.stdout: 796699 4 -rw-rw-r-- 1 ubuntu ubuntu 23 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/HEAD 2023-05-24T04:03:13.457 INFO:teuthology.orchestra.run.smithi162.stdout: 796741 4 -rw-rw-r-- 1 ubuntu ubuntu 2776 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/index 2023-05-24T04:03:13.457 INFO:teuthology.orchestra.run.smithi162.stdout: 796710 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs 2023-05-24T04:03:13.458 INFO:teuthology.orchestra.run.smithi162.stdout: 796711 4 -rw-rw-r-- 1 ubuntu ubuntu 176 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/HEAD 2023-05-24T04:03:13.458 INFO:teuthology.orchestra.run.smithi162.stdout: 796712 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs 2023-05-24T04:03:13.458 INFO:teuthology.orchestra.run.smithi162.stdout: 796713 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs/heads 2023-05-24T04:03:13.458 INFO:teuthology.orchestra.run.smithi162.stdout: 796714 4 -rw-rw-r-- 1 ubuntu ubuntu 176 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/logs/refs/heads/master 2023-05-24T04:03:13.458 INFO:teuthology.orchestra.run.smithi162.stdout: 796709 4 -rw-rw-r-- 1 ubuntu ubuntu 257 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/config 2023-05-24T04:03:13.459 INFO:teuthology.orchestra.run.smithi162.stdout: 796700 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/info 2023-05-24T04:03:13.459 INFO:teuthology.orchestra.run.smithi162.stdout: 796701 4 -rw-rw-r-- 1 ubuntu ubuntu 240 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/info/exclude 2023-05-24T04:03:13.459 INFO:teuthology.orchestra.run.smithi162.stdout: 796715 4 -rw-rw-r-- 1 ubuntu ubuntu 798 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/packed-refs 2023-05-24T04:03:13.459 INFO:teuthology.orchestra.run.smithi162.stdout: 796702 4 drwxrwxr-x 5 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs 2023-05-24T04:03:13.459 INFO:teuthology.orchestra.run.smithi162.stdout: 796703 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/tags 2023-05-24T04:03:13.460 INFO:teuthology.orchestra.run.smithi162.stdout: 796706 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes 2023-05-24T04:03:13.460 INFO:teuthology.orchestra.run.smithi162.stdout: 796707 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes/origin 2023-05-24T04:03:13.460 INFO:teuthology.orchestra.run.smithi162.stdout: 796708 4 -rw-rw-r-- 1 ubuntu ubuntu 32 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/remotes/origin/HEAD 2023-05-24T04:03:13.460 INFO:teuthology.orchestra.run.smithi162.stdout: 796704 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/heads 2023-05-24T04:03:13.460 INFO:teuthology.orchestra.run.smithi162.stdout: 796705 4 -rw-rw-r-- 1 ubuntu ubuntu 41 Nov 14 2012 /home/ubuntu/cephtest/ior/.git/refs/heads/master 2023-05-24T04:03:13.461 INFO:teuthology.orchestra.run.smithi162.stdout: 796620 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts 2023-05-24T04:03:13.461 INFO:teuthology.orchestra.run.smithi162.stdout: 796622 4 -rw-rw-r-- 1 ubuntu ubuntu 3361 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/run_script.linux 2023-05-24T04:03:13.461 INFO:teuthology.orchestra.run.smithi162.stdout: 796623 4 -rw-rw-r-- 1 ubuntu ubuntu 371 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/exampleScript 2023-05-24T04:03:13.461 INFO:teuthology.orchestra.run.smithi162.stdout: 796621 4 -rw-rw-r-- 1 ubuntu ubuntu 3360 Nov 14 2012 /home/ubuntu/cephtest/ior/scripts/run_script.cnl 2023-05-24T04:03:13.461 INFO:teuthology.orchestra.run.smithi162.stdout: 796683 4 drwxrwxr-x 3 ubuntu ubuntu 4096 May 24 04:00 /home/ubuntu/cephtest/ior/contrib 2023-05-24T04:03:13.462 INFO:teuthology.orchestra.run.smithi162.stdout: 796686 32 -rw-rw-r-- 1 ubuntu ubuntu 29056 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/cbif.o 2023-05-24T04:03:13.462 INFO:teuthology.orchestra.run.smithi162.stdout: 796687 24 -rwxrwxr-x 1 ubuntu ubuntu 23627 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/cbif 2023-05-24T04:03:13.462 INFO:teuthology.orchestra.run.smithi162.stdout: 796693 8 -rw-rw-r-- 1 ubuntu ubuntu 4506 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/cbif.c 2023-05-24T04:03:13.462 INFO:teuthology.orchestra.run.smithi162.stdout: 796694 4 -rw-rw-r-- 1 ubuntu ubuntu 45 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/Makefile.am 2023-05-24T04:03:13.462 INFO:teuthology.orchestra.run.smithi162.stdout: 796685 16 -rw-rw-r-- 1 ubuntu ubuntu 13136 Nov 14 2012 /home/ubuntu/cephtest/ior/contrib/Makefile.in 2023-05-24T04:03:13.463 INFO:teuthology.orchestra.run.smithi162.stdout: 796637 16 -rw-rw-r-- 1 ubuntu ubuntu 12808 May 24 04:00 /home/ubuntu/cephtest/ior/contrib/Makefile 2023-05-24T04:03:13.463 INFO:teuthology.orchestra.run.smithi162.stdout: 796695 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/.deps 2023-05-24T04:03:13.463 INFO:teuthology.orchestra.run.smithi162.stdout: 796696 8 -rw-rw-r-- 1 ubuntu ubuntu 4565 Dec 7 2012 /home/ubuntu/cephtest/ior/contrib/.deps/cbif.Po 2023-05-24T04:03:13.463 INFO:teuthology.orchestra.run.smithi162.stdout: 793497 40 -rw-rw-r-- 1 ubuntu ubuntu 37808 Nov 14 2012 /home/ubuntu/cephtest/ior/aclocal.m4 2023-05-24T04:03:13.463 INFO:teuthology.orchestra.run.smithi162.stdout: 793518 4 -rw-rw-r-- 1 ubuntu ubuntu 6 Nov 14 2012 /home/ubuntu/cephtest/ior/hosts 2023-05-24T04:03:13.465 INFO:teuthology.orchestra.run.smithi162.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-05-24T04:03:13.492 DEBUG:teuthology.nuke:shortname: smithi040 2023-05-24T04:03:13.493 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T04:03:13.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.488544', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIcYehHKRCOZMJs0TX73ZxuODablbS0ht8/p5d3kfoXgkNWbQEwMR5zD9ZZXuD/3M6tQX9gSnmALqZj70Rg4Gu0='} 2023-05-24T04:03:13.525 DEBUG:teuthology.nuke:shortname: smithi067 2023-05-24T04:03:13.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T04:03:13.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.487276', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOUYy+0CXpAm6lgDQ8Z2zGCA0MeYOPttlj/daf5w+/xd'} 2023-05-24T04:03:13.561 DEBUG:teuthology.nuke:shortname: smithi121 2023-05-24T04:03:13.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T04:03:13.594 INFO:teuthology.orchestra.console:Power off smithi040 2023-05-24T04:03:13.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T04:03:13.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.484297', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2e/MzT90YFY933kSp8sC5l8DS0nZU55rxKQ/Vz2CmuGjeqiAsIbyBDnhPr6HcQpITpY05I8T7wQHaJhjhcN+4='} 2023-05-24T04:03:13.643 DEBUG:teuthology.nuke:shortname: smithi155 2023-05-24T04:03:13.644 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T04:03:13.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:13.679 DEBUG:teuthology.nuke:shortname: smithi162 2023-05-24T04:03:13.680 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T04:03:13.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.486041', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbdKZ0H3Wz2rH6WQwWfoMX0H1HuHJyuMHFKqhEX5Pu4YFuJ/mpBpRsdsebnGZ007+wQJexXSrhoDpUELvq4QgU='} 2023-05-24T04:03:13.694 INFO:teuthology.orchestra.console:Power off smithi067 2023-05-24T04:03:13.695 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T04:03:13.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:13.737 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:38:50.489784', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEsJoPbYwYzoVvmxpiWNCKjuwyMacSwAK4thGPAQ4eC5'} 2023-05-24T04:03:13.753 INFO:teuthology.orchestra.console:Power off smithi121 2023-05-24T04:03:13.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T04:03:13.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:13.807 INFO:teuthology.orchestra.console:Power off smithi155 2023-05-24T04:03:13.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T04:03:13.841 INFO:teuthology.orchestra.console:Power off smithi162 2023-05-24T04:03:13.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T04:03:13.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:13.869 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:17.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:17.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:17.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:17.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:17.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:21.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:21.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:21.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:22.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:22.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:22.214 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2023-05-24T04:03:25.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:26.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:26.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:26.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T04:03:26.163 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-05-24T04:03:26.253 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2023-05-24T04:03:26.305 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2023-05-24T04:03:26.353 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2023-05-24T04:03:26.534 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} duration: 906.2563142776489 failure_reason: 'Command failed on smithi162 with status 2: ''TESTDIR=/home/ubuntu/cephtest bash -s''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=aab1e3f856e64334995e28d90dda8cdb status: fail success: false 2023-05-24T04:03:26.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-24T04:03:26.635 INFO:teuthology.run:FAIL